[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:30:37 dist-test-slave-1jjb krb5kdc[11855](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:30:37 dist-test-slave-1jjb krb5kdc[11855](info): set up 2 sockets
Aug 09 15:30:37 dist-test-slave-1jjb krb5kdc[11855](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260809 15:30:38.554086 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.090s user 0.008s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:30:38 dist-test-slave-1jjb krb5kdc[11855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289438, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:30:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:30:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.146.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
I20260809 15:30:38.706027 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:44359
--webserver_interface=127.11.146.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:33621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:44359
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:30:38.832211 11869 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:30:38.832520 11869 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:30:38.832590 11869 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:30:38.836771 11869 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:30:38.836835 11869 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:30:38.836855 11869 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:30:38.836874 11869 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:30:38.836889 11869 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:30:38.842715 11869 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:33621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:44359
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:44359
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11869
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:30:38.844318 11869 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:30:38.845709 11869 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:30:38.857946 11875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:38.858265 11869 server_base.cc:1034] running on GCE node
W20260809 15:30:38.859526 11874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:38.859784 11878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:38.860708 11869 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:30:38.862694 11869 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:30:38.863978 11869 hybrid_clock.cc:648] HybridClock initialized: now 1786289438863949 us; error 69 us; skew 500 ppm
Aug 09 15:30:38 dist-test-slave-1jjb krb5kdc[11855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289438, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:30:38.867182 11869 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:30:38.868587 11869 webserver.cc:460] Webserver started at http://127.11.146.62:42853/ using document root <none> and password file <none>
I20260809 15:30:38.869484 11869 fs_manager.cc:359] Metadata directory not provided
I20260809 15:30:38.869590 11869 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:30:38.869992 11869 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:30:38.873003 11869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "13a949f4359045678d67e1ad35d1417e"
format_stamp: "Formatted at 2026-08-09 15:30:38 on dist-test-slave-1jjb"
server_key: "c788e8063aaf69fc03b1a107968327c2"
server_key_iv: "958217ba453caf754b5bac4690911225"
server_key_version: "encryptionkey@0"
I20260809 15:30:38.873668 11869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "13a949f4359045678d67e1ad35d1417e"
format_stamp: "Formatted at 2026-08-09 15:30:38 on dist-test-slave-1jjb"
server_key: "c788e8063aaf69fc03b1a107968327c2"
server_key_iv: "958217ba453caf754b5bac4690911225"
server_key_version: "encryptionkey@0"
I20260809 15:30:38.879182 11869 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 15:30:38.882918 11887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:38.884709 11869 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 15:30:38.884899 11869 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "13a949f4359045678d67e1ad35d1417e"
format_stamp: "Formatted at 2026-08-09 15:30:38 on dist-test-slave-1jjb"
server_key: "c788e8063aaf69fc03b1a107968327c2"
server_key_iv: "958217ba453caf754b5bac4690911225"
server_key_version: "encryptionkey@0"
I20260809 15:30:38.885038 11869 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:30:38.905611 11869 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:30:38.909183 11869 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:30:38.909449 11869 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:30:38.919950 11869 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:44359
I20260809 15:30:38.920025 11946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:44359 every 8 connection(s)
I20260809 15:30:38.921375 11869 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:30:38.925135 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 11869
I20260809 15:30:38.925321 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:30:38.926291 11947 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:30:38.926813 11848 external_mini_cluster.cc:1428] Setting key eda2c22c108543d6299b8b2dbca90de8
I20260809 15:30:38.936973 11947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13a949f4359045678d67e1ad35d1417e: Bootstrap starting.
I20260809 15:30:38.941501 11947 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 13a949f4359045678d67e1ad35d1417e: Neither blocks nor log segments found. Creating new log.
I20260809 15:30:38.943085 11947 log.cc:824] T 00000000000000000000000000000000 P 13a949f4359045678d67e1ad35d1417e: Log is configured to *not* fsync() on all Append() calls
I20260809 15:30:38.946326 11947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13a949f4359045678d67e1ad35d1417e: No bootstrap required, opened a new log
Aug 09 15:30:38 dist-test-slave-1jjb krb5kdc[11855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289438, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:30:38.953255 11947 raft_consensus.cc:348] T 00000000000000000000000000000000 P 13a949f4359045678d67e1ad35d1417e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13a949f4359045678d67e1ad35d1417e" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44359 } }
I20260809 15:30:38.953594 11947 raft_consensus.cc:374] T 00000000000000000000000000000000 P 13a949f4359045678d67e1ad35d1417e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:30:38.953716 11947 raft_consensus.cc:729] T 00000000000000000000000000000000 P 13a949f4359045678d67e1ad35d1417e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13a949f4359045678d67e1ad35d1417e, State: Initialized, Role: FOLLOWER
I20260809 15:30:38.954480 11947 consensus_queue.cc:260] T 00000000000000000000000000000000 P 13a949f4359045678d67e1ad35d1417e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13a949f4359045678d67e1ad35d1417e" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44359 } }
I20260809 15:30:38.954695 11947 raft_consensus.cc:388] T 00000000000000000000000000000000 P 13a949f4359045678d67e1ad35d1417e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:30:38.954836 11947 raft_consensus.cc:482] T 00000000000000000000000000000000 P 13a949f4359045678d67e1ad35d1417e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:30:38.955014 11947 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 13a949f4359045678d67e1ad35d1417e [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:30:38.956339 11947 raft_consensus.cc:504] T 00000000000000000000000000000000 P 13a949f4359045678d67e1ad35d1417e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13a949f4359045678d67e1ad35d1417e" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44359 } }
I20260809 15:30:38.956957 11947 leader_election.cc:302] T 00000000000000000000000000000000 P 13a949f4359045678d67e1ad35d1417e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 13a949f4359045678d67e1ad35d1417e; no voters:
I20260809 15:30:38.957415 11947 leader_election.cc:288] T 00000000000000000000000000000000 P 13a949f4359045678d67e1ad35d1417e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:30:38.957553 11952 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 13a949f4359045678d67e1ad35d1417e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:30:38.957767 11952 raft_consensus.cc:686] T 00000000000000000000000000000000 P 13a949f4359045678d67e1ad35d1417e [term 1 LEADER]: Becoming Leader. State: Replica: 13a949f4359045678d67e1ad35d1417e, State: Running, Role: LEADER
I20260809 15:30:38.958247 11952 consensus_queue.cc:237] T 00000000000000000000000000000000 P 13a949f4359045678d67e1ad35d1417e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13a949f4359045678d67e1ad35d1417e" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44359 } }
I20260809 15:30:38.959303 11947 sys_catalog.cc:564] T 00000000000000000000000000000000 P 13a949f4359045678d67e1ad35d1417e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:30:38.960238 11949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:38.931250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37810 (local address 127.11.146.62:44359)
0809 15:30:38.932023 (+ 773us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:38.932048 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:38.933439 (+ 1391us) server_negotiation.cc:407] Connection header received
0809 15:30:38.938402 (+ 4963us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:38.938419 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:38.938818 (+ 399us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:38.939092 (+ 274us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:38.943043 (+ 3951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:38.944457 (+ 1414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:38.946414 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:38.946913 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:38.947046 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:38.952777 (+ 5731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:38.952817 (+ 40us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:38.952831 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:38.952867 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:38.954963 (+ 2096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:38.955638 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:38.955648 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:38.955657 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:38.955784 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:38.956209 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:38.956213 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:38.956215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:38.956791 (+ 576us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:38.957035 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:38.958834 (+ 1799us) server_negotiation.cc:299] Negotiation successful
0809 15:30:38.959130 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":535,"thread_start_us":245,"threads_started":1}
I20260809 15:30:38.961107 11954 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13a949f4359045678d67e1ad35d1417e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "13a949f4359045678d67e1ad35d1417e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13a949f4359045678d67e1ad35d1417e" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44359 } } }
I20260809 15:30:38.961153 11953 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13a949f4359045678d67e1ad35d1417e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 13a949f4359045678d67e1ad35d1417e. Latest consensus state: current_term: 1 leader_uuid: "13a949f4359045678d67e1ad35d1417e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13a949f4359045678d67e1ad35d1417e" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44359 } } }
I20260809 15:30:38.961231 11954 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13a949f4359045678d67e1ad35d1417e [sys.catalog]: This master's current role is: LEADER
I20260809 15:30:38.961265 11953 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13a949f4359045678d67e1ad35d1417e [sys.catalog]: This master's current role is: LEADER
I20260809 15:30:38.962179 11961 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:30:38.967176 11961 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:30:38.974959 11961 catalog_manager.cc:1347] Generated new cluster ID: 7a18014088a64f479027bf7e394f71c6
I20260809 15:30:38.975051 11961 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:30:38.986354 11961 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:30:38.988260 11961 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:30:39.003394 11961 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 13a949f4359045678d67e1ad35d1417e: Generated new TSK 0
I20260809 15:30:39.004308 11961 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.146.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
I20260809 15:30:39.047582 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.1:0
--local_ip_for_outbound_sockets=127.11.146.1
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:44359
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:33621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:30:39.186939 11973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:30:39.187225 11973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:30:39.187278 11973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:30:39.191526 11973 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:30:39.191730 11973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:30:39.191800 11973 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.1
I20260809 15:30:39.197816 11973 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:33621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:44359
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11973
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.1
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:30:39.198843 11973 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:30:39.199841 11973 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:30:39.210114 11979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:39.210064 11980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:39.210064 11982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:39.210090 11973 server_base.cc:1034] running on GCE node
I20260809 15:30:39.210781 11973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:30:39.211436 11973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:30:39.212637 11973 hybrid_clock.cc:648] HybridClock initialized: now 1786289439212608 us; error 40 us; skew 500 ppm
Aug 09 15:30:39 dist-test-slave-1jjb krb5kdc[11855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289439, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:30:39.215696 11973 init.cc:377] Logged in from keytab as kudu/127.11.146.1@KRBTEST.COM (short username kudu)
I20260809 15:30:39.216728 11973 webserver.cc:460] Webserver started at http://127.11.146.1:43541/ using document root <none> and password file <none>
I20260809 15:30:39.217275 11973 fs_manager.cc:359] Metadata directory not provided
I20260809 15:30:39.217337 11973 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:30:39.217509 11973 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:30:39.219556 11973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-0/data/instance:
uuid: "36bea2e803d44b55b9f4987057c31ab2"
format_stamp: "Formatted at 2026-08-09 15:30:39 on dist-test-slave-1jjb"
server_key: "26a55c02699e94a15d371a0b657b5db0"
server_key_iv: "8fe5699a4ed2ff75a0fbddbd526107f8"
server_key_version: "encryptionkey@0"
I20260809 15:30:39.220121 11973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance:
uuid: "36bea2e803d44b55b9f4987057c31ab2"
format_stamp: "Formatted at 2026-08-09 15:30:39 on dist-test-slave-1jjb"
server_key: "26a55c02699e94a15d371a0b657b5db0"
server_key_iv: "8fe5699a4ed2ff75a0fbddbd526107f8"
server_key_version: "encryptionkey@0"
I20260809 15:30:39.223716 11973 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:30:39.226161 11990 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:39.227427 11973 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 15:30:39.227571 11973 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-0/wal
uuid: "36bea2e803d44b55b9f4987057c31ab2"
format_stamp: "Formatted at 2026-08-09 15:30:39 on dist-test-slave-1jjb"
server_key: "26a55c02699e94a15d371a0b657b5db0"
server_key_iv: "8fe5699a4ed2ff75a0fbddbd526107f8"
server_key_version: "encryptionkey@0"
I20260809 15:30:39.227766 11973 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:30:39.244242 11973 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:30:39.247861 11973 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:30:39.248155 11973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:30:39.248898 11973 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:30:39.250000 11973 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:30:39.250052 11973 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:39.250130 11973 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:30:39.250162 11973 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:39.259969 11973 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.1:37941
I20260809 15:30:39.260032 12113 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.1:37941 every 8 connection(s)
I20260809 15:30:39.261077 11973 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
I20260809 15:30:39.265770 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 11973
I20260809 15:30:39.265887 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance
I20260809 15:30:39.266179 11848 external_mini_cluster.cc:1428] Setting key 0c8f762843b4be8b771d30214f51779a
Aug 09 15:30:39 dist-test-slave-1jjb krb5kdc[11855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289439, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:30:39.277263 11949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:39.263196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:37869 (local address 127.11.146.62:44359)
0809 15:30:39.263340 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:39.263344 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:39.264758 (+ 1414us) server_negotiation.cc:407] Connection header received
0809 15:30:39.265705 (+ 947us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:39.265708 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:39.265757 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:39.265830 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:39.267263 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:39.267888 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:39.269702 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:39.270082 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:39.270230 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:39.273057 (+ 2827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:39.273060 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:39.273062 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:39.273086 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:39.274690 (+ 1604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:39.275373 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:39.275377 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:39.275378 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:39.275472 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:39.276060 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:39.276063 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:39.276064 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:39.276321 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:39.276450 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:39.276952 (+ 502us) server_negotiation.cc:299] Negotiation successful
0809 15:30:39.277086 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
WARNING: no policy specified for kudu/127.11.146.2@KRBTEST.COM; defaulting to no policy
I20260809 15:30:39.278117 12117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:39.263529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:44359 (local address 127.11.146.1:37869)
0809 15:30:39.264603 (+ 1074us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:39.264647 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:39.265453 (+ 806us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:39.266034 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:39.266043 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:39.266540 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:30:39.267116 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:39.267135 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:39.268026 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:39.268030 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:39.269541 (+ 1511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:39.269558 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:39.270246 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:39.270249 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:39.270394 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:39.271033 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:30:39.271050 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:30:39.272861 (+ 1811us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:30:39.274839 (+ 1978us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:39.274847 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:39.274866 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:39.275240 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:39.275709 (+ 469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:39.275713 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:39.275715 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:39.275921 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:39.276447 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:30:39.276454 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:30:39.276705 (+ 251us) client_negotiation.cc:769] Sending connection context
0809 15:30:39.276895 (+ 190us) client_negotiation.cc:240] Negotiation successful
0809 15:30:39.277226 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":857,"thread_start_us":704,"threads_started":1}
I20260809 15:30:39.279456 12114 heartbeater.cc:347] Connected to a master server at 127.11.146.62:44359
I20260809 15:30:39.279855 12114 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.2@KRBTEST.COM" created.
I20260809 15:30:39.280499 12114 heartbeater.cc:511] Master 127.11.146.62:44359 requested a full tablet report, sending...
I20260809 15:30:39.282567 11904 ts_manager.cc:194] Registered new tserver with Master: 36bea2e803d44b55b9f4987057c31ab2 (127.11.146.1:37941)
I20260809 15:30:39.284410 11904 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.1@KRBTEST.COM'} at 127.11.146.1:37869
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
I20260809 15:30:39.298815 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.2:0
--local_ip_for_outbound_sockets=127.11.146.2
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:44359
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:33621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:30:39.418135 12120 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:30:39.418417 12120 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:30:39.418493 12120 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:30:39.422892 12120 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:30:39.422992 12120 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:30:39.423086 12120 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.2
I20260809 15:30:39.428869 12120 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:33621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:44359
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12120
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.2
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:30:39.430074 12120 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:30:39.431140 12120 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:30:39.441113 12128 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:39.441188 12120 server_base.cc:1034] running on GCE node
W20260809 15:30:39.441207 12125 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:39.441129 12126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:39.441875 12120 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:30:39.442518 12120 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:30:39.443724 12120 hybrid_clock.cc:648] HybridClock initialized: now 1786289439443702 us; error 30 us; skew 500 ppm
Aug 09 15:30:39 dist-test-slave-1jjb krb5kdc[11855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289439, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:30:39.446656 12120 init.cc:377] Logged in from keytab as kudu/127.11.146.2@KRBTEST.COM (short username kudu)
I20260809 15:30:39.447870 12120 webserver.cc:460] Webserver started at http://127.11.146.2:44601/ using document root <none> and password file <none>
I20260809 15:30:39.448552 12120 fs_manager.cc:359] Metadata directory not provided
I20260809 15:30:39.448650 12120 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:30:39.448899 12120 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:30:39.451098 12120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-1/data/instance:
uuid: "d405d39f7b8c4b31ae5d9629b94c7800"
format_stamp: "Formatted at 2026-08-09 15:30:39 on dist-test-slave-1jjb"
server_key: "623748a34a07717775abaa771aa1b815"
server_key_iv: "9800871bbee00d709f70dc2dcd179986"
server_key_version: "encryptionkey@0"
I20260809 15:30:39.451695 12120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance:
uuid: "d405d39f7b8c4b31ae5d9629b94c7800"
format_stamp: "Formatted at 2026-08-09 15:30:39 on dist-test-slave-1jjb"
server_key: "623748a34a07717775abaa771aa1b815"
server_key_iv: "9800871bbee00d709f70dc2dcd179986"
server_key_version: "encryptionkey@0"
I20260809 15:30:39.456286 12120 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.001s
I20260809 15:30:39.459018 12135 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:39.460855 12120 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:30:39.460994 12120 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-1/wal
uuid: "d405d39f7b8c4b31ae5d9629b94c7800"
format_stamp: "Formatted at 2026-08-09 15:30:39 on dist-test-slave-1jjb"
server_key: "623748a34a07717775abaa771aa1b815"
server_key_iv: "9800871bbee00d709f70dc2dcd179986"
server_key_version: "encryptionkey@0"
I20260809 15:30:39.461125 12120 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:30:39.483839 12120 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:30:39.487361 12120 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:30:39.487527 12120 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:30:39.488158 12120 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:30:39.489147 12120 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:30:39.489195 12120 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:39.489238 12120 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:30:39.489264 12120 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:39.498955 12120 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.2:46181
I20260809 15:30:39.499001 12259 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.2:46181 every 8 connection(s)
I20260809 15:30:39.499872 12120 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
I20260809 15:30:39.506317 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 12120
I20260809 15:30:39.506443 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance
I20260809 15:30:39.506719 11848 external_mini_cluster.cc:1428] Setting key 481d6289602d5b5d5f81805d308b923f
Aug 09 15:30:39 dist-test-slave-1jjb krb5kdc[11855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289439, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:30:39.516041 11949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:39.501881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:59855 (local address 127.11.146.62:44359)
0809 15:30:39.502040 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:39.502045 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:39.503220 (+ 1175us) server_negotiation.cc:407] Connection header received
0809 15:30:39.504361 (+ 1141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:39.504364 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:39.504436 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:39.504510 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:39.505752 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:39.506288 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:39.508005 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:39.508327 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:39.508435 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:39.511765 (+ 3330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:39.511772 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:39.511775 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:39.511811 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:39.513363 (+ 1552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:39.514039 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:39.514042 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:39.514043 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:39.514118 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:39.514568 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:39.514571 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:39.514572 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:39.514774 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:39.514860 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:39.515802 (+ 942us) server_negotiation.cc:299] Negotiation successful
0809 15:30:39.515917 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 15:30:39.517149 12263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:39.502281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:44359 (local address 127.11.146.2:59855)
0809 15:30:39.503034 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:39.503075 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:39.504168 (+ 1093us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:39.504670 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:39.504676 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:39.505053 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:30:39.505598 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:39.505612 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:39.506439 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:39.506443 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:39.507825 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:39.507836 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:39.508528 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:39.508535 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:39.508769 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:39.509527 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:30:39.509553 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:30:39.511579 (+ 2026us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:30:39.513498 (+ 1919us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:39.513508 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:39.513526 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:39.513922 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:39.514215 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:39.514222 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:39.514226 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:39.514440 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:39.514896 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:30:39.514905 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:30:39.515275 (+ 370us) client_negotiation.cc:769] Sending connection context
0809 15:30:39.515576 (+ 301us) client_negotiation.cc:240] Negotiation successful
0809 15:30:39.515989 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":117,"threads_started":1}
I20260809 15:30:39.518483 12260 heartbeater.cc:347] Connected to a master server at 127.11.146.62:44359
WARNING: no policy specified for kudu/127.11.146.3@KRBTEST.COM; defaulting to no policy
I20260809 15:30:39.518783 12260 heartbeater.cc:464] Registering TS with master...
I20260809 15:30:39.519307 12260 heartbeater.cc:511] Master 127.11.146.62:44359 requested a full tablet report, sending...
I20260809 15:30:39.520576 11904 ts_manager.cc:194] Registered new tserver with Master: d405d39f7b8c4b31ae5d9629b94c7800 (127.11.146.2:46181)
I20260809 15:30:39.521181 11904 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.2@KRBTEST.COM'} at 127.11.146.2:59855
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
I20260809 15:30:39.539199 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.3:0
--local_ip_for_outbound_sockets=127.11.146.3
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:44359
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:33621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:30:39.654903 12267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:30:39.655198 12267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:30:39.655274 12267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:30:39.659299 12267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:30:39.659394 12267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:30:39.659487 12267 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.3
I20260809 15:30:39.665117 12267 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:33621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:44359
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.3
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:30:39.666177 12267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:30:39.667203 12267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:30:39.677057 12273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:39.677057 12272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:39.677114 12275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:39.677276 12267 server_base.cc:1034] running on GCE node
I20260809 15:30:39.677837 12267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:30:39.678496 12267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:30:39.679695 12267 hybrid_clock.cc:648] HybridClock initialized: now 1786289439679663 us; error 43 us; skew 500 ppm
Aug 09 15:30:39 dist-test-slave-1jjb krb5kdc[11855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289439, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:30:39.682593 12267 init.cc:377] Logged in from keytab as kudu/127.11.146.3@KRBTEST.COM (short username kudu)
I20260809 15:30:39.683508 12267 webserver.cc:460] Webserver started at http://127.11.146.3:42071/ using document root <none> and password file <none>
I20260809 15:30:39.684159 12267 fs_manager.cc:359] Metadata directory not provided
I20260809 15:30:39.684253 12267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:30:39.684504 12267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:30:39.686723 12267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-2/data/instance:
uuid: "98d3a4b38620463d8b02b5e13a7dc9be"
format_stamp: "Formatted at 2026-08-09 15:30:39 on dist-test-slave-1jjb"
server_key: "3b7823083d06e05e4ed458762ba402a9"
server_key_iv: "93496948e28cb28348c5501ff3e6f992"
server_key_version: "encryptionkey@0"
I20260809 15:30:39.687333 12267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance:
uuid: "98d3a4b38620463d8b02b5e13a7dc9be"
format_stamp: "Formatted at 2026-08-09 15:30:39 on dist-test-slave-1jjb"
server_key: "3b7823083d06e05e4ed458762ba402a9"
server_key_iv: "93496948e28cb28348c5501ff3e6f992"
server_key_version: "encryptionkey@0"
I20260809 15:30:39.691504 12267 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 15:30:39.694236 12282 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:39.695536 12267 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:30:39.695894 12267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-2/wal
uuid: "98d3a4b38620463d8b02b5e13a7dc9be"
format_stamp: "Formatted at 2026-08-09 15:30:39 on dist-test-slave-1jjb"
server_key: "3b7823083d06e05e4ed458762ba402a9"
server_key_iv: "93496948e28cb28348c5501ff3e6f992"
server_key_version: "encryptionkey@0"
I20260809 15:30:39.695999 12267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:30:39.710178 12267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:30:39.713286 12267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:30:39.713449 12267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:30:39.713955 12267 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:30:39.714735 12267 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:30:39.714781 12267 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:39.714820 12267 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:30:39.714835 12267 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:39.724261 12267 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.3:41579
I20260809 15:30:39.724287 12405 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.3:41579 every 8 connection(s)
I20260809 15:30:39.725183 12267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
I20260809 15:30:39.726506 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 12267
I20260809 15:30:39.726665 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance
I20260809 15:30:39.726981 11848 external_mini_cluster.cc:1428] Setting key 11520922172cca7464fe725c018e2883
Aug 09 15:30:39 dist-test-slave-1jjb krb5kdc[11855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289439, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:30:39.739655 11949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:39.727165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:38769 (local address 127.11.146.62:44359)
0809 15:30:39.727338 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:39.727344 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:39.728886 (+ 1542us) server_negotiation.cc:407] Connection header received
0809 15:30:39.730061 (+ 1175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:39.730064 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:39.730110 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:39.730177 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:39.731457 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:39.732271 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:39.733597 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:39.733814 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:39.733901 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:39.736476 (+ 2575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:39.736479 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:39.736481 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:39.736507 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:39.737797 (+ 1290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:39.738269 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:39.738271 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:39.738273 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:39.738348 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:39.738667 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:39.738669 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:39.738670 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:39.738843 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:39.738952 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:39.739403 (+ 451us) server_negotiation.cc:299] Negotiation successful
0809 15:30:39.739509 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 15:30:39.740548 12408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:39.727577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:44359 (local address 127.11.146.3:38769)
0809 15:30:39.728430 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:39.728761 (+ 331us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:39.729829 (+ 1068us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:39.730382 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:39.730388 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:39.730740 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:30:39.731304 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:39.731318 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:39.732421 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:39.732424 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:39.733465 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:39.733475 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:39.733955 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:39.733958 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:39.734109 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:39.734715 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:30:39.734731 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:30:39.736312 (+ 1581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:30:39.737910 (+ 1598us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:39.737915 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:39.737927 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:39.738183 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:39.738435 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:39.738438 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:39.738439 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:39.738586 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:39.738947 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:30:39.738952 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:30:39.739179 (+ 227us) client_negotiation.cc:769] Sending connection context
0809 15:30:39.739334 (+ 155us) client_negotiation.cc:240] Negotiation successful
0809 15:30:39.739593 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":581,"thread_start_us":140,"threads_started":1}
I20260809 15:30:39.741676 12406 heartbeater.cc:347] Connected to a master server at 127.11.146.62:44359
I20260809 15:30:39.742038 12406 heartbeater.cc:464] Registering TS with master...
I20260809 15:30:39.742652 12406 heartbeater.cc:511] Master 127.11.146.62:44359 requested a full tablet report, sending...
I20260809 15:30:39.743682 11903 ts_manager.cc:194] Registered new tserver with Master: 98d3a4b38620463d8b02b5e13a7dc9be (127.11.146.3:41579)
I20260809 15:30:39.744331 11903 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.3@KRBTEST.COM'} at 127.11.146.3:38769
I20260809 15:30:39.754588 11848 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 15:30:39 dist-test-slave-1jjb krb5kdc[11855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289439, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 15:30:39 dist-test-slave-1jjb krb5kdc[11855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289439, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.146.1@KRBTEST.COM
I20260809 15:30:39.783784 12413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:39.773713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39282 (local address 127.11.146.1:37941)
0809 15:30:39.774085 (+ 372us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:39.774101 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:39.774129 (+ 28us) server_negotiation.cc:407] Connection header received
0809 15:30:39.774191 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:39.774197 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:39.774383 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:39.774518 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:39.775180 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:39.776304 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:39.777199 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:39.777598 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:39.777686 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:39.780388 (+ 2702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:39.780398 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:39.780413 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:39.780439 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:39.782021 (+ 1582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:39.782454 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:39.782461 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:39.782462 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:39.782546 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:39.782791 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:39.782793 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:39.782794 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:39.783039 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:39.783195 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:39.783405 (+ 210us) server_negotiation.cc:299] Negotiation successful
0809 15:30:39.783610 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":124,"threads_started":1}
W20260809 15:30:39.784934 12019 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39282
Aug 09 15:30:39 dist-test-slave-1jjb krb5kdc[11855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289439, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 15:30:39 dist-test-slave-1jjb krb5kdc[11855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289439, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.1@KRBTEST.COM
I20260809 15:30:39.813939 12413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:39.804510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39286 (local address 127.11.146.1:37941)
0809 15:30:39.804725 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:39.804729 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:39.804796 (+ 67us) server_negotiation.cc:407] Connection header received
0809 15:30:39.804935 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:39.804938 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:39.804990 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:39.805065 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:39.805845 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:39.806393 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:39.807225 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:39.807511 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:39.807706 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:39.810505 (+ 2799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:39.810509 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:39.810511 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:39.810536 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:39.812022 (+ 1486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:39.812645 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:39.812648 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:39.812649 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:39.812727 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:39.813014 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:39.813016 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:39.813017 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:39.813182 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:39.813305 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:39.813586 (+ 281us) server_negotiation.cc:299] Negotiation successful
0809 15:30:39.813697 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260809 15:30:39.815167 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 11973
I20260809 15:30:39.824939 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 12120
I20260809 15:30:39.832762 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 12267
I20260809 15:30:39.840190 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 11869
2026-08-09T15:30:39Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2413 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:30:39 dist-test-slave-1jjb krb5kdc[12420](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:30:39 dist-test-slave-1jjb krb5kdc[12420](info): set up 2 sockets
Aug 09 15:30:39 dist-test-slave-1jjb krb5kdc[12420](info): commencing operation
krb5kdc: starting...
W20260809 15:30:40.947579 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.082s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:30:41 dist-test-slave-1jjb krb5kdc[12420](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289441, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:30:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:30:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.146.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
I20260809 15:30:41.092010 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:39783
--webserver_interface=127.11.146.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:45283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:39783
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:30:41.215162 12435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:30:41.215464 12435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:30:41.215507 12435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:30:41.219996 12435 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:30:41.220067 12435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:30:41.220116 12435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:30:41.220134 12435 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:30:41.220149 12435 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:30:41.226157 12435 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:45283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:39783
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:39783
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12435
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:30:41.227262 12435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:30:41.228586 12435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:30:41.237524 12443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:41.237506 12440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:41.237579 12435 server_base.cc:1034] running on GCE node
W20260809 15:30:41.237493 12441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:41.238438 12435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:30:41.239580 12435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:30:41.240773 12435 hybrid_clock.cc:648] HybridClock initialized: now 1786289441240742 us; error 40 us; skew 500 ppm
Aug 09 15:30:41 dist-test-slave-1jjb krb5kdc[12420](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289441, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:30:41.243954 12435 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:30:41.244992 12435 webserver.cc:460] Webserver started at http://127.11.146.62:42163/ using document root <none> and password file <none>
I20260809 15:30:41.245601 12435 fs_manager.cc:359] Metadata directory not provided
I20260809 15:30:41.245702 12435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:30:41.245947 12435 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:30:41.248361 12435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "a724731b3f204ef5b6e61b173985bc2a"
format_stamp: "Formatted at 2026-08-09 15:30:41 on dist-test-slave-1jjb"
server_key: "a9aa7d89b9548c7d2763d5dfb0bfb37c"
server_key_iv: "c20df41343512bdc84be69a0a8be8acb"
server_key_version: "encryptionkey@0"
I20260809 15:30:41.248976 12435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "a724731b3f204ef5b6e61b173985bc2a"
format_stamp: "Formatted at 2026-08-09 15:30:41 on dist-test-slave-1jjb"
server_key: "a9aa7d89b9548c7d2763d5dfb0bfb37c"
server_key_iv: "c20df41343512bdc84be69a0a8be8acb"
server_key_version: "encryptionkey@0"
I20260809 15:30:41.252856 12435 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 15:30:41.255290 12451 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:41.256721 12435 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:30:41.256873 12435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "a724731b3f204ef5b6e61b173985bc2a"
format_stamp: "Formatted at 2026-08-09 15:30:41 on dist-test-slave-1jjb"
server_key: "a9aa7d89b9548c7d2763d5dfb0bfb37c"
server_key_iv: "c20df41343512bdc84be69a0a8be8acb"
server_key_version: "encryptionkey@0"
I20260809 15:30:41.256995 12435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:30:41.278417 12435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:30:41.281792 12435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:30:41.282017 12435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:30:41.290217 12435 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:39783
I20260809 15:30:41.290249 12513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:39783 every 8 connection(s)
I20260809 15:30:41.291255 12435 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:30:41.294225 12515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:30:41.299891 12515 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a724731b3f204ef5b6e61b173985bc2a: Bootstrap starting.
I20260809 15:30:41.300560 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 12435
I20260809 15:30:41.300652 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:30:41.300917 11848 external_mini_cluster.cc:1428] Setting key 838057a3937ea6570d49fff59a959956
I20260809 15:30:41.302763 12515 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a724731b3f204ef5b6e61b173985bc2a: Neither blocks nor log segments found. Creating new log.
I20260809 15:30:41.303665 12515 log.cc:824] T 00000000000000000000000000000000 P a724731b3f204ef5b6e61b173985bc2a: Log is configured to *not* fsync() on all Append() calls
I20260809 15:30:41.305666 12515 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a724731b3f204ef5b6e61b173985bc2a: No bootstrap required, opened a new log
I20260809 15:30:41.309566 12515 raft_consensus.cc:348] T 00000000000000000000000000000000 P a724731b3f204ef5b6e61b173985bc2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a724731b3f204ef5b6e61b173985bc2a" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 39783 } }
I20260809 15:30:41.309820 12515 raft_consensus.cc:374] T 00000000000000000000000000000000 P a724731b3f204ef5b6e61b173985bc2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:30:41.309902 12515 raft_consensus.cc:729] T 00000000000000000000000000000000 P a724731b3f204ef5b6e61b173985bc2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a724731b3f204ef5b6e61b173985bc2a, State: Initialized, Role: FOLLOWER
Aug 09 15:30:41 dist-test-slave-1jjb krb5kdc[12420](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289441, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:30:41.310475 12515 consensus_queue.cc:260] T 00000000000000000000000000000000 P a724731b3f204ef5b6e61b173985bc2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a724731b3f204ef5b6e61b173985bc2a" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 39783 } }
I20260809 15:30:41.310670 12515 raft_consensus.cc:388] T 00000000000000000000000000000000 P a724731b3f204ef5b6e61b173985bc2a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:30:41.310751 12515 raft_consensus.cc:482] T 00000000000000000000000000000000 P a724731b3f204ef5b6e61b173985bc2a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:30:41.310854 12515 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a724731b3f204ef5b6e61b173985bc2a [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:30:41.311997 12515 raft_consensus.cc:504] T 00000000000000000000000000000000 P a724731b3f204ef5b6e61b173985bc2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a724731b3f204ef5b6e61b173985bc2a" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 39783 } }
I20260809 15:30:41.312381 12515 leader_election.cc:302] T 00000000000000000000000000000000 P a724731b3f204ef5b6e61b173985bc2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a724731b3f204ef5b6e61b173985bc2a; no voters:
I20260809 15:30:41.312741 12515 leader_election.cc:288] T 00000000000000000000000000000000 P a724731b3f204ef5b6e61b173985bc2a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:30:41.312841 12522 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a724731b3f204ef5b6e61b173985bc2a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:30:41.313113 12522 raft_consensus.cc:686] T 00000000000000000000000000000000 P a724731b3f204ef5b6e61b173985bc2a [term 1 LEADER]: Becoming Leader. State: Replica: a724731b3f204ef5b6e61b173985bc2a, State: Running, Role: LEADER
I20260809 15:30:41.313490 12522 consensus_queue.cc:237] T 00000000000000000000000000000000 P a724731b3f204ef5b6e61b173985bc2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a724731b3f204ef5b6e61b173985bc2a" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 39783 } }
I20260809 15:30:41.314211 12515 sys_catalog.cc:564] T 00000000000000000000000000000000 P a724731b3f204ef5b6e61b173985bc2a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:30:41.314766 12522 sys_catalog.cc:455] T 00000000000000000000000000000000 P a724731b3f204ef5b6e61b173985bc2a [sys.catalog]: SysCatalogTable state changed. Reason: New leader a724731b3f204ef5b6e61b173985bc2a. Latest consensus state: current_term: 1 leader_uuid: "a724731b3f204ef5b6e61b173985bc2a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a724731b3f204ef5b6e61b173985bc2a" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 39783 } } }
I20260809 15:30:41.314910 12522 sys_catalog.cc:458] T 00000000000000000000000000000000 P a724731b3f204ef5b6e61b173985bc2a [sys.catalog]: This master's current role is: LEADER
I20260809 15:30:41.315330 12530 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:30:41.315420 12523 sys_catalog.cc:455] T 00000000000000000000000000000000 P a724731b3f204ef5b6e61b173985bc2a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a724731b3f204ef5b6e61b173985bc2a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a724731b3f204ef5b6e61b173985bc2a" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 39783 } } }
I20260809 15:30:41.315606 12523 sys_catalog.cc:458] T 00000000000000000000000000000000 P a724731b3f204ef5b6e61b173985bc2a [sys.catalog]: This master's current role is: LEADER
I20260809 15:30:41.317399 12519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:41.302306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42912 (local address 127.11.146.62:39783)
0809 15:30:41.302756 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:41.302777 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:41.302823 (+ 46us) server_negotiation.cc:407] Connection header received
0809 15:30:41.303707 (+ 884us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:41.303734 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:41.304193 (+ 459us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:41.304536 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:41.305362 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:41.306435 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:41.307295 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:41.307785 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:41.307966 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:41.310743 (+ 2777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:41.310750 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:41.310768 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:41.310801 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:41.313194 (+ 2393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:41.313765 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:41.313772 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:41.313777 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:41.313923 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:41.314246 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:41.314249 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:41.314251 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:41.314785 (+ 534us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:41.315886 (+ 1101us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:41.316045 (+ 159us) server_negotiation.cc:299] Negotiation successful
0809 15:30:41.316389 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":137,"threads_started":1}
I20260809 15:30:41.318845 12530 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:30:41.324595 12530 catalog_manager.cc:1347] Generated new cluster ID: 70e3c546863c462ba58e5313d84a1012
I20260809 15:30:41.324667 12530 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:30:41.341950 12530 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:30:41.342931 12530 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:30:41.349352 12530 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a724731b3f204ef5b6e61b173985bc2a: Generated new TSK 0
I20260809 15:30:41.349984 12530 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.146.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
I20260809 15:30:41.383922 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.1:0
--local_ip_for_outbound_sockets=127.11.146.1
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:39783
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:45283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:30:41.503966 12547 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:30:41.504226 12547 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:30:41.504312 12547 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:30:41.508656 12547 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:30:41.508721 12547 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:30:41.508824 12547 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.1
I20260809 15:30:41.514216 12547 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:45283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:39783
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12547
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.1
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:30:41.515434 12547 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:30:41.516603 12547 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 15:30:41.526630 12547 server_base.cc:1034] running on GCE node
W20260809 15:30:41.526574 12552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:41.526543 12553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:41.526564 12555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:41.527287 12547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:30:41.528179 12547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:30:41.529402 12547 hybrid_clock.cc:648] HybridClock initialized: now 1786289441529377 us; error 44 us; skew 500 ppm
Aug 09 15:30:41 dist-test-slave-1jjb krb5kdc[12420](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289441, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:30:41.532377 12547 init.cc:377] Logged in from keytab as kudu/127.11.146.1@KRBTEST.COM (short username kudu)
I20260809 15:30:41.533198 12547 webserver.cc:460] Webserver started at http://127.11.146.1:34673/ using document root <none> and password file <none>
I20260809 15:30:41.533877 12547 fs_manager.cc:359] Metadata directory not provided
I20260809 15:30:41.533982 12547 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:30:41.534212 12547 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:30:41.536252 12547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-0/data/instance:
uuid: "b2924c0837e84c4a82dc9489d6ddb340"
format_stamp: "Formatted at 2026-08-09 15:30:41 on dist-test-slave-1jjb"
server_key: "cb69788d31e2b3676eb3b2a957aabc04"
server_key_iv: "888e60cfcdbf526ade25dedd2c16ccb0"
server_key_version: "encryptionkey@0"
I20260809 15:30:41.536765 12547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance:
uuid: "b2924c0837e84c4a82dc9489d6ddb340"
format_stamp: "Formatted at 2026-08-09 15:30:41 on dist-test-slave-1jjb"
server_key: "cb69788d31e2b3676eb3b2a957aabc04"
server_key_iv: "888e60cfcdbf526ade25dedd2c16ccb0"
server_key_version: "encryptionkey@0"
I20260809 15:30:41.540613 12547 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 15:30:41.543207 12562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:41.544517 12547 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:30:41.544667 12547 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-0/wal
uuid: "b2924c0837e84c4a82dc9489d6ddb340"
format_stamp: "Formatted at 2026-08-09 15:30:41 on dist-test-slave-1jjb"
server_key: "cb69788d31e2b3676eb3b2a957aabc04"
server_key_iv: "888e60cfcdbf526ade25dedd2c16ccb0"
server_key_version: "encryptionkey@0"
I20260809 15:30:41.544780 12547 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:30:41.563192 12547 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:30:41.566632 12547 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:30:41.566847 12547 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:30:41.567512 12547 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:30:41.568605 12547 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:30:41.568681 12547 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:41.568755 12547 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:30:41.568799 12547 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:41.577559 12547 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.1:43403
I20260809 15:30:41.577658 12685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.1:43403 every 8 connection(s)
I20260809 15:30:41.578512 12547 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
I20260809 15:30:41.581513 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 12547
I20260809 15:30:41.581629 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance
I20260809 15:30:41.581903 11848 external_mini_cluster.cc:1428] Setting key e14352a71bc8994d449998837d80962e
Aug 09 15:30:41 dist-test-slave-1jjb krb5kdc[12420](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289441, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.146.2@KRBTEST.COM; defaulting to no policy
I20260809 15:30:41.593565 12519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:41.580568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:37297 (local address 127.11.146.62:39783)
0809 15:30:41.580743 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:41.580747 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:41.581793 (+ 1046us) server_negotiation.cc:407] Connection header received
0809 15:30:41.582838 (+ 1045us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:41.582842 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:41.582910 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:41.583015 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:41.584602 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:41.585133 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:41.586286 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:41.586527 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:41.586644 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:41.589540 (+ 2896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:41.589544 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:41.589546 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:41.589572 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:41.591082 (+ 1510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:41.591723 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:41.591729 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:41.591731 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:41.591827 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:41.592271 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:41.592275 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:41.592277 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:41.592558 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:41.592671 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:41.593230 (+ 559us) server_negotiation.cc:299] Negotiation successful
0809 15:30:41.593369 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 15:30:41.594401 12690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:41.580894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39783 (local address 127.11.146.1:37297)
0809 15:30:41.581614 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:41.581671 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:41.582637 (+ 966us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:41.583211 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:41.583219 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:41.583849 (+ 630us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:30:41.584448 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:41.584463 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:41.585266 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:41.585274 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:41.586156 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:41.586165 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:41.586691 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:41.586695 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:41.586868 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:41.587496 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:30:41.587512 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:30:41.589325 (+ 1813us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:30:41.591208 (+ 1883us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:41.591214 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:41.591231 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:41.591503 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:41.591940 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:41.591943 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:41.591945 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:41.592159 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:41.592669 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:30:41.592677 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:30:41.592968 (+ 291us) client_negotiation.cc:769] Sending connection context
0809 15:30:41.593170 (+ 202us) client_negotiation.cc:240] Negotiation successful
0809 15:30:41.593525 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":118,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.2@KRBTEST.COM" created.
I20260809 15:30:41.595747 12688 heartbeater.cc:347] Connected to a master server at 127.11.146.62:39783
I20260809 15:30:41.596168 12688 heartbeater.cc:464] Registering TS with master...
I20260809 15:30:41.596822 12688 heartbeater.cc:511] Master 127.11.146.62:39783 requested a full tablet report, sending...
I20260809 15:30:41.598564 12469 ts_manager.cc:194] Registered new tserver with Master: b2924c0837e84c4a82dc9489d6ddb340 (127.11.146.1:43403)
I20260809 15:30:41.599754 12469 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.1@KRBTEST.COM'} at 127.11.146.1:37297
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
I20260809 15:30:41.615281 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.2:0
--local_ip_for_outbound_sockets=127.11.146.2
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:39783
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:45283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:30:41.732208 12693 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:30:41.732503 12693 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:30:41.732577 12693 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:30:41.736676 12693 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:30:41.736761 12693 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:30:41.736853 12693 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.2
I20260809 15:30:41.742321 12693 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:45283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:39783
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12693
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.2
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:30:41.743408 12693 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:30:41.744493 12693 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 15:30:41.754144 12693 server_base.cc:1034] running on GCE node
W20260809 15:30:41.754107 12699 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:41.754112 12702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:41.754107 12700 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:41.754742 12693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:30:41.755357 12693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:30:41.756524 12693 hybrid_clock.cc:648] HybridClock initialized: now 1786289441756491 us; error 49 us; skew 500 ppm
Aug 09 15:30:41 dist-test-slave-1jjb krb5kdc[12420](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289441, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:30:41.759138 12693 init.cc:377] Logged in from keytab as kudu/127.11.146.2@KRBTEST.COM (short username kudu)
I20260809 15:30:41.759976 12693 webserver.cc:460] Webserver started at http://127.11.146.2:39671/ using document root <none> and password file <none>
I20260809 15:30:41.760558 12693 fs_manager.cc:359] Metadata directory not provided
I20260809 15:30:41.760620 12693 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:30:41.760870 12693 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:30:41.763043 12693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-1/data/instance:
uuid: "8fc783eeb2b64979a7332d27d790d780"
format_stamp: "Formatted at 2026-08-09 15:30:41 on dist-test-slave-1jjb"
server_key: "5bcaf13ce881aa24180d175b2606b85a"
server_key_iv: "e58cf95c21f2535140707b58b68ad111"
server_key_version: "encryptionkey@0"
I20260809 15:30:41.763568 12693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance:
uuid: "8fc783eeb2b64979a7332d27d790d780"
format_stamp: "Formatted at 2026-08-09 15:30:41 on dist-test-slave-1jjb"
server_key: "5bcaf13ce881aa24180d175b2606b85a"
server_key_iv: "e58cf95c21f2535140707b58b68ad111"
server_key_version: "encryptionkey@0"
I20260809 15:30:41.767156 12693 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 15:30:41.769534 12709 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:41.770710 12693 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:30:41.770829 12693 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-1/wal
uuid: "8fc783eeb2b64979a7332d27d790d780"
format_stamp: "Formatted at 2026-08-09 15:30:41 on dist-test-slave-1jjb"
server_key: "5bcaf13ce881aa24180d175b2606b85a"
server_key_iv: "e58cf95c21f2535140707b58b68ad111"
server_key_version: "encryptionkey@0"
I20260809 15:30:41.770931 12693 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:30:41.784438 12693 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:30:41.787940 12693 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:30:41.788190 12693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:30:41.788793 12693 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:30:41.789635 12693 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:30:41.789690 12693 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:41.789757 12693 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:30:41.789799 12693 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:41.798822 12693 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.2:36251
I20260809 15:30:41.798851 12841 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.2:36251 every 8 connection(s)
I20260809 15:30:41.799769 12693 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
I20260809 15:30:41.802812 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 12693
I20260809 15:30:41.802929 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance
I20260809 15:30:41.803233 11848 external_mini_cluster.cc:1428] Setting key 71e0db16c2ab800e32273d710c2c9270
Aug 09 15:30:41 dist-test-slave-1jjb krb5kdc[12420](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289441, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.146.3@KRBTEST.COM; defaulting to no policy
I20260809 15:30:41.814677 12519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:41.801739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:46451 (local address 127.11.146.62:39783)
0809 15:30:41.801923 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:41.801928 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:41.803097 (+ 1169us) server_negotiation.cc:407] Connection header received
0809 15:30:41.804271 (+ 1174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:41.804275 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:41.804322 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:41.804414 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:41.806003 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:41.806531 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:41.807905 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:41.808212 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:41.808328 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:41.810935 (+ 2607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:41.810939 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:41.810942 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:41.810971 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:41.812503 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:41.813027 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:41.813031 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:41.813033 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:41.813120 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:41.813469 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:41.813472 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:41.813474 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:41.813674 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:41.813784 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:41.814363 (+ 579us) server_negotiation.cc:299] Negotiation successful
0809 15:30:41.814499 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 15:30:41.815712 12844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:41.802097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39783 (local address 127.11.146.2:46451)
0809 15:30:41.802892 (+ 795us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:41.802975 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:41.804001 (+ 1026us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:41.804590 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:41.804597 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:41.805124 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:30:41.805830 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:41.805854 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:41.806668 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:41.806675 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:41.807771 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:41.807781 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:41.808371 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:41.808376 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:41.808549 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:41.809204 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:30:41.809221 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:30:41.810760 (+ 1539us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:30:41.812627 (+ 1867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:41.812633 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:41.812648 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:41.812908 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:41.813216 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:41.813220 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:41.813222 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:41.813365 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:41.813784 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:30:41.813791 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:30:41.814098 (+ 307us) client_negotiation.cc:769] Sending connection context
0809 15:30:41.814316 (+ 218us) client_negotiation.cc:240] Negotiation successful
0809 15:30:41.814653 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":108,"threads_started":1}
I20260809 15:30:41.817066 12842 heartbeater.cc:347] Connected to a master server at 127.11.146.62:39783
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.3@KRBTEST.COM" created.
I20260809 15:30:41.817335 12842 heartbeater.cc:464] Registering TS with master...
I20260809 15:30:41.817858 12842 heartbeater.cc:511] Master 127.11.146.62:39783 requested a full tablet report, sending...
I20260809 15:30:41.819042 12469 ts_manager.cc:194] Registered new tserver with Master: 8fc783eeb2b64979a7332d27d790d780 (127.11.146.2:36251)
I20260809 15:30:41.819916 12469 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.2@KRBTEST.COM'} at 127.11.146.2:46451
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
I20260809 15:30:41.835749 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.3:0
--local_ip_for_outbound_sockets=127.11.146.3
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:39783
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:45283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:30:41.949708 12847 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:30:41.950028 12847 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:30:41.950145 12847 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:30:41.954226 12847 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:30:41.954315 12847 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:30:41.954412 12847 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.3
I20260809 15:30:41.959800 12847 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:45283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:39783
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12847
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.3
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:30:41.961046 12847 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:30:41.962193 12847 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:30:41.971866 12854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:41.972066 12847 server_base.cc:1034] running on GCE node
W20260809 15:30:41.971958 12853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:41.972297 12856 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:41.972745 12847 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:30:41.973421 12847 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:30:41.974684 12847 hybrid_clock.cc:648] HybridClock initialized: now 1786289441974641 us; error 43 us; skew 500 ppm
Aug 09 15:30:41 dist-test-slave-1jjb krb5kdc[12420](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289441, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:30:41.977771 12847 init.cc:377] Logged in from keytab as kudu/127.11.146.3@KRBTEST.COM (short username kudu)
I20260809 15:30:41.978642 12847 webserver.cc:460] Webserver started at http://127.11.146.3:44451/ using document root <none> and password file <none>
I20260809 15:30:41.979219 12847 fs_manager.cc:359] Metadata directory not provided
I20260809 15:30:41.979312 12847 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:30:41.979548 12847 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:30:41.981676 12847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-2/data/instance:
uuid: "9ba65d7066b5433eb998599f82683326"
format_stamp: "Formatted at 2026-08-09 15:30:41 on dist-test-slave-1jjb"
server_key: "6b778fcc82581496f9cf89330d5b54f7"
server_key_iv: "9f5ac88d2f5502e81e5575ced39162a4"
server_key_version: "encryptionkey@0"
I20260809 15:30:41.982280 12847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance:
uuid: "9ba65d7066b5433eb998599f82683326"
format_stamp: "Formatted at 2026-08-09 15:30:41 on dist-test-slave-1jjb"
server_key: "6b778fcc82581496f9cf89330d5b54f7"
server_key_iv: "9f5ac88d2f5502e81e5575ced39162a4"
server_key_version: "encryptionkey@0"
I20260809 15:30:41.986613 12847 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 15:30:41.989100 12864 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:41.990356 12847 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:30:41.990497 12847 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-2/wal
uuid: "9ba65d7066b5433eb998599f82683326"
format_stamp: "Formatted at 2026-08-09 15:30:41 on dist-test-slave-1jjb"
server_key: "6b778fcc82581496f9cf89330d5b54f7"
server_key_iv: "9f5ac88d2f5502e81e5575ced39162a4"
server_key_version: "encryptionkey@0"
I20260809 15:30:41.990613 12847 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:30:42.002168 12847 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:30:42.005599 12847 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:30:42.005810 12847 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:30:42.006425 12847 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:30:42.007265 12847 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:30:42.007347 12847 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:42.007423 12847 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:30:42.007460 12847 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:42.017256 12847 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.3:38207
I20260809 15:30:42.017328 12984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.3:38207 every 8 connection(s)
I20260809 15:30:42.018225 12847 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
I20260809 15:30:42.022996 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 12847
I20260809 15:30:42.023129 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance
I20260809 15:30:42.023425 11848 external_mini_cluster.cc:1428] Setting key 415da5e6a8723ebcd3e5a31927717edd
Aug 09 15:30:42 dist-test-slave-1jjb krb5kdc[12420](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289441, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:30:42.032390 12519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:42.020165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:60193 (local address 127.11.146.62:39783)
0809 15:30:42.020309 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:42.020319 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:42.021052 (+ 733us) server_negotiation.cc:407] Connection header received
0809 15:30:42.021998 (+ 946us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:42.022002 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:42.022063 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:42.022173 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:42.023681 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:42.024499 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:42.026021 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:42.026238 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:42.026329 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:42.028921 (+ 2592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:42.028925 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:42.028927 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:42.028956 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:42.030368 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:42.030852 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:42.030854 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:42.030856 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:42.030943 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:42.031256 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:42.031259 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:42.031260 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:42.031446 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:42.031538 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:42.032168 (+ 630us) server_negotiation.cc:299] Negotiation successful
0809 15:30:42.032273 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 15:30:42.033177 12987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:42.020445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39783 (local address 127.11.146.3:60193)
0809 15:30:42.020902 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:42.020945 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:42.021780 (+ 835us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:42.022350 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:42.022357 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:42.022783 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:30:42.023509 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:42.023532 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:42.024640 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:42.024645 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:42.025882 (+ 1237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:42.025893 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:42.026404 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:42.026407 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:42.026554 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:42.027132 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:30:42.027149 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:30:42.028752 (+ 1603us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:30:42.030486 (+ 1734us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:42.030491 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:42.030502 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:42.030750 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:42.031034 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:42.031037 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:42.031038 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:42.031172 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:42.031542 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:30:42.031555 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:30:42.031865 (+ 310us) client_negotiation.cc:769] Sending connection context
0809 15:30:42.032041 (+ 176us) client_negotiation.cc:240] Negotiation successful
0809 15:30:42.032366 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":110,"threads_started":1}
I20260809 15:30:42.034260 12985 heartbeater.cc:347] Connected to a master server at 127.11.146.62:39783
I20260809 15:30:42.034518 12985 heartbeater.cc:464] Registering TS with master...
I20260809 15:30:42.035037 12985 heartbeater.cc:511] Master 127.11.146.62:39783 requested a full tablet report, sending...
I20260809 15:30:42.036006 12469 ts_manager.cc:194] Registered new tserver with Master: 9ba65d7066b5433eb998599f82683326 (127.11.146.3:38207)
I20260809 15:30:42.036602 12469 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.3@KRBTEST.COM'} at 127.11.146.3:60193
I20260809 15:30:42.037473 11848 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:30:42.049068 12519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:42.041530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42920 (local address 127.11.146.62:39783)
0809 15:30:42.041710 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:42.041715 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:42.041883 (+ 168us) server_negotiation.cc:407] Connection header received
0809 15:30:42.042046 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:42.042048 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:42.042086 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:42.042167 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:42.042889 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:42.043398 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:42.044283 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:42.044501 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:42.044611 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:42.046080 (+ 1469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:42.046084 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:42.046087 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:42.046110 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:42.047325 (+ 1215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:42.047775 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:42.047785 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:42.047787 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:42.047860 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:42.048186 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:42.048189 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:42.048191 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:42.048399 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:42.048540 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:42.048779 (+ 239us) server_negotiation.cc:299] Negotiation successful
0809 15:30:42.048899 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260809 15:30:42.054711 12469 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42920:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:30:42.058080 12469 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:30:42.075305 12999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:42.068841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54492 (local address 127.11.146.3:38207)
0809 15:30:42.069180 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:42.069191 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:42.069747 (+ 556us) server_negotiation.cc:407] Connection header received
0809 15:30:42.070060 (+ 313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:42.070066 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:42.070288 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:42.070438 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:30:42.070822 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:42.072063 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:42.073655 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:42.074506 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:42.074624 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:42.074840 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:42.075029 (+ 189us) server_negotiation.cc:299] Negotiation successful
0809 15:30:42.075129 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":229,"thread_start_us":124,"threads_started":1}
I20260809 15:30:42.075448 12998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:42.068846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:43403 (local address 127.0.0.1:57596)
0809 15:30:42.070142 (+ 1296us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:42.070155 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:42.070243 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:42.070708 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:42.070711 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:42.070729 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:30:42.070833 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:42.070840 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:42.072250 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:42.072253 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:42.073848 (+ 1595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:42.073857 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:42.075039 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:42.075043 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:42.075137 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:42.075160 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 15:30:42.075214 (+ 54us) client_negotiation.cc:240] Negotiation successful
0809 15:30:42.075277 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1236,"mutex_wait_us":345,"thread_start_us":98,"threads_started":1}
I20260809 15:30:42.075560 12997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:42.068697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:38207 (local address 127.0.0.1:54492)
0809 15:30:42.069598 (+ 901us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:42.069649 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:42.069867 (+ 218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:42.070502 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:42.070507 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:42.070525 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:30:42.070684 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:42.070692 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:42.072250 (+ 1558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:42.072253 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:42.073528 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:42.073540 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:42.074640 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:42.074644 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:42.074768 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:42.074814 (+ 46us) client_negotiation.cc:769] Sending connection context
0809 15:30:42.074994 (+ 180us) client_negotiation.cc:240] Negotiation successful
0809 15:30:42.075125 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":728,"mutex_wait_us":265,"thread_start_us":110,"threads_started":1}
I20260809 15:30:42.075951 13005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:42.069905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52758 (local address 127.11.146.2:36251)
0809 15:30:42.070512 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:42.070528 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:42.070549 (+ 21us) server_negotiation.cc:407] Connection header received
0809 15:30:42.070628 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:42.070632 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:42.070817 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:42.070969 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:30:42.071312 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:42.072034 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:42.074113 (+ 2079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:42.074790 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:42.074897 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:42.075050 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:42.075731 (+ 681us) server_negotiation.cc:299] Negotiation successful
0809 15:30:42.075831 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":507,"thread_start_us":115,"threads_started":1}
I20260809 15:30:42.076226 13003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:42.069432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57596 (local address 127.11.146.1:43403)
0809 15:30:42.069824 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:42.069839 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:42.070242 (+ 403us) server_negotiation.cc:407] Connection header received
0809 15:30:42.070357 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:42.070362 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:42.070560 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:42.070715 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:30:42.070943 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:42.072067 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:42.073964 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:42.074814 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:42.075635 (+ 821us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:42.075927 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:42.075980 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 15:30:42.076091 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":117,"threads_started":1}
I20260809 15:30:42.076303 13004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:42.069506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:36251 (local address 127.0.0.1:52758)
0809 15:30:42.070270 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:42.070286 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:42.070375 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:42.071118 (+ 743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:42.071120 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:42.071135 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:30:42.071195 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:42.071199 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:42.072227 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:42.072230 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:42.074005 (+ 1775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:42.074012 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:42.075113 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:42.075116 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:42.075193 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:42.075215 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 15:30:42.075286 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 15:30:42.075354 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":691,"mutex_wait_us":150,"thread_start_us":93,"threads_started":1}
I20260809 15:30:42.078723 12915 tablet_service.cc:1467] Processing CreateTablet for tablet 82a3aca19603425782948c3b2d97e9aa (DEFAULT_TABLE table=test-table [id=1254b0a41ceb48cc822642bd13cc954d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:30:42.078917 12762 tablet_service.cc:1467] Processing CreateTablet for tablet 82a3aca19603425782948c3b2d97e9aa (DEFAULT_TABLE table=test-table [id=1254b0a41ceb48cc822642bd13cc954d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:30:42.078923 12611 tablet_service.cc:1467] Processing CreateTablet for tablet 82a3aca19603425782948c3b2d97e9aa (DEFAULT_TABLE table=test-table [id=1254b0a41ceb48cc822642bd13cc954d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:30:42.079934 12915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82a3aca19603425782948c3b2d97e9aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:30:42.080060 12611 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82a3aca19603425782948c3b2d97e9aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:30:42.080058 12762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82a3aca19603425782948c3b2d97e9aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:30:42.086725 13006 tablet_bootstrap.cc:492] T 82a3aca19603425782948c3b2d97e9aa P 9ba65d7066b5433eb998599f82683326: Bootstrap starting.
I20260809 15:30:42.087919 13007 tablet_bootstrap.cc:492] T 82a3aca19603425782948c3b2d97e9aa P 8fc783eeb2b64979a7332d27d790d780: Bootstrap starting.
I20260809 15:30:42.088176 13008 tablet_bootstrap.cc:492] T 82a3aca19603425782948c3b2d97e9aa P b2924c0837e84c4a82dc9489d6ddb340: Bootstrap starting.
I20260809 15:30:42.089480 13006 tablet_bootstrap.cc:654] T 82a3aca19603425782948c3b2d97e9aa P 9ba65d7066b5433eb998599f82683326: Neither blocks nor log segments found. Creating new log.
I20260809 15:30:42.090196 13008 tablet_bootstrap.cc:654] T 82a3aca19603425782948c3b2d97e9aa P b2924c0837e84c4a82dc9489d6ddb340: Neither blocks nor log segments found. Creating new log.
I20260809 15:30:42.090806 13006 log.cc:824] T 82a3aca19603425782948c3b2d97e9aa P 9ba65d7066b5433eb998599f82683326: Log is configured to *not* fsync() on all Append() calls
I20260809 15:30:42.091310 13008 log.cc:824] T 82a3aca19603425782948c3b2d97e9aa P b2924c0837e84c4a82dc9489d6ddb340: Log is configured to *not* fsync() on all Append() calls
I20260809 15:30:42.091897 13007 tablet_bootstrap.cc:654] T 82a3aca19603425782948c3b2d97e9aa P 8fc783eeb2b64979a7332d27d790d780: Neither blocks nor log segments found. Creating new log.
I20260809 15:30:42.092901 13007 log.cc:824] T 82a3aca19603425782948c3b2d97e9aa P 8fc783eeb2b64979a7332d27d790d780: Log is configured to *not* fsync() on all Append() calls
I20260809 15:30:42.093092 13008 tablet_bootstrap.cc:492] T 82a3aca19603425782948c3b2d97e9aa P b2924c0837e84c4a82dc9489d6ddb340: No bootstrap required, opened a new log
I20260809 15:30:42.093305 13008 ts_tablet_manager.cc:1397] T 82a3aca19603425782948c3b2d97e9aa P b2924c0837e84c4a82dc9489d6ddb340: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 15:30:42.093333 13006 tablet_bootstrap.cc:492] T 82a3aca19603425782948c3b2d97e9aa P 9ba65d7066b5433eb998599f82683326: No bootstrap required, opened a new log
I20260809 15:30:42.093523 13006 ts_tablet_manager.cc:1397] T 82a3aca19603425782948c3b2d97e9aa P 9ba65d7066b5433eb998599f82683326: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260809 15:30:42.094997 13007 tablet_bootstrap.cc:492] T 82a3aca19603425782948c3b2d97e9aa P 8fc783eeb2b64979a7332d27d790d780: No bootstrap required, opened a new log
I20260809 15:30:42.095165 13007 ts_tablet_manager.cc:1397] T 82a3aca19603425782948c3b2d97e9aa P 8fc783eeb2b64979a7332d27d790d780: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260809 15:30:42.097244 13006 raft_consensus.cc:348] T 82a3aca19603425782948c3b2d97e9aa P 9ba65d7066b5433eb998599f82683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba65d7066b5433eb998599f82683326" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38207 } } peers { permanent_uuid: "b2924c0837e84c4a82dc9489d6ddb340" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 43403 } } peers { permanent_uuid: "8fc783eeb2b64979a7332d27d790d780" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 36251 } }
I20260809 15:30:42.097522 13006 raft_consensus.cc:374] T 82a3aca19603425782948c3b2d97e9aa P 9ba65d7066b5433eb998599f82683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:30:42.097584 13006 raft_consensus.cc:729] T 82a3aca19603425782948c3b2d97e9aa P 9ba65d7066b5433eb998599f82683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba65d7066b5433eb998599f82683326, State: Initialized, Role: FOLLOWER
I20260809 15:30:42.097455 13008 raft_consensus.cc:348] T 82a3aca19603425782948c3b2d97e9aa P b2924c0837e84c4a82dc9489d6ddb340 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba65d7066b5433eb998599f82683326" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38207 } } peers { permanent_uuid: "b2924c0837e84c4a82dc9489d6ddb340" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 43403 } } peers { permanent_uuid: "8fc783eeb2b64979a7332d27d790d780" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 36251 } }
I20260809 15:30:42.097697 13008 raft_consensus.cc:374] T 82a3aca19603425782948c3b2d97e9aa P b2924c0837e84c4a82dc9489d6ddb340 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:30:42.097765 13008 raft_consensus.cc:729] T 82a3aca19603425782948c3b2d97e9aa P b2924c0837e84c4a82dc9489d6ddb340 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2924c0837e84c4a82dc9489d6ddb340, State: Initialized, Role: FOLLOWER
I20260809 15:30:42.098162 13006 consensus_queue.cc:260] T 82a3aca19603425782948c3b2d97e9aa P 9ba65d7066b5433eb998599f82683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba65d7066b5433eb998599f82683326" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38207 } } peers { permanent_uuid: "b2924c0837e84c4a82dc9489d6ddb340" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 43403 } } peers { permanent_uuid: "8fc783eeb2b64979a7332d27d790d780" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 36251 } }
I20260809 15:30:42.098203 13008 consensus_queue.cc:260] T 82a3aca19603425782948c3b2d97e9aa P b2924c0837e84c4a82dc9489d6ddb340 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba65d7066b5433eb998599f82683326" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38207 } } peers { permanent_uuid: "b2924c0837e84c4a82dc9489d6ddb340" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 43403 } } peers { permanent_uuid: "8fc783eeb2b64979a7332d27d790d780" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 36251 } }
I20260809 15:30:42.098953 12688 heartbeater.cc:503] Master 127.11.146.62:39783 was elected leader, sending a full tablet report...
I20260809 15:30:42.098905 13007 raft_consensus.cc:348] T 82a3aca19603425782948c3b2d97e9aa P 8fc783eeb2b64979a7332d27d790d780 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba65d7066b5433eb998599f82683326" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38207 } } peers { permanent_uuid: "b2924c0837e84c4a82dc9489d6ddb340" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 43403 } } peers { permanent_uuid: "8fc783eeb2b64979a7332d27d790d780" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 36251 } }
I20260809 15:30:42.099197 13007 raft_consensus.cc:374] T 82a3aca19603425782948c3b2d97e9aa P 8fc783eeb2b64979a7332d27d790d780 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:30:42.099259 13007 raft_consensus.cc:729] T 82a3aca19603425782948c3b2d97e9aa P 8fc783eeb2b64979a7332d27d790d780 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fc783eeb2b64979a7332d27d790d780, State: Initialized, Role: FOLLOWER
I20260809 15:30:42.099749 13007 consensus_queue.cc:260] T 82a3aca19603425782948c3b2d97e9aa P 8fc783eeb2b64979a7332d27d790d780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba65d7066b5433eb998599f82683326" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38207 } } peers { permanent_uuid: "b2924c0837e84c4a82dc9489d6ddb340" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 43403 } } peers { permanent_uuid: "8fc783eeb2b64979a7332d27d790d780" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 36251 } }
I20260809 15:30:42.100720 13007 ts_tablet_manager.cc:1428] T 82a3aca19603425782948c3b2d97e9aa P 8fc783eeb2b64979a7332d27d790d780: Time spent starting tablet: real 0.005s user 0.001s sys 0.004s
I20260809 15:30:42.100824 12842 heartbeater.cc:503] Master 127.11.146.62:39783 was elected leader, sending a full tablet report...
I20260809 15:30:42.099319 13006 ts_tablet_manager.cc:1428] T 82a3aca19603425782948c3b2d97e9aa P 9ba65d7066b5433eb998599f82683326: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 15:30:42.102011 12985 heartbeater.cc:503] Master 127.11.146.62:39783 was elected leader, sending a full tablet report...
I20260809 15:30:42.102977 13008 ts_tablet_manager.cc:1428] T 82a3aca19603425782948c3b2d97e9aa P b2924c0837e84c4a82dc9489d6ddb340: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20260809 15:30:42.142413 13013 raft_consensus.cc:482] T 82a3aca19603425782948c3b2d97e9aa P 9ba65d7066b5433eb998599f82683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:30:42.142676 13013 raft_consensus.cc:504] T 82a3aca19603425782948c3b2d97e9aa P 9ba65d7066b5433eb998599f82683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba65d7066b5433eb998599f82683326" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38207 } } peers { permanent_uuid: "b2924c0837e84c4a82dc9489d6ddb340" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 43403 } } peers { permanent_uuid: "8fc783eeb2b64979a7332d27d790d780" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 36251 } }
I20260809 15:30:42.143944 13013 leader_election.cc:288] T 82a3aca19603425782948c3b2d97e9aa P 9ba65d7066b5433eb998599f82683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2924c0837e84c4a82dc9489d6ddb340 (127.11.146.1:43403), 8fc783eeb2b64979a7332d27d790d780 (127.11.146.2:36251)
I20260809 15:30:42.147883 13015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:42.144260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:36251 (local address 127.11.146.3:53529)
0809 15:30:42.144648 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:42.144663 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:42.144754 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:42.145046 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:42.145049 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:42.145067 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:30:42.145181 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:42.145187 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:42.145913 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:42.145916 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:42.146694 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:42.146727 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:42.147391 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:42.147394 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:42.147492 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:42.147510 (+ 18us) client_negotiation.cc:769] Sending connection context
0809 15:30:42.147603 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 15:30:42.147690 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"mutex_wait_us":1,"thread_start_us":143,"threads_started":1}
I20260809 15:30:42.147997 13003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:42.144347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:50227 (local address 127.11.146.1:43403)
0809 15:30:42.144502 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:42.144508 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:42.144522 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:30:42.144575 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:42.144578 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:42.144625 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:42.144712 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:30:42.145049 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:42.145670 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:42.146779 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:42.147185 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:42.147279 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:42.147347 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:42.147773 (+ 426us) server_negotiation.cc:299] Negotiation successful
0809 15:30:42.147842 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 15:30:42.147997 13005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:42.144454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:53529 (local address 127.11.146.2:36251)
0809 15:30:42.144604 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:42.144607 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:42.144745 (+ 138us) server_negotiation.cc:407] Connection header received
0809 15:30:42.144856 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:42.144859 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:42.144925 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:42.145018 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:30:42.145292 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:42.145805 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:42.146853 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:42.147264 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:42.147378 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:42.147434 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:42.147771 (+ 337us) server_negotiation.cc:299] Negotiation successful
0809 15:30:42.147847 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 15:30:42.148034 12987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:42.144142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:43403 (local address 127.11.146.3:50227)
0809 15:30:42.144263 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:42.144280 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:42.144377 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:42.144761 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:42.144767 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:42.144797 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:30:42.144929 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:42.144936 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:42.145790 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:42.145794 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:42.146646 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:42.146657 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:42.147310 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:42.147316 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:42.147465 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:42.147496 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 15:30:42.147761 (+ 265us) client_negotiation.cc:240] Negotiation successful
0809 15:30:42.147845 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":1}
I20260809 15:30:42.149021 12634 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82a3aca19603425782948c3b2d97e9aa" candidate_uuid: "9ba65d7066b5433eb998599f82683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2924c0837e84c4a82dc9489d6ddb340" is_pre_election: true
I20260809 15:30:42.149026 12786 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82a3aca19603425782948c3b2d97e9aa" candidate_uuid: "9ba65d7066b5433eb998599f82683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fc783eeb2b64979a7332d27d790d780" is_pre_election: true
I20260809 15:30:42.149502 12634 raft_consensus.cc:2454] T 82a3aca19603425782948c3b2d97e9aa P b2924c0837e84c4a82dc9489d6ddb340 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba65d7066b5433eb998599f82683326 in term 0.
I20260809 15:30:42.150097 12865 leader_election.cc:302] T 82a3aca19603425782948c3b2d97e9aa P 9ba65d7066b5433eb998599f82683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ba65d7066b5433eb998599f82683326, b2924c0837e84c4a82dc9489d6ddb340; no voters:
I20260809 15:30:42.150408 13013 raft_consensus.cc:2781] T 82a3aca19603425782948c3b2d97e9aa P 9ba65d7066b5433eb998599f82683326 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:30:42.150501 13013 raft_consensus.cc:482] T 82a3aca19603425782948c3b2d97e9aa P 9ba65d7066b5433eb998599f82683326 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:30:42.150532 13013 raft_consensus.cc:3037] T 82a3aca19603425782948c3b2d97e9aa P 9ba65d7066b5433eb998599f82683326 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:30:42.151153 12786 raft_consensus.cc:2454] T 82a3aca19603425782948c3b2d97e9aa P 8fc783eeb2b64979a7332d27d790d780 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba65d7066b5433eb998599f82683326 in term 0.
I20260809 15:30:42.151799 13013 raft_consensus.cc:504] T 82a3aca19603425782948c3b2d97e9aa P 9ba65d7066b5433eb998599f82683326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba65d7066b5433eb998599f82683326" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38207 } } peers { permanent_uuid: "b2924c0837e84c4a82dc9489d6ddb340" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 43403 } } peers { permanent_uuid: "8fc783eeb2b64979a7332d27d790d780" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 36251 } }
I20260809 15:30:42.152181 13013 leader_election.cc:288] T 82a3aca19603425782948c3b2d97e9aa P 9ba65d7066b5433eb998599f82683326 [CANDIDATE]: Term 1 election: Requested vote from peers b2924c0837e84c4a82dc9489d6ddb340 (127.11.146.1:43403), 8fc783eeb2b64979a7332d27d790d780 (127.11.146.2:36251)
I20260809 15:30:42.152534 12786 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82a3aca19603425782948c3b2d97e9aa" candidate_uuid: "9ba65d7066b5433eb998599f82683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fc783eeb2b64979a7332d27d790d780"
I20260809 15:30:42.152521 12634 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82a3aca19603425782948c3b2d97e9aa" candidate_uuid: "9ba65d7066b5433eb998599f82683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2924c0837e84c4a82dc9489d6ddb340"
I20260809 15:30:42.152658 12786 raft_consensus.cc:3037] T 82a3aca19603425782948c3b2d97e9aa P 8fc783eeb2b64979a7332d27d790d780 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:30:42.152658 12634 raft_consensus.cc:3037] T 82a3aca19603425782948c3b2d97e9aa P b2924c0837e84c4a82dc9489d6ddb340 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:30:42.153952 12634 raft_consensus.cc:2454] T 82a3aca19603425782948c3b2d97e9aa P b2924c0837e84c4a82dc9489d6ddb340 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba65d7066b5433eb998599f82683326 in term 1.
I20260809 15:30:42.153955 12786 raft_consensus.cc:2454] T 82a3aca19603425782948c3b2d97e9aa P 8fc783eeb2b64979a7332d27d790d780 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba65d7066b5433eb998599f82683326 in term 1.
I20260809 15:30:42.154256 12865 leader_election.cc:302] T 82a3aca19603425782948c3b2d97e9aa P 9ba65d7066b5433eb998599f82683326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ba65d7066b5433eb998599f82683326, b2924c0837e84c4a82dc9489d6ddb340; no voters:
I20260809 15:30:42.154476 13013 raft_consensus.cc:2781] T 82a3aca19603425782948c3b2d97e9aa P 9ba65d7066b5433eb998599f82683326 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:30:42.154722 13013 raft_consensus.cc:686] T 82a3aca19603425782948c3b2d97e9aa P 9ba65d7066b5433eb998599f82683326 [term 1 LEADER]: Becoming Leader. State: Replica: 9ba65d7066b5433eb998599f82683326, State: Running, Role: LEADER
I20260809 15:30:42.155097 13013 consensus_queue.cc:237] T 82a3aca19603425782948c3b2d97e9aa P 9ba65d7066b5433eb998599f82683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba65d7066b5433eb998599f82683326" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38207 } } peers { permanent_uuid: "b2924c0837e84c4a82dc9489d6ddb340" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 43403 } } peers { permanent_uuid: "8fc783eeb2b64979a7332d27d790d780" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 36251 } }
I20260809 15:30:42.158416 12469 catalog_manager.cc:5495] T 82a3aca19603425782948c3b2d97e9aa P 9ba65d7066b5433eb998599f82683326 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ba65d7066b5433eb998599f82683326 (127.11.146.3). New cstate: current_term: 1 leader_uuid: "9ba65d7066b5433eb998599f82683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba65d7066b5433eb998599f82683326" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2924c0837e84c4a82dc9489d6ddb340" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 43403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fc783eeb2b64979a7332d27d790d780" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 36251 } health_report { overall_health: UNKNOWN } } }
Aug 09 15:30:42 dist-test-slave-1jjb krb5kdc[12420](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289441, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.1@KRBTEST.COM
I20260809 15:30:42.179822 13003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:42.170551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57606 (local address 127.11.146.1:43403)
0809 15:30:42.170705 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:42.170710 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:42.170844 (+ 134us) server_negotiation.cc:407] Connection header received
0809 15:30:42.171013 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:42.171016 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:42.171068 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:42.171151 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:42.171862 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:42.172438 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:42.173276 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:42.173498 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:42.173632 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:42.176400 (+ 2768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:42.176411 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:42.176427 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:42.176451 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:42.177929 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:42.178434 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:42.178440 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:42.178441 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:42.178528 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:42.178850 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:42.178853 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:42.178855 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:42.179120 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:42.179352 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:42.179521 (+ 169us) server_negotiation.cc:299] Negotiation successful
0809 15:30:42.179651 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
Aug 09 15:30:42 dist-test-slave-1jjb krb5kdc[12420](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289442, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 15:30:42 dist-test-slave-1jjb krb5kdc[12420](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289442, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.146.1@KRBTEST.COM
I20260809 15:30:42.208448 13003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:42.200052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57612 (local address 127.11.146.1:43403)
0809 15:30:42.200239 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:42.200242 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:42.200301 (+ 59us) server_negotiation.cc:407] Connection header received
0809 15:30:42.200477 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:42.200480 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:42.200524 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:42.200595 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:42.201256 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:42.201796 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:42.202590 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:42.202804 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:42.202878 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:42.205327 (+ 2449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:42.205330 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:42.205332 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:42.205355 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:42.206751 (+ 1396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:42.207172 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:42.207176 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:42.207177 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:42.207258 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:42.207503 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:42.207505 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:42.207506 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:42.207675 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:42.207774 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:42.208058 (+ 284us) server_negotiation.cc:299] Negotiation successful
0809 15:30:42.208230 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
Aug 09 15:30:42 dist-test-slave-1jjb krb5kdc[12420](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289442, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 15:30:42 dist-test-slave-1jjb krb5kdc[12420](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289442, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.1@KRBTEST.COM
I20260809 15:30:42.237120 13003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:42.228037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57616 (local address 127.11.146.1:43403)
0809 15:30:42.228242 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:42.228247 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:42.228324 (+ 77us) server_negotiation.cc:407] Connection header received
0809 15:30:42.228451 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:42.228453 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:42.228498 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:42.228569 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:42.229291 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:42.229809 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:42.230652 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:42.230855 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:42.230937 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:42.233712 (+ 2775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:42.233715 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:42.233717 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:42.233740 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:42.235196 (+ 1456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:42.235761 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:42.235768 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:42.235770 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:42.235864 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:42.236218 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:42.236221 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:42.236223 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:42.236425 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:42.236565 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:42.236819 (+ 254us) server_negotiation.cc:299] Negotiation successful
0809 15:30:42.236951 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
W20260809 15:30:42.238888 12590 tablet_service.cc:2908] Rejecting scan request for tablet 82a3aca19603425782948c3b2d97e9aa: Uninitialized: clean time has not yet been initialized
I20260809 15:30:42.241392 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 12547
I20260809 15:30:42.253661 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 12693
I20260809 15:30:42.262392 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 12847
I20260809 15:30:42.270153 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 12435
2026-08-09T15:30:42Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2429 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:30:42 dist-test-slave-1jjb krb5kdc[13031](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:30:42 dist-test-slave-1jjb krb5kdc[13031](info): set up 2 sockets
Aug 09 15:30:42 dist-test-slave-1jjb krb5kdc[13031](info): commencing operation
krb5kdc: starting...
W20260809 15:30:43.373974 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.079s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:30:43 dist-test-slave-1jjb krb5kdc[13031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289443, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:30:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:30:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.146.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
I20260809 15:30:43.512221 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:42045
--webserver_interface=127.11.146.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:41867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:42045
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:30:43.633203 13045 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:30:43.633558 13045 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:30:43.633648 13045 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:30:43.637944 13045 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:30:43.638031 13045 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 15:30:43.638063 13045 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:30:43.638103 13045 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:30:43.638141 13045 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:30:43.638177 13045 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:30:43.643698 13045 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:41867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:42045
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:42045
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13045
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:30:43.645054 13045 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:30:43.646587 13045 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 15:30:43.655390 13045 server_base.cc:1034] running on GCE node
W20260809 15:30:43.655378 13054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:43.655364 13051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:43.655364 13052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:43.656347 13045 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:30:43.657362 13045 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:30:43.658525 13045 hybrid_clock.cc:648] HybridClock initialized: now 1786289443658508 us; error 30 us; skew 500 ppm
Aug 09 15:30:43 dist-test-slave-1jjb krb5kdc[13031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289443, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:30:43.666625 13045 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:30:43.667753 13045 webserver.cc:460] Webserver started at http://127.11.146.62:41695/ using document root <none> and password file <none>
I20260809 15:30:43.668429 13045 fs_manager.cc:359] Metadata directory not provided
I20260809 15:30:43.668506 13045 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:30:43.668735 13045 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:30:43.670926 13045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "112bd3dca4fb4e65ba236f3be1e67e1b"
format_stamp: "Formatted at 2026-08-09 15:30:43 on dist-test-slave-1jjb"
server_key: "fc4b1f5e507581d25aeb5943be2e863b"
server_key_iv: "7ca3a4b60a86c9ab79515a8ec721b985"
server_key_version: "encryptionkey@0"
I20260809 15:30:43.671527 13045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "112bd3dca4fb4e65ba236f3be1e67e1b"
format_stamp: "Formatted at 2026-08-09 15:30:43 on dist-test-slave-1jjb"
server_key: "fc4b1f5e507581d25aeb5943be2e863b"
server_key_iv: "7ca3a4b60a86c9ab79515a8ec721b985"
server_key_version: "encryptionkey@0"
I20260809 15:30:43.675415 13045 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260809 15:30:43.678174 13061 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:43.679502 13045 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:30:43.679661 13045 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "112bd3dca4fb4e65ba236f3be1e67e1b"
format_stamp: "Formatted at 2026-08-09 15:30:43 on dist-test-slave-1jjb"
server_key: "fc4b1f5e507581d25aeb5943be2e863b"
server_key_iv: "7ca3a4b60a86c9ab79515a8ec721b985"
server_key_version: "encryptionkey@0"
I20260809 15:30:43.679780 13045 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:30:43.698957 13045 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:30:43.702278 13045 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:30:43.702526 13045 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:30:43.711851 13045 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:42045
I20260809 15:30:43.711901 13128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:42045 every 8 connection(s)
I20260809 15:30:43.712836 13045 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:30:43.715629 13129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:30:43.720773 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 13045
I20260809 15:30:43.720893 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:30:43.721160 11848 external_mini_cluster.cc:1428] Setting key d66135747a5fabf870c173699404ac11
I20260809 15:30:43.721395 13129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 112bd3dca4fb4e65ba236f3be1e67e1b: Bootstrap starting.
I20260809 15:30:43.723919 13129 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 112bd3dca4fb4e65ba236f3be1e67e1b: Neither blocks nor log segments found. Creating new log.
I20260809 15:30:43.724937 13129 log.cc:824] T 00000000000000000000000000000000 P 112bd3dca4fb4e65ba236f3be1e67e1b: Log is configured to *not* fsync() on all Append() calls
I20260809 15:30:43.727077 13129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 112bd3dca4fb4e65ba236f3be1e67e1b: No bootstrap required, opened a new log
Aug 09 15:30:43 dist-test-slave-1jjb krb5kdc[13031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289443, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:30:43.731591 13129 raft_consensus.cc:348] T 00000000000000000000000000000000 P 112bd3dca4fb4e65ba236f3be1e67e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "112bd3dca4fb4e65ba236f3be1e67e1b" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 42045 } }
I20260809 15:30:43.731853 13129 raft_consensus.cc:374] T 00000000000000000000000000000000 P 112bd3dca4fb4e65ba236f3be1e67e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:30:43.731940 13129 raft_consensus.cc:729] T 00000000000000000000000000000000 P 112bd3dca4fb4e65ba236f3be1e67e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 112bd3dca4fb4e65ba236f3be1e67e1b, State: Initialized, Role: FOLLOWER
I20260809 15:30:43.732489 13129 consensus_queue.cc:260] T 00000000000000000000000000000000 P 112bd3dca4fb4e65ba236f3be1e67e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "112bd3dca4fb4e65ba236f3be1e67e1b" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 42045 } }
I20260809 15:30:43.732648 13129 raft_consensus.cc:388] T 00000000000000000000000000000000 P 112bd3dca4fb4e65ba236f3be1e67e1b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:30:43.732736 13129 raft_consensus.cc:482] T 00000000000000000000000000000000 P 112bd3dca4fb4e65ba236f3be1e67e1b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:30:43.732837 13129 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 112bd3dca4fb4e65ba236f3be1e67e1b [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:30:43.733747 13129 raft_consensus.cc:504] T 00000000000000000000000000000000 P 112bd3dca4fb4e65ba236f3be1e67e1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "112bd3dca4fb4e65ba236f3be1e67e1b" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 42045 } }
I20260809 15:30:43.734114 13129 leader_election.cc:302] T 00000000000000000000000000000000 P 112bd3dca4fb4e65ba236f3be1e67e1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 112bd3dca4fb4e65ba236f3be1e67e1b; no voters:
I20260809 15:30:43.734472 13129 leader_election.cc:288] T 00000000000000000000000000000000 P 112bd3dca4fb4e65ba236f3be1e67e1b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:30:43.734577 13134 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 112bd3dca4fb4e65ba236f3be1e67e1b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:30:43.734819 13134 raft_consensus.cc:686] T 00000000000000000000000000000000 P 112bd3dca4fb4e65ba236f3be1e67e1b [term 1 LEADER]: Becoming Leader. State: Replica: 112bd3dca4fb4e65ba236f3be1e67e1b, State: Running, Role: LEADER
I20260809 15:30:43.735140 13134 consensus_queue.cc:237] T 00000000000000000000000000000000 P 112bd3dca4fb4e65ba236f3be1e67e1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "112bd3dca4fb4e65ba236f3be1e67e1b" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 42045 } }
I20260809 15:30:43.735895 13129 sys_catalog.cc:564] T 00000000000000000000000000000000 P 112bd3dca4fb4e65ba236f3be1e67e1b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:30:43.736891 13136 sys_catalog.cc:455] T 00000000000000000000000000000000 P 112bd3dca4fb4e65ba236f3be1e67e1b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 112bd3dca4fb4e65ba236f3be1e67e1b. Latest consensus state: current_term: 1 leader_uuid: "112bd3dca4fb4e65ba236f3be1e67e1b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "112bd3dca4fb4e65ba236f3be1e67e1b" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 42045 } } }
I20260809 15:30:43.737042 13136 sys_catalog.cc:458] T 00000000000000000000000000000000 P 112bd3dca4fb4e65ba236f3be1e67e1b [sys.catalog]: This master's current role is: LEADER
I20260809 15:30:43.737277 13132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:43.722504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42922 (local address 127.11.146.62:42045)
0809 15:30:43.722929 (+ 425us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:43.722951 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:43.722986 (+ 35us) server_negotiation.cc:407] Connection header received
0809 15:30:43.723632 (+ 646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:43.723651 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:43.724014 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:43.724379 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:43.725291 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:43.726255 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:43.727379 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:43.727952 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:43.728140 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:43.731116 (+ 2976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:43.731122 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:43.731134 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:43.731161 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:43.733362 (+ 2201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:43.733848 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:43.733854 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:43.733860 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:43.734016 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:43.734322 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:43.734326 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:43.734328 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:43.734903 (+ 575us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:43.735704 (+ 801us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:43.735856 (+ 152us) server_negotiation.cc:299] Negotiation successful
0809 15:30:43.736199 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":156,"threads_started":1}
I20260809 15:30:43.737375 13135 sys_catalog.cc:455] T 00000000000000000000000000000000 P 112bd3dca4fb4e65ba236f3be1e67e1b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "112bd3dca4fb4e65ba236f3be1e67e1b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "112bd3dca4fb4e65ba236f3be1e67e1b" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 42045 } } }
I20260809 15:30:43.737474 13135 sys_catalog.cc:458] T 00000000000000000000000000000000 P 112bd3dca4fb4e65ba236f3be1e67e1b [sys.catalog]: This master's current role is: LEADER
I20260809 15:30:43.737746 13145 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:30:43.740768 13145 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:30:43.746073 13145 catalog_manager.cc:1347] Generated new cluster ID: bf9e4581fd224e36a4a6f722aab85e00
I20260809 15:30:43.746130 13145 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:30:43.769145 13145 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:30:43.770084 13145 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:30:43.775405 13145 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 112bd3dca4fb4e65ba236f3be1e67e1b: Generated new TSK 0
I20260809 15:30:43.776239 13145 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.146.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
I20260809 15:30:43.815907 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.1:0
--local_ip_for_outbound_sockets=127.11.146.1
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:42045
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:41867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:30:43.931226 13160 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:30:43.931528 13160 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:30:43.931609 13160 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:30:43.935768 13160 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:30:43.935847 13160 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:30:43.935915 13160 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 15:30:43.935998 13160 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.1
I20260809 15:30:43.941820 13160 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:41867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.146.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.146.62:42045
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13160
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.1
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:30:43.943075 13160 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:30:43.944186 13160 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:30:43.954299 13166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:43.954308 13168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:43.954670 13160 server_base.cc:1034] running on GCE node
W20260809 15:30:43.954567 13165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:43.955080 13160 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:30:43.955807 13160 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:30:43.956997 13160 hybrid_clock.cc:648] HybridClock initialized: now 1786289443956971 us; error 37 us; skew 500 ppm
Aug 09 15:30:43 dist-test-slave-1jjb krb5kdc[13031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289443, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:30:43.959828 13160 init.cc:377] Logged in from keytab as kudu/127.11.146.1@KRBTEST.COM (short username kudu)
I20260809 15:30:43.960758 13160 webserver.cc:460] Webserver started at http://127.11.146.1:35815/ using document root <none> and password file <none>
I20260809 15:30:43.961269 13160 fs_manager.cc:359] Metadata directory not provided
I20260809 15:30:43.961330 13160 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:30:43.961501 13160 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:30:43.963423 13160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-0/data/instance:
uuid: "24b485058dad4e0abdacbdf8ae4349bd"
format_stamp: "Formatted at 2026-08-09 15:30:43 on dist-test-slave-1jjb"
server_key: "835459a92edb14e1c421cae72671d77f"
server_key_iv: "db799b4978cc2cac8a60719952bb1b52"
server_key_version: "encryptionkey@0"
I20260809 15:30:43.963933 13160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance:
uuid: "24b485058dad4e0abdacbdf8ae4349bd"
format_stamp: "Formatted at 2026-08-09 15:30:43 on dist-test-slave-1jjb"
server_key: "835459a92edb14e1c421cae72671d77f"
server_key_iv: "db799b4978cc2cac8a60719952bb1b52"
server_key_version: "encryptionkey@0"
I20260809 15:30:43.967518 13160 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.002s
I20260809 15:30:43.969962 13175 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:43.971118 13160 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:30:43.971215 13160 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-0/wal
uuid: "24b485058dad4e0abdacbdf8ae4349bd"
format_stamp: "Formatted at 2026-08-09 15:30:43 on dist-test-slave-1jjb"
server_key: "835459a92edb14e1c421cae72671d77f"
server_key_iv: "db799b4978cc2cac8a60719952bb1b52"
server_key_version: "encryptionkey@0"
I20260809 15:30:43.971297 13160 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:30:43.983840 13160 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:30:43.987309 13160 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:30:43.987529 13160 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:30:43.989255 13160 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:30:43.989333 13160 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:43.989409 13160 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:30:43.989475 13160 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 15:30:43 dist-test-slave-1jjb krb5kdc[13031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289443, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:30:44.000666 13160 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.1:40303
I20260809 15:30:44.000748 13302 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.1:40303 every 8 connection(s)
I20260809 15:30:44.001727 13160 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
I20260809 15:30:44.003945 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 13160
I20260809 15:30:44.004067 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance
I20260809 15:30:44.004184 13132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:43.990158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:48311 (local address 127.11.146.62:42045)
0809 15:30:43.990317 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:43.990322 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:43.991258 (+ 936us) server_negotiation.cc:407] Connection header received
0809 15:30:43.992450 (+ 1192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:43.992454 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:43.992518 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:43.992608 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:43.994082 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:43.995008 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:43.996544 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:43.996806 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:43.996927 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:43.999792 (+ 2865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:43.999796 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:43.999798 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:43.999825 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:44.001530 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:44.002193 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:44.002197 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:44.002199 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:44.002312 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:44.002789 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:44.002792 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:44.002794 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:44.003037 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:44.003126 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:44.003781 (+ 655us) server_negotiation.cc:299] Negotiation successful
0809 15:30:44.003949 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 15:30:44.004432 11848 external_mini_cluster.cc:1428] Setting key a97e738304f13ecbee0be0cd0c5bfd55
I20260809 15:30:44.004941 13184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:43.990596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:42045 (local address 127.11.146.1:48311)
0809 15:30:43.991067 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:43.991119 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:43.992164 (+ 1045us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:43.992811 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:43.992823 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:43.993221 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:30:43.993888 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:43.993908 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:43.995163 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:43.995169 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:43.996411 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:43.996422 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:43.997011 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:43.997016 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:43.997192 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:43.997830 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:30:43.997847 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:30:43.999554 (+ 1707us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:30:44.001654 (+ 2100us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:44.001660 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:44.001678 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:44.002051 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:44.002479 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:44.002482 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:44.002484 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:44.002661 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:44.003146 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:30:44.003152 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:30:44.003415 (+ 263us) client_negotiation.cc:769] Sending connection context
0809 15:30:44.003609 (+ 194us) client_negotiation.cc:240] Negotiation successful
0809 15:30:44.003885 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":139,"threads_started":1}
I20260809 15:30:44.006811 13303 heartbeater.cc:347] Connected to a master server at 127.11.146.62:42045
I20260809 15:30:44.006984 13303 heartbeater.cc:464] Registering TS with master...
I20260809 15:30:44.007618 13303 heartbeater.cc:511] Master 127.11.146.62:42045 requested a full tablet report, sending...
I20260809 15:30:44.009420 13078 ts_manager.cc:194] Registered new tserver with Master: 24b485058dad4e0abdacbdf8ae4349bd (127.11.146.1:40303)
I20260809 15:30:44.010568 13078 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.1@KRBTEST.COM'} at 127.11.146.1:48311
WARNING: no policy specified for kudu/127.11.146.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.2@KRBTEST.COM" created.
I20260809 15:30:44.023128 13132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:44.009391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:43215 (local address 127.11.146.62:42045)
0809 15:30:44.009506 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:44.009512 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:44.015810 (+ 6298us) server_negotiation.cc:407] Connection header received
0809 15:30:44.015979 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:44.015981 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:44.016025 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:44.016146 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:44.016589 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.017170 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.018013 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.018231 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.018338 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:44.019473 (+ 1135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:44.019476 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:44.019478 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:44.019499 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:44.021252 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:44.021752 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:44.021755 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:44.021757 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:44.021880 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:44.022193 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:44.022200 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:44.022202 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:44.022385 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:44.022566 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:44.022835 (+ 269us) server_negotiation.cc:299] Negotiation successful
0809 15:30:44.022958 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 15:30:44.023144 13311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:44.009359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:42045 (local address 127.11.146.1:43215)
0809 15:30:44.015707 (+ 6348us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:44.015721 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:44.015862 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:44.016165 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:44.016169 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:44.016372 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:30:44.016473 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:44.016479 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.017308 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.017311 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:44.017861 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:44.017869 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.018357 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.018360 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:44.018461 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:44.019005 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:30:44.019016 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:30:44.019322 (+ 306us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:30:44.021403 (+ 2081us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:44.021406 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:44.021407 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:44.021633 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:44.021996 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:44.022000 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:44.022002 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:44.022096 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:44.022556 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:30:44.022559 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:30:44.022662 (+ 103us) client_negotiation.cc:769] Sending connection context
0809 15:30:44.022768 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 15:30:44.022924 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6251,"thread_start_us":109,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
I20260809 15:30:44.035806 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.2:0
--local_ip_for_outbound_sockets=127.11.146.2
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:42045
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:41867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:30:44.151230 13313 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:30:44.151470 13313 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:30:44.151513 13313 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:30:44.155550 13313 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:30:44.155608 13313 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:30:44.155647 13313 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 15:30:44.155679 13313 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.2
I20260809 15:30:44.161362 13313 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:41867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.146.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.146.62:42045
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13313
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.2
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:30:44.162513 13313 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:30:44.163770 13313 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:30:44.173578 13320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:44.173641 13313 server_base.cc:1034] running on GCE node
W20260809 15:30:44.173588 13319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:44.173584 13322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:44.174302 13313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:30:44.174914 13313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:30:44.176162 13313 hybrid_clock.cc:648] HybridClock initialized: now 1786289444176135 us; error 34 us; skew 500 ppm
Aug 09 15:30:44 dist-test-slave-1jjb krb5kdc[13031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289444, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:30:44.178932 13313 init.cc:377] Logged in from keytab as kudu/127.11.146.2@KRBTEST.COM (short username kudu)
I20260809 15:30:44.179849 13313 webserver.cc:460] Webserver started at http://127.11.146.2:36143/ using document root <none> and password file <none>
I20260809 15:30:44.180454 13313 fs_manager.cc:359] Metadata directory not provided
I20260809 15:30:44.180514 13313 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:30:44.180724 13313 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:30:44.182808 13313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-1/data/instance:
uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863"
format_stamp: "Formatted at 2026-08-09 15:30:44 on dist-test-slave-1jjb"
server_key: "19e48fb4dd728c77944a4b445f6711b6"
server_key_iv: "7b2ef3894db76e6c355cb9f72ba275d4"
server_key_version: "encryptionkey@0"
I20260809 15:30:44.183430 13313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance:
uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863"
format_stamp: "Formatted at 2026-08-09 15:30:44 on dist-test-slave-1jjb"
server_key: "19e48fb4dd728c77944a4b445f6711b6"
server_key_iv: "7b2ef3894db76e6c355cb9f72ba275d4"
server_key_version: "encryptionkey@0"
I20260809 15:30:44.187191 13313 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 15:30:44.190212 13329 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:44.191495 13313 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 15:30:44.191601 13313 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-1/wal
uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863"
format_stamp: "Formatted at 2026-08-09 15:30:44 on dist-test-slave-1jjb"
server_key: "19e48fb4dd728c77944a4b445f6711b6"
server_key_iv: "7b2ef3894db76e6c355cb9f72ba275d4"
server_key_version: "encryptionkey@0"
I20260809 15:30:44.191735 13313 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:30:44.213901 13313 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:30:44.217324 13313 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:30:44.217546 13313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:30:44.219463 13313 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:30:44.219535 13313 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:44.219609 13313 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:30:44.219631 13313 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 15:30:44 dist-test-slave-1jjb krb5kdc[13031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289444, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:30:44.231297 13313 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.2:38187
I20260809 15:30:44.232157 13457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.2:38187 every 8 connection(s)
I20260809 15:30:44.232506 13313 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
I20260809 15:30:44.233690 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 13313
I20260809 15:30:44.233788 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance
I20260809 15:30:44.234074 11848 external_mini_cluster.cc:1428] Setting key 33cea59ef758a65dbe60616e754d3b9c
I20260809 15:30:44.234302 13132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:44.220448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:53531 (local address 127.11.146.62:42045)
0809 15:30:44.220635 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:44.220639 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:44.221550 (+ 911us) server_negotiation.cc:407] Connection header received
0809 15:30:44.222642 (+ 1092us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:44.222646 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:44.222715 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:44.222829 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:44.224279 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.225203 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.226614 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.227038 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.227166 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:44.230143 (+ 2977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:44.230147 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:44.230150 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:44.230181 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:44.231886 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:44.232544 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:44.232550 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:44.232551 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:44.232643 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:44.232991 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:44.232994 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:44.232999 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:44.233235 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:44.233338 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:44.234001 (+ 663us) server_negotiation.cc:299] Negotiation successful
0809 15:30:44.234128 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260809 15:30:44.235138 13339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:44.220903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:42045 (local address 127.11.146.2:53531)
0809 15:30:44.221380 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:44.221430 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:44.222406 (+ 976us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:44.223055 (+ 649us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:44.223064 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:44.223511 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:30:44.224070 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:44.224133 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.225371 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.225374 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:44.226501 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:44.226512 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.227209 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.227216 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:44.227474 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:44.228319 (+ 845us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:30:44.228336 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:30:44.229949 (+ 1613us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:30:44.232025 (+ 2076us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:44.232030 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:44.232041 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:44.232422 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:44.232733 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:44.232735 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:44.232737 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:44.232868 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:44.233428 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:30:44.233434 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:30:44.233723 (+ 289us) client_negotiation.cc:769] Sending connection context
0809 15:30:44.233951 (+ 228us) client_negotiation.cc:240] Negotiation successful
0809 15:30:44.234266 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":129,"threads_started":1}
I20260809 15:30:44.236469 13458 heartbeater.cc:347] Connected to a master server at 127.11.146.62:42045
I20260809 15:30:44.236627 13458 heartbeater.cc:464] Registering TS with master...
I20260809 15:30:44.237179 13458 heartbeater.cc:511] Master 127.11.146.62:42045 requested a full tablet report, sending...
I20260809 15:30:44.238327 13079 ts_manager.cc:194] Registered new tserver with Master: a32a7ecc6a5f4bb2a0dc3392a9e6d863 (127.11.146.2:38187)
I20260809 15:30:44.239147 13079 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.2@KRBTEST.COM'} at 127.11.146.2:53531
WARNING: no policy specified for kudu/127.11.146.3@KRBTEST.COM; defaulting to no policy
I20260809 15:30:44.248126 13466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:44.239068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:42045 (local address 127.11.146.2:57281)
0809 15:30:44.239365 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:44.239384 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:44.239549 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:44.240021 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:44.240027 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:44.240337 (+ 310us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:30:44.240518 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:44.240531 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.241509 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.241516 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:44.242554 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:44.242571 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.243246 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.243252 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:44.243406 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:44.244120 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:30:44.244143 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:30:44.244621 (+ 478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:30:44.246376 (+ 1755us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:44.246380 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:44.246382 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:44.246641 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:44.246967 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:44.246972 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:44.246974 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:44.247074 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:44.247501 (+ 427us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:30:44.247504 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:30:44.247629 (+ 125us) client_negotiation.cc:769] Sending connection context
0809 15:30:44.247738 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 15:30:44.247913 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":100,"threads_started":1}
I20260809 15:30:44.248246 13132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:44.238956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:57281 (local address 127.11.146.62:42045)
0809 15:30:44.239110 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:44.239118 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:44.239470 (+ 352us) server_negotiation.cc:407] Connection header received
0809 15:30:44.239831 (+ 361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:44.239834 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:44.239880 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:44.239972 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:44.240668 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.241379 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.242724 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.243072 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.243198 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:44.244763 (+ 1565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:44.244766 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:44.244768 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:44.244790 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:44.246261 (+ 1471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:44.246757 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:44.246762 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:44.246768 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:44.246847 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:44.247164 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:44.247167 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:44.247168 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:44.247383 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:44.247477 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:44.247854 (+ 377us) server_negotiation.cc:299] Negotiation successful
0809 15:30:44.248030 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
I20260809 15:30:44.269001 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.3:0
--local_ip_for_outbound_sockets=127.11.146.3
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:42045
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:41867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:30:44.395502 13468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:30:44.395759 13468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:30:44.395803 13468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:30:44.399971 13468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:30:44.400040 13468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:30:44.400141 13468 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 15:30:44.400233 13468 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.3
I20260809 15:30:44.405875 13468 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:41867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.146.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.146.62:42045
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13468
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.3
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:30:44.407115 13468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:30:44.408537 13468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:30:44.419581 13477 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:44.419618 13474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:44.419581 13475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:44.419826 13468 server_base.cc:1034] running on GCE node
I20260809 15:30:44.420416 13468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:30:44.421077 13468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:30:44.422258 13468 hybrid_clock.cc:648] HybridClock initialized: now 1786289444422235 us; error 26 us; skew 500 ppm
Aug 09 15:30:44 dist-test-slave-1jjb krb5kdc[13031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289444, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:30:44.425202 13468 init.cc:377] Logged in from keytab as kudu/127.11.146.3@KRBTEST.COM (short username kudu)
I20260809 15:30:44.426136 13468 webserver.cc:460] Webserver started at http://127.11.146.3:44257/ using document root <none> and password file <none>
I20260809 15:30:44.426707 13468 fs_manager.cc:359] Metadata directory not provided
I20260809 15:30:44.426770 13468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:30:44.426986 13468 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:30:44.429242 13468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-2/data/instance:
uuid: "fb87091e44164cb0ad48f3ca5858ee82"
format_stamp: "Formatted at 2026-08-09 15:30:44 on dist-test-slave-1jjb"
server_key: "22375fc19b1147eace061b79723dbd1e"
server_key_iv: "771e2b5c5e0c446d610fca9b79e323bd"
server_key_version: "encryptionkey@0"
I20260809 15:30:44.429823 13468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance:
uuid: "fb87091e44164cb0ad48f3ca5858ee82"
format_stamp: "Formatted at 2026-08-09 15:30:44 on dist-test-slave-1jjb"
server_key: "22375fc19b1147eace061b79723dbd1e"
server_key_iv: "771e2b5c5e0c446d610fca9b79e323bd"
server_key_version: "encryptionkey@0"
I20260809 15:30:44.433557 13468 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 15:30:44.435952 13484 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:44.437371 13468 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:30:44.437470 13468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-2/wal
uuid: "fb87091e44164cb0ad48f3ca5858ee82"
format_stamp: "Formatted at 2026-08-09 15:30:44 on dist-test-slave-1jjb"
server_key: "22375fc19b1147eace061b79723dbd1e"
server_key_iv: "771e2b5c5e0c446d610fca9b79e323bd"
server_key_version: "encryptionkey@0"
I20260809 15:30:44.437606 13468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:30:44.479969 13468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:30:44.483053 13468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:30:44.483249 13468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:30:44.485342 13468 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:30:44.485422 13468 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:44.485499 13468 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:30:44.485548 13468 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 15:30:44 dist-test-slave-1jjb krb5kdc[13031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289444, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:30:44.497155 13468 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.3:37549
I20260809 15:30:44.497504 13613 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.3:37549 every 8 connection(s)
I20260809 15:30:44.498152 13468 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
I20260809 15:30:44.500170 13132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:44.486006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:42857 (local address 127.11.146.62:42045)
0809 15:30:44.486169 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:44.486174 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:44.487455 (+ 1281us) server_negotiation.cc:407] Connection header received
0809 15:30:44.488868 (+ 1413us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:44.488872 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:44.488931 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:44.489024 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:44.490737 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.491351 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.492977 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.493220 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.493341 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:44.496165 (+ 2824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:44.496168 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:44.496170 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:44.496196 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:44.497958 (+ 1762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:44.498542 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:44.498546 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:44.498548 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:44.498648 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:44.499057 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:44.499061 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:44.499062 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:44.499254 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:44.499338 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:44.499888 (+ 550us) server_negotiation.cc:299] Negotiation successful
0809 15:30:44.499995 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 15:30:44.500893 13494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:44.486829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:42045 (local address 127.11.146.3:42857)
0809 15:30:44.487306 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:44.487356 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:44.488629 (+ 1273us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:44.489263 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:44.489276 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:44.489772 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:30:44.490536 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:44.490560 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.491497 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.491501 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:44.492833 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:44.492862 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.493395 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.493399 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:44.493569 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:44.494181 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:30:44.494197 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:30:44.495948 (+ 1751us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:30:44.498086 (+ 2138us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:44.498092 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:44.498107 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:44.498430 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:44.498760 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:44.498763 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:44.498764 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:44.498944 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:44.499366 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:30:44.499373 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:30:44.499652 (+ 279us) client_negotiation.cc:769] Sending connection context
0809 15:30:44.499800 (+ 148us) client_negotiation.cc:240] Negotiation successful
0809 15:30:44.500033 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":138,"threads_started":1}
I20260809 15:30:44.502009 13614 heartbeater.cc:347] Connected to a master server at 127.11.146.62:42045
I20260809 15:30:44.502157 13614 heartbeater.cc:464] Registering TS with master...
I20260809 15:30:44.502743 13614 heartbeater.cc:511] Master 127.11.146.62:42045 requested a full tablet report, sending...
I20260809 15:30:44.503898 13078 ts_manager.cc:194] Registered new tserver with Master: fb87091e44164cb0ad48f3ca5858ee82 (127.11.146.3:37549)
I20260809 15:30:44.504581 13078 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.3@KRBTEST.COM'} at 127.11.146.3:42857
I20260809 15:30:44.507963 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 13468
I20260809 15:30:44.508128 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance
I20260809 15:30:44.508404 11848 external_mini_cluster.cc:1428] Setting key 081d75ebb13b6dc0e42c315358179734
I20260809 15:30:44.510622 11848 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:30:44.512001 13621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:44.504508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:42045 (local address 127.11.146.3:44563)
0809 15:30:44.504842 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:44.504860 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:44.504971 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:44.505232 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:44.505235 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:44.505435 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:30:44.505580 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:44.505592 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.506563 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.506565 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:44.507102 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:44.507109 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.507594 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.507597 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:44.507727 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:44.508268 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:30:44.508279 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:30:44.508633 (+ 354us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:30:44.510431 (+ 1798us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:44.510434 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:44.510436 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:44.510642 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:44.510946 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:44.510949 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:44.510950 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:44.511027 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:44.511479 (+ 452us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:30:44.511481 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:30:44.511666 (+ 185us) client_negotiation.cc:769] Sending connection context
0809 15:30:44.511763 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 15:30:44.511868 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":112,"threads_started":1}
I20260809 15:30:44.512246 13132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:44.504575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:44563 (local address 127.11.146.62:42045)
0809 15:30:44.504703 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:44.504707 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:44.504934 (+ 227us) server_negotiation.cc:407] Connection header received
0809 15:30:44.505083 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:44.505086 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:44.505133 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:44.505208 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:44.505712 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.506436 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.507257 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.507494 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.507577 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:44.508773 (+ 1196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:44.508776 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:44.508777 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:44.508798 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:44.510304 (+ 1506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:44.510762 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:44.510766 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:44.510768 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:44.510852 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:44.511134 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:44.511137 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:44.511140 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:44.511366 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:44.511482 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:44.511854 (+ 372us) server_negotiation.cc:299] Negotiation successful
0809 15:30:44.511993 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
Aug 09 15:30:44 dist-test-slave-1jjb krb5kdc[13031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289444, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 15:30:44 dist-test-slave-1jjb krb5kdc[13031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289444, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:30:44.538717 13132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:44.530266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42926 (local address 127.11.146.62:42045)
0809 15:30:44.530397 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:44.530401 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:44.530413 (+ 12us) server_negotiation.cc:407] Connection header received
0809 15:30:44.530452 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:44.530454 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:44.530490 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:44.530584 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:44.531293 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.531819 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.532709 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.532929 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.533035 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:44.535363 (+ 2328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:44.535373 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:44.535376 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:44.535399 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:44.537045 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:44.537472 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:44.537477 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:44.537478 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:44.537561 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:44.537860 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:44.537864 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:44.537866 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:44.538050 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:44.538190 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:44.538431 (+ 241us) server_negotiation.cc:299] Negotiation successful
0809 15:30:44.538557 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 15:30:44.541880 13078 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42926:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:30:44.545136 13078 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:30:44.559564 13638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:44.554416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43116 (local address 127.11.146.1:40303)
0809 15:30:44.555100 (+ 684us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:44.555106 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:44.555126 (+ 20us) server_negotiation.cc:407] Connection header received
0809 15:30:44.555202 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:44.555206 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:44.555370 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:44.555513 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:30:44.555705 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.556674 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.557914 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.558742 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.558856 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:44.559019 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:44.559318 (+ 299us) server_negotiation.cc:299] Negotiation successful
0809 15:30:44.559409 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":569,"thread_start_us":73,"threads_started":1}
I20260809 15:30:44.559602 13636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:44.553840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:40303 (local address 127.0.0.1:43116)
0809 15:30:44.554112 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:44.554126 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:44.554199 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:44.555497 (+ 1298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:44.555500 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:44.555520 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:30:44.555593 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:44.555598 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.556971 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.556975 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:44.557785 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:44.557795 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.558877 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.558882 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:44.559018 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:44.559158 (+ 140us) client_negotiation.cc:769] Sending connection context
0809 15:30:44.559270 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 15:30:44.559437 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"mutex_wait_us":71,"thread_start_us":115,"threads_started":1}
I20260809 15:30:44.559602 13633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:44.553164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:37549 (local address 127.0.0.1:47124)
0809 15:30:44.553503 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:44.553552 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:44.553680 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:44.555158 (+ 1478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:44.555161 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:44.555179 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:30:44.555273 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:44.555284 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.556443 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.556448 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:44.557989 (+ 1541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:44.558001 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.558944 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.558947 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:44.559023 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:44.559158 (+ 135us) client_negotiation.cc:769] Sending connection context
0809 15:30:44.559261 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 15:30:44.559441 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"mutex_wait_us":213,"thread_start_us":74,"threads_started":1}
I20260809 15:30:44.559794 13637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:44.553979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34478 (local address 127.11.146.2:38187)
0809 15:30:44.554306 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:44.554320 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:44.554344 (+ 24us) server_negotiation.cc:407] Connection header received
0809 15:30:44.554420 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:44.554425 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:44.554631 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:44.554841 (+ 210us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:30:44.555092 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.556304 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.558147 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.558932 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.559029 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:44.559182 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:44.559517 (+ 335us) server_negotiation.cc:299] Negotiation successful
0809 15:30:44.559620 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":111,"threads_started":1}
I20260809 15:30:44.560110 13635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:44.553556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:38187 (local address 127.0.0.1:34478)
0809 15:30:44.553926 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:44.553939 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:44.554038 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:44.554805 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:44.554812 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:44.554836 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:30:44.554964 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:44.554971 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.556462 (+ 1491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.556464 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:44.558019 (+ 1555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:44.558028 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.559099 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.559102 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:44.559205 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:44.559227 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 15:30:44.559306 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 15:30:44.559409 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"mutex_wait_us":109,"thread_start_us":90,"threads_started":1}
I20260809 15:30:44.560257 13634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:44.553351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47124 (local address 127.11.146.3:37549)
0809 15:30:44.554713 (+ 1362us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:44.554726 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:44.554749 (+ 23us) server_negotiation.cc:407] Connection header received
0809 15:30:44.554816 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:44.554821 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:44.555007 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:44.555175 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:30:44.555399 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.556316 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.558131 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.558792 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.559751 (+ 959us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:44.559922 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:44.559975 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 15:30:44.560109 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1260,"thread_start_us":136,"threads_started":1}
I20260809 15:30:44.562592 13543 tablet_service.cc:1467] Processing CreateTablet for tablet ca3824523f9b4175ab1fcc70e4bee926 (DEFAULT_TABLE table=test-table [id=04ef4c2ce1e547c2bfcbeb1c5f2e63ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:30:44.562551 13227 tablet_service.cc:1467] Processing CreateTablet for tablet ca3824523f9b4175ab1fcc70e4bee926 (DEFAULT_TABLE table=test-table [id=04ef4c2ce1e547c2bfcbeb1c5f2e63ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:30:44.563457 13227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca3824523f9b4175ab1fcc70e4bee926. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:30:44.563469 13543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca3824523f9b4175ab1fcc70e4bee926. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:30:44.567067 13386 tablet_service.cc:1467] Processing CreateTablet for tablet ca3824523f9b4175ab1fcc70e4bee926 (DEFAULT_TABLE table=test-table [id=04ef4c2ce1e547c2bfcbeb1c5f2e63ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:30:44.568055 13386 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca3824523f9b4175ab1fcc70e4bee926. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:30:44.570894 13640 tablet_bootstrap.cc:492] T ca3824523f9b4175ab1fcc70e4bee926 P 24b485058dad4e0abdacbdf8ae4349bd: Bootstrap starting.
I20260809 15:30:44.571245 13639 tablet_bootstrap.cc:492] T ca3824523f9b4175ab1fcc70e4bee926 P fb87091e44164cb0ad48f3ca5858ee82: Bootstrap starting.
I20260809 15:30:44.573043 13639 tablet_bootstrap.cc:654] T ca3824523f9b4175ab1fcc70e4bee926 P fb87091e44164cb0ad48f3ca5858ee82: Neither blocks nor log segments found. Creating new log.
I20260809 15:30:44.573168 13640 tablet_bootstrap.cc:654] T ca3824523f9b4175ab1fcc70e4bee926 P 24b485058dad4e0abdacbdf8ae4349bd: Neither blocks nor log segments found. Creating new log.
I20260809 15:30:44.573803 13639 log.cc:824] T ca3824523f9b4175ab1fcc70e4bee926 P fb87091e44164cb0ad48f3ca5858ee82: Log is configured to *not* fsync() on all Append() calls
I20260809 15:30:44.573979 13640 log.cc:824] T ca3824523f9b4175ab1fcc70e4bee926 P 24b485058dad4e0abdacbdf8ae4349bd: Log is configured to *not* fsync() on all Append() calls
I20260809 15:30:44.575944 13639 tablet_bootstrap.cc:492] T ca3824523f9b4175ab1fcc70e4bee926 P fb87091e44164cb0ad48f3ca5858ee82: No bootstrap required, opened a new log
I20260809 15:30:44.575963 13640 tablet_bootstrap.cc:492] T ca3824523f9b4175ab1fcc70e4bee926 P 24b485058dad4e0abdacbdf8ae4349bd: No bootstrap required, opened a new log
I20260809 15:30:44.576171 13640 ts_tablet_manager.cc:1397] T ca3824523f9b4175ab1fcc70e4bee926 P 24b485058dad4e0abdacbdf8ae4349bd: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260809 15:30:44.576171 13639 ts_tablet_manager.cc:1397] T ca3824523f9b4175ab1fcc70e4bee926 P fb87091e44164cb0ad48f3ca5858ee82: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260809 15:30:44.576398 13643 tablet_bootstrap.cc:492] T ca3824523f9b4175ab1fcc70e4bee926 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: Bootstrap starting.
I20260809 15:30:44.578624 13643 tablet_bootstrap.cc:654] T ca3824523f9b4175ab1fcc70e4bee926 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: Neither blocks nor log segments found. Creating new log.
I20260809 15:30:44.579035 13639 raft_consensus.cc:348] T ca3824523f9b4175ab1fcc70e4bee926 P fb87091e44164cb0ad48f3ca5858ee82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } } peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } }
I20260809 15:30:44.579262 13639 raft_consensus.cc:374] T ca3824523f9b4175ab1fcc70e4bee926 P fb87091e44164cb0ad48f3ca5858ee82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:30:44.579326 13639 raft_consensus.cc:729] T ca3824523f9b4175ab1fcc70e4bee926 P fb87091e44164cb0ad48f3ca5858ee82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb87091e44164cb0ad48f3ca5858ee82, State: Initialized, Role: FOLLOWER
I20260809 15:30:44.579432 13643 log.cc:824] T ca3824523f9b4175ab1fcc70e4bee926 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: Log is configured to *not* fsync() on all Append() calls
I20260809 15:30:44.579838 13639 consensus_queue.cc:260] T ca3824523f9b4175ab1fcc70e4bee926 P fb87091e44164cb0ad48f3ca5858ee82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } } peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } }
I20260809 15:30:44.580746 13639 ts_tablet_manager.cc:1428] T ca3824523f9b4175ab1fcc70e4bee926 P fb87091e44164cb0ad48f3ca5858ee82: Time spent starting tablet: real 0.004s user 0.003s sys 0.001s
I20260809 15:30:44.580807 13640 raft_consensus.cc:348] T ca3824523f9b4175ab1fcc70e4bee926 P 24b485058dad4e0abdacbdf8ae4349bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } } peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } }
I20260809 15:30:44.581064 13640 raft_consensus.cc:374] T ca3824523f9b4175ab1fcc70e4bee926 P 24b485058dad4e0abdacbdf8ae4349bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:30:44.581125 13640 raft_consensus.cc:729] T ca3824523f9b4175ab1fcc70e4bee926 P 24b485058dad4e0abdacbdf8ae4349bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24b485058dad4e0abdacbdf8ae4349bd, State: Initialized, Role: FOLLOWER
I20260809 15:30:44.581113 13614 heartbeater.cc:503] Master 127.11.146.62:42045 was elected leader, sending a full tablet report...
I20260809 15:30:44.581528 13643 tablet_bootstrap.cc:492] T ca3824523f9b4175ab1fcc70e4bee926 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: No bootstrap required, opened a new log
I20260809 15:30:44.581519 13640 consensus_queue.cc:260] T ca3824523f9b4175ab1fcc70e4bee926 P 24b485058dad4e0abdacbdf8ae4349bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } } peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } }
I20260809 15:30:44.581708 13643 ts_tablet_manager.cc:1397] T ca3824523f9b4175ab1fcc70e4bee926 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 15:30:44.582396 13640 ts_tablet_manager.cc:1428] T ca3824523f9b4175ab1fcc70e4bee926 P 24b485058dad4e0abdacbdf8ae4349bd: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 15:30:44.584304 13303 heartbeater.cc:503] Master 127.11.146.62:42045 was elected leader, sending a full tablet report...
I20260809 15:30:44.584915 13643 raft_consensus.cc:348] T ca3824523f9b4175ab1fcc70e4bee926 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } } peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } }
I20260809 15:30:44.585188 13643 raft_consensus.cc:374] T ca3824523f9b4175ab1fcc70e4bee926 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:30:44.585242 13643 raft_consensus.cc:729] T ca3824523f9b4175ab1fcc70e4bee926 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a32a7ecc6a5f4bb2a0dc3392a9e6d863, State: Initialized, Role: FOLLOWER
I20260809 15:30:44.585650 13643 consensus_queue.cc:260] T ca3824523f9b4175ab1fcc70e4bee926 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } } peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } }
I20260809 15:30:44.586282 13458 heartbeater.cc:503] Master 127.11.146.62:42045 was elected leader, sending a full tablet report...
I20260809 15:30:44.586578 13643 ts_tablet_manager.cc:1428] T ca3824523f9b4175ab1fcc70e4bee926 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
W20260809 15:30:44.733827 13459 tablet.cc:2369] T ca3824523f9b4175ab1fcc70e4bee926 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:30:44.735375 13645 raft_consensus.cc:482] T ca3824523f9b4175ab1fcc70e4bee926 P fb87091e44164cb0ad48f3ca5858ee82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:30:44.735643 13645 raft_consensus.cc:504] T ca3824523f9b4175ab1fcc70e4bee926 P fb87091e44164cb0ad48f3ca5858ee82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } } peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } }
I20260809 15:30:44.736977 13645 leader_election.cc:288] T ca3824523f9b4175ab1fcc70e4bee926 P fb87091e44164cb0ad48f3ca5858ee82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24b485058dad4e0abdacbdf8ae4349bd (127.11.146.1:40303), a32a7ecc6a5f4bb2a0dc3392a9e6d863 (127.11.146.2:38187)
I20260809 15:30:44.741104 13494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:44.737248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:38187 (local address 127.11.146.3:60183)
0809 15:30:44.737403 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:44.737420 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:44.737536 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:44.737825 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:44.737828 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:44.737849 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:30:44.737997 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:44.738005 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.738891 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.738894 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:44.739775 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:44.739785 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.740692 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.740696 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:44.740796 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:44.740822 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 15:30:44.740902 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 15:30:44.740974 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 15:30:44.741106 13637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:44.737356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:60183 (local address 127.11.146.2:38187)
0809 15:30:44.737498 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:44.737502 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:44.737518 (+ 16us) server_negotiation.cc:407] Connection header received
0809 15:30:44.737667 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:44.737670 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:44.737714 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:44.737811 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:30:44.738137 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.738784 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.739911 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.740567 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.740685 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:44.740736 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:44.740923 (+ 187us) server_negotiation.cc:299] Negotiation successful
0809 15:30:44.741004 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 15:30:44.741791 13409 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca3824523f9b4175ab1fcc70e4bee926" candidate_uuid: "fb87091e44164cb0ad48f3ca5858ee82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" is_pre_election: true
I20260809 15:30:44.742115 13409 raft_consensus.cc:2454] T ca3824523f9b4175ab1fcc70e4bee926 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb87091e44164cb0ad48f3ca5858ee82 in term 0.
I20260809 15:30:44.742198 13648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:44.737251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:40303 (local address 127.11.146.3:48417)
0809 15:30:44.737900 (+ 649us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:44.737911 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:44.738001 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:44.738227 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:44.738230 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:44.738247 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:30:44.738366 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:44.738372 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.739152 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.739155 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:44.740838 (+ 1683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:44.740872 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.741748 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.741751 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:44.741855 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:44.741880 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 15:30:44.741971 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 15:30:44.742040 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":582,"mutex_wait_us":279,"thread_start_us":164,"threads_started":1}
I20260809 15:30:44.742184 13638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:44.737370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:48417 (local address 127.11.146.1:40303)
0809 15:30:44.737509 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:44.737515 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:44.738001 (+ 486us) server_negotiation.cc:407] Connection header received
0809 15:30:44.738067 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:44.738072 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:44.738134 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:44.738191 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:30:44.738480 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.739040 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.741014 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.741612 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.741720 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:44.741756 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:44.741994 (+ 238us) server_negotiation.cc:299] Negotiation successful
0809 15:30:44.742071 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 15:30:44.742635 13488 leader_election.cc:302] T ca3824523f9b4175ab1fcc70e4bee926 P fb87091e44164cb0ad48f3ca5858ee82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a32a7ecc6a5f4bb2a0dc3392a9e6d863, fb87091e44164cb0ad48f3ca5858ee82; no voters:
I20260809 15:30:44.742928 13645 raft_consensus.cc:2781] T ca3824523f9b4175ab1fcc70e4bee926 P fb87091e44164cb0ad48f3ca5858ee82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:30:44.743017 13645 raft_consensus.cc:482] T ca3824523f9b4175ab1fcc70e4bee926 P fb87091e44164cb0ad48f3ca5858ee82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:30:44.743049 13645 raft_consensus.cc:3037] T ca3824523f9b4175ab1fcc70e4bee926 P fb87091e44164cb0ad48f3ca5858ee82 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:30:44.743055 13249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca3824523f9b4175ab1fcc70e4bee926" candidate_uuid: "fb87091e44164cb0ad48f3ca5858ee82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24b485058dad4e0abdacbdf8ae4349bd" is_pre_election: true
I20260809 15:30:44.743327 13249 raft_consensus.cc:2454] T ca3824523f9b4175ab1fcc70e4bee926 P 24b485058dad4e0abdacbdf8ae4349bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb87091e44164cb0ad48f3ca5858ee82 in term 0.
I20260809 15:30:44.744457 13645 raft_consensus.cc:504] T ca3824523f9b4175ab1fcc70e4bee926 P fb87091e44164cb0ad48f3ca5858ee82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } } peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } }
I20260809 15:30:44.744831 13645 leader_election.cc:288] T ca3824523f9b4175ab1fcc70e4bee926 P fb87091e44164cb0ad48f3ca5858ee82 [CANDIDATE]: Term 1 election: Requested vote from peers 24b485058dad4e0abdacbdf8ae4349bd (127.11.146.1:40303), a32a7ecc6a5f4bb2a0dc3392a9e6d863 (127.11.146.2:38187)
I20260809 15:30:44.745167 13249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca3824523f9b4175ab1fcc70e4bee926" candidate_uuid: "fb87091e44164cb0ad48f3ca5858ee82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24b485058dad4e0abdacbdf8ae4349bd"
I20260809 15:30:44.745203 13409 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca3824523f9b4175ab1fcc70e4bee926" candidate_uuid: "fb87091e44164cb0ad48f3ca5858ee82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863"
I20260809 15:30:44.745288 13249 raft_consensus.cc:3037] T ca3824523f9b4175ab1fcc70e4bee926 P 24b485058dad4e0abdacbdf8ae4349bd [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:30:44.745324 13409 raft_consensus.cc:3037] T ca3824523f9b4175ab1fcc70e4bee926 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:30:44.746330 13409 raft_consensus.cc:2454] T ca3824523f9b4175ab1fcc70e4bee926 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb87091e44164cb0ad48f3ca5858ee82 in term 1.
I20260809 15:30:44.746356 13249 raft_consensus.cc:2454] T ca3824523f9b4175ab1fcc70e4bee926 P 24b485058dad4e0abdacbdf8ae4349bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb87091e44164cb0ad48f3ca5858ee82 in term 1.
I20260809 15:30:44.746629 13488 leader_election.cc:302] T ca3824523f9b4175ab1fcc70e4bee926 P fb87091e44164cb0ad48f3ca5858ee82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a32a7ecc6a5f4bb2a0dc3392a9e6d863, fb87091e44164cb0ad48f3ca5858ee82; no voters:
I20260809 15:30:44.746840 13645 raft_consensus.cc:2781] T ca3824523f9b4175ab1fcc70e4bee926 P fb87091e44164cb0ad48f3ca5858ee82 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:30:44.747021 13645 raft_consensus.cc:686] T ca3824523f9b4175ab1fcc70e4bee926 P fb87091e44164cb0ad48f3ca5858ee82 [term 1 LEADER]: Becoming Leader. State: Replica: fb87091e44164cb0ad48f3ca5858ee82, State: Running, Role: LEADER
I20260809 15:30:44.747365 13645 consensus_queue.cc:237] T ca3824523f9b4175ab1fcc70e4bee926 P fb87091e44164cb0ad48f3ca5858ee82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } } peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } }
W20260809 15:30:44.749125 13616 tablet.cc:2369] T ca3824523f9b4175ab1fcc70e4bee926 P fb87091e44164cb0ad48f3ca5858ee82: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:30:44.751029 13079 catalog_manager.cc:5495] T ca3824523f9b4175ab1fcc70e4bee926 P fb87091e44164cb0ad48f3ca5858ee82 reported cstate change: term changed from 0 to 1, leader changed from <none> to fb87091e44164cb0ad48f3ca5858ee82 (127.11.146.3). New cstate: current_term: 1 leader_uuid: "fb87091e44164cb0ad48f3ca5858ee82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } health_report { overall_health: UNKNOWN } } }
W20260809 15:30:44.753162 13304 tablet.cc:2369] T ca3824523f9b4175ab1fcc70e4bee926 P 24b485058dad4e0abdacbdf8ae4349bd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:30:44.804025 13634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:44.800020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47134 (local address 127.11.146.3:37549)
0809 15:30:44.800197 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:44.800201 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:44.800218 (+ 17us) server_negotiation.cc:407] Connection header received
0809 15:30:44.800396 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:44.800398 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:44.800457 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:44.800545 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:30:44.800847 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.801357 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.802361 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.802572 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.802709 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:44.803083 (+ 374us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:30:44.803556 (+ 473us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:30:44.803694 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:44.803799 (+ 105us) server_negotiation.cc:299] Negotiation successful
0809 15:30:44.803861 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 15:30:44.810688 13409 raft_consensus.cc:1261] T ca3824523f9b4175ab1fcc70e4bee926 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [term 1 FOLLOWER]: Refusing update from remote peer fb87091e44164cb0ad48f3ca5858ee82: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:30:44.811633 13649 consensus_queue.cc:1035] T ca3824523f9b4175ab1fcc70e4bee926 P fb87091e44164cb0ad48f3ca5858ee82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:30:44.812932 13249 raft_consensus.cc:1261] T ca3824523f9b4175ab1fcc70e4bee926 P 24b485058dad4e0abdacbdf8ae4349bd [term 1 FOLLOWER]: Refusing update from remote peer fb87091e44164cb0ad48f3ca5858ee82: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:30:44.813661 13649 consensus_queue.cc:1035] T ca3824523f9b4175ab1fcc70e4bee926 P fb87091e44164cb0ad48f3ca5858ee82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:30:44.820248 13653 mvcc.cc:205] Tried to move back new op lower bound from 7316641565935497216 to 7316641565688688640. Current Snapshot: MvccSnapshot[applied={T|T < 7316641565935497216}]
I20260809 15:30:44.822387 13652 mvcc.cc:205] Tried to move back new op lower bound from 7316641565935497216 to 7316641565688688640. Current Snapshot: MvccSnapshot[applied={T|T < 7316641565935497216}]
I20260809 15:30:44.835896 13078 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:30:44.836247 13078 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:30:44.839212 13078 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 112bd3dca4fb4e65ba236f3be1e67e1b: Sending DeleteTablet for 3 replicas of tablet ca3824523f9b4175ab1fcc70e4bee926
I20260809 15:30:44.840216 13386 tablet_service.cc:1514] Processing DeleteTablet for tablet ca3824523f9b4175ab1fcc70e4bee926 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:30:44 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:34478
I20260809 15:30:44.840301 13227 tablet_service.cc:1514] Processing DeleteTablet for tablet ca3824523f9b4175ab1fcc70e4bee926 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:30:44 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:43116
I20260809 15:30:44.840411 13543 tablet_service.cc:1514] Processing DeleteTablet for tablet ca3824523f9b4175ab1fcc70e4bee926 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:30:44 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:47124
I20260809 15:30:44.840893 13663 tablet_replica.cc:330] T ca3824523f9b4175ab1fcc70e4bee926 P fb87091e44164cb0ad48f3ca5858ee82: stopping tablet replica
I20260809 15:30:44.841008 13662 tablet_replica.cc:330] T ca3824523f9b4175ab1fcc70e4bee926 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: stopping tablet replica
I20260809 15:30:44.841229 13663 raft_consensus.cc:2229] T ca3824523f9b4175ab1fcc70e4bee926 P fb87091e44164cb0ad48f3ca5858ee82 [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:30:44.841339 13662 raft_consensus.cc:2229] T ca3824523f9b4175ab1fcc70e4bee926 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:30:44.841511 13078 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42926:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 15:30:44.841703 13663 raft_consensus.cc:2258] T ca3824523f9b4175ab1fcc70e4bee926 P fb87091e44164cb0ad48f3ca5858ee82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:30:44.841713 13662 raft_consensus.cc:2258] T ca3824523f9b4175ab1fcc70e4bee926 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260809 15:30:44.841930 13078 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:30:44.842113 13664 tablet_replica.cc:330] T ca3824523f9b4175ab1fcc70e4bee926 P 24b485058dad4e0abdacbdf8ae4349bd: stopping tablet replica
I20260809 15:30:44.842401 13664 raft_consensus.cc:2229] T ca3824523f9b4175ab1fcc70e4bee926 P 24b485058dad4e0abdacbdf8ae4349bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:30:44.842684 13664 raft_consensus.cc:2258] T ca3824523f9b4175ab1fcc70e4bee926 P 24b485058dad4e0abdacbdf8ae4349bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:30:44.844465 13662 ts_tablet_manager.cc:1905] T ca3824523f9b4175ab1fcc70e4bee926 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:30:44.844465 13663 ts_tablet_manager.cc:1905] T ca3824523f9b4175ab1fcc70e4bee926 P fb87091e44164cb0ad48f3ca5858ee82: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:30:44.847317 13662 ts_tablet_manager.cc:1918] T ca3824523f9b4175ab1fcc70e4bee926 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:30:44.847429 13662 log.cc:1196] T ca3824523f9b4175ab1fcc70e4bee926 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-1/wal/wals/ca3824523f9b4175ab1fcc70e4bee926
I20260809 15:30:44.847734 13663 ts_tablet_manager.cc:1918] T ca3824523f9b4175ab1fcc70e4bee926 P fb87091e44164cb0ad48f3ca5858ee82: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:30:44.847949 13663 log.cc:1196] T ca3824523f9b4175ab1fcc70e4bee926 P fb87091e44164cb0ad48f3ca5858ee82: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-2/wal/wals/ca3824523f9b4175ab1fcc70e4bee926
I20260809 15:30:44.847975 13662 ts_tablet_manager.cc:1939] T ca3824523f9b4175ab1fcc70e4bee926 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: Deleting consensus metadata
I20260809 15:30:44.847980 13386 tablet_service.cc:1467] Processing CreateTablet for tablet 25598a5ba943428f89b886ce60bfa705 (DEFAULT_TABLE table=test-table [id=0ad3065630ee4e31a8e3b94505ebe95e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:30:44.848307 13386 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25598a5ba943428f89b886ce60bfa705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:30:44.848563 13663 ts_tablet_manager.cc:1939] T ca3824523f9b4175ab1fcc70e4bee926 P fb87091e44164cb0ad48f3ca5858ee82: Deleting consensus metadata
I20260809 15:30:44.848636 13227 tablet_service.cc:1467] Processing CreateTablet for tablet 25598a5ba943428f89b886ce60bfa705 (DEFAULT_TABLE table=test-table [id=0ad3065630ee4e31a8e3b94505ebe95e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:30:44.848932 13227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25598a5ba943428f89b886ce60bfa705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:30:44.849368 13064 catalog_manager.cc:4841] TS a32a7ecc6a5f4bb2a0dc3392a9e6d863 (127.11.146.2:38187): tablet ca3824523f9b4175ab1fcc70e4bee926 (table test-table [id=04ef4c2ce1e547c2bfcbeb1c5f2e63ec]) successfully deleted
I20260809 15:30:44.850617 13643 tablet_bootstrap.cc:492] T 25598a5ba943428f89b886ce60bfa705 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: Bootstrap starting.
I20260809 15:30:44.850699 13664 ts_tablet_manager.cc:1905] T ca3824523f9b4175ab1fcc70e4bee926 P 24b485058dad4e0abdacbdf8ae4349bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:30:44.851611 13643 tablet_bootstrap.cc:654] T 25598a5ba943428f89b886ce60bfa705 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: Neither blocks nor log segments found. Creating new log.
I20260809 15:30:44.851648 13543 tablet_service.cc:1467] Processing CreateTablet for tablet 25598a5ba943428f89b886ce60bfa705 (DEFAULT_TABLE table=test-table [id=0ad3065630ee4e31a8e3b94505ebe95e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:30:44.851905 13543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25598a5ba943428f89b886ce60bfa705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:30:44.853317 13664 ts_tablet_manager.cc:1918] T ca3824523f9b4175ab1fcc70e4bee926 P 24b485058dad4e0abdacbdf8ae4349bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:30:44.853412 13664 log.cc:1196] T ca3824523f9b4175ab1fcc70e4bee926 P 24b485058dad4e0abdacbdf8ae4349bd: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-0/wal/wals/ca3824523f9b4175ab1fcc70e4bee926
I20260809 15:30:44.853714 13664 ts_tablet_manager.cc:1939] T ca3824523f9b4175ab1fcc70e4bee926 P 24b485058dad4e0abdacbdf8ae4349bd: Deleting consensus metadata
I20260809 15:30:44.854187 13639 tablet_bootstrap.cc:492] T 25598a5ba943428f89b886ce60bfa705 P fb87091e44164cb0ad48f3ca5858ee82: Bootstrap starting.
I20260809 15:30:44.854292 13640 tablet_bootstrap.cc:492] T 25598a5ba943428f89b886ce60bfa705 P 24b485058dad4e0abdacbdf8ae4349bd: Bootstrap starting.
I20260809 15:30:44.855175 13640 tablet_bootstrap.cc:654] T 25598a5ba943428f89b886ce60bfa705 P 24b485058dad4e0abdacbdf8ae4349bd: Neither blocks nor log segments found. Creating new log.
I20260809 15:30:44.855175 13639 tablet_bootstrap.cc:654] T 25598a5ba943428f89b886ce60bfa705 P fb87091e44164cb0ad48f3ca5858ee82: Neither blocks nor log segments found. Creating new log.
I20260809 15:30:44.855149 13062 catalog_manager.cc:4841] TS 24b485058dad4e0abdacbdf8ae4349bd (127.11.146.1:40303): tablet ca3824523f9b4175ab1fcc70e4bee926 (table test-table [id=04ef4c2ce1e547c2bfcbeb1c5f2e63ec]) successfully deleted
I20260809 15:30:44.855286 13062 catalog_manager.cc:4841] TS fb87091e44164cb0ad48f3ca5858ee82 (127.11.146.3:37549): tablet ca3824523f9b4175ab1fcc70e4bee926 (table test-table [id=04ef4c2ce1e547c2bfcbeb1c5f2e63ec]) successfully deleted
I20260809 15:30:44.856479 13640 tablet_bootstrap.cc:492] T 25598a5ba943428f89b886ce60bfa705 P 24b485058dad4e0abdacbdf8ae4349bd: No bootstrap required, opened a new log
I20260809 15:30:44.856571 13640 ts_tablet_manager.cc:1397] T 25598a5ba943428f89b886ce60bfa705 P 24b485058dad4e0abdacbdf8ae4349bd: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 15:30:44.856738 13643 tablet_bootstrap.cc:492] T 25598a5ba943428f89b886ce60bfa705 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: No bootstrap required, opened a new log
I20260809 15:30:44.856818 13643 ts_tablet_manager.cc:1397] T 25598a5ba943428f89b886ce60bfa705 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260809 15:30:44.857263 13643 raft_consensus.cc:348] T 25598a5ba943428f89b886ce60bfa705 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } } peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } }
I20260809 15:30:44.857386 13643 raft_consensus.cc:374] T 25598a5ba943428f89b886ce60bfa705 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:30:44.857424 13643 raft_consensus.cc:729] T 25598a5ba943428f89b886ce60bfa705 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a32a7ecc6a5f4bb2a0dc3392a9e6d863, State: Initialized, Role: FOLLOWER
I20260809 15:30:44.857491 13640 raft_consensus.cc:348] T 25598a5ba943428f89b886ce60bfa705 P 24b485058dad4e0abdacbdf8ae4349bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } } peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } }
I20260809 15:30:44.857540 13643 consensus_queue.cc:260] T 25598a5ba943428f89b886ce60bfa705 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } } peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } }
I20260809 15:30:44.857604 13640 raft_consensus.cc:374] T 25598a5ba943428f89b886ce60bfa705 P 24b485058dad4e0abdacbdf8ae4349bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:30:44.857645 13640 raft_consensus.cc:729] T 25598a5ba943428f89b886ce60bfa705 P 24b485058dad4e0abdacbdf8ae4349bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24b485058dad4e0abdacbdf8ae4349bd, State: Initialized, Role: FOLLOWER
I20260809 15:30:44.857793 13643 ts_tablet_manager.cc:1428] T 25598a5ba943428f89b886ce60bfa705 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 15:30:44.857766 13640 consensus_queue.cc:260] T 25598a5ba943428f89b886ce60bfa705 P 24b485058dad4e0abdacbdf8ae4349bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } } peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } }
I20260809 15:30:44.857888 13639 tablet_bootstrap.cc:492] T 25598a5ba943428f89b886ce60bfa705 P fb87091e44164cb0ad48f3ca5858ee82: No bootstrap required, opened a new log
I20260809 15:30:44.857973 13639 ts_tablet_manager.cc:1397] T 25598a5ba943428f89b886ce60bfa705 P fb87091e44164cb0ad48f3ca5858ee82: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260809 15:30:44.858021 13640 ts_tablet_manager.cc:1428] T 25598a5ba943428f89b886ce60bfa705 P 24b485058dad4e0abdacbdf8ae4349bd: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260809 15:30:44.858453 13639 raft_consensus.cc:348] T 25598a5ba943428f89b886ce60bfa705 P fb87091e44164cb0ad48f3ca5858ee82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } } peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } }
I20260809 15:30:44.858609 13639 raft_consensus.cc:374] T 25598a5ba943428f89b886ce60bfa705 P fb87091e44164cb0ad48f3ca5858ee82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:30:44.858649 13639 raft_consensus.cc:729] T 25598a5ba943428f89b886ce60bfa705 P fb87091e44164cb0ad48f3ca5858ee82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb87091e44164cb0ad48f3ca5858ee82, State: Initialized, Role: FOLLOWER
I20260809 15:30:44.858767 13639 consensus_queue.cc:260] T 25598a5ba943428f89b886ce60bfa705 P fb87091e44164cb0ad48f3ca5858ee82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } } peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } }
I20260809 15:30:44.859037 13639 ts_tablet_manager.cc:1428] T 25598a5ba943428f89b886ce60bfa705 P fb87091e44164cb0ad48f3ca5858ee82: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 15:30:44.887473 13647 raft_consensus.cc:482] T 25598a5ba943428f89b886ce60bfa705 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:30:44.887709 13647 raft_consensus.cc:504] T 25598a5ba943428f89b886ce60bfa705 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } } peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } }
I20260809 15:30:44.889082 13647 leader_election.cc:288] T 25598a5ba943428f89b886ce60bfa705 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24b485058dad4e0abdacbdf8ae4349bd (127.11.146.1:40303), fb87091e44164cb0ad48f3ca5858ee82 (127.11.146.3:37549)
I20260809 15:30:44.893760 13669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:44.889321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:40303 (local address 127.11.146.2:56987)
0809 15:30:44.889728 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:44.889742 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:44.889916 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:44.890354 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:44.890356 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:44.890371 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:30:44.890477 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:44.890482 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.891500 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.891503 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:44.892583 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:44.892594 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.893287 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.893291 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:44.893398 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:44.893424 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 15:30:44.893508 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 15:30:44.893583 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"mutex_wait_us":26,"thread_start_us":107,"threads_started":1}
I20260809 15:30:44.893786 13638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:44.889405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:56987 (local address 127.11.146.1:40303)
0809 15:30:44.889569 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:44.889575 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:44.889830 (+ 255us) server_negotiation.cc:407] Connection header received
0809 15:30:44.890081 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:44.890085 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:44.890138 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:44.890190 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:30:44.890651 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.891359 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.892710 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.893141 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.893284 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:44.893342 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:44.893553 (+ 211us) server_negotiation.cc:299] Negotiation successful
0809 15:30:44.893648 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 15:30:44.894392 13249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25598a5ba943428f89b886ce60bfa705" candidate_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24b485058dad4e0abdacbdf8ae4349bd" is_pre_election: true
I20260809 15:30:44.894583 13249 raft_consensus.cc:2454] T 25598a5ba943428f89b886ce60bfa705 P 24b485058dad4e0abdacbdf8ae4349bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a32a7ecc6a5f4bb2a0dc3392a9e6d863 in term 0.
I20260809 15:30:44.894708 13634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:44.890137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:58251 (local address 127.11.146.3:37549)
0809 15:30:44.890262 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:44.890267 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:44.890537 (+ 270us) server_negotiation.cc:407] Connection header received
0809 15:30:44.890662 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:44.890666 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:44.890716 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:44.890792 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:30:44.891089 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.891783 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.893438 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.894067 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.894176 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:44.894226 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:44.894519 (+ 293us) server_negotiation.cc:299] Negotiation successful
0809 15:30:44.894596 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 15:30:44.894697 13670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:44.889736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:37549 (local address 127.11.146.2:58251)
0809 15:30:44.890426 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:44.890443 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:44.890561 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:44.890822 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:44.890825 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:44.890841 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:30:44.890973 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:44.890979 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.891926 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.891932 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:44.893312 (+ 1380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:44.893325 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.894253 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.894257 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:44.894367 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:44.894393 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 15:30:44.894479 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 15:30:44.894549 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":617,"mutex_wait_us":8,"thread_start_us":100,"threads_started":1}
I20260809 15:30:44.895351 13565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25598a5ba943428f89b886ce60bfa705" candidate_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb87091e44164cb0ad48f3ca5858ee82" is_pre_election: true
I20260809 15:30:44.895339 13331 leader_election.cc:302] T 25598a5ba943428f89b886ce60bfa705 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24b485058dad4e0abdacbdf8ae4349bd, a32a7ecc6a5f4bb2a0dc3392a9e6d863; no voters:
I20260809 15:30:44.895599 13565 raft_consensus.cc:2454] T 25598a5ba943428f89b886ce60bfa705 P fb87091e44164cb0ad48f3ca5858ee82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a32a7ecc6a5f4bb2a0dc3392a9e6d863 in term 0.
I20260809 15:30:44.895669 13647 raft_consensus.cc:2781] T 25598a5ba943428f89b886ce60bfa705 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:30:44.895731 13647 raft_consensus.cc:482] T 25598a5ba943428f89b886ce60bfa705 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:30:44.895835 13647 raft_consensus.cc:3037] T 25598a5ba943428f89b886ce60bfa705 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:30:44.897208 13647 raft_consensus.cc:504] T 25598a5ba943428f89b886ce60bfa705 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } } peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } }
I20260809 15:30:44.897595 13647 leader_election.cc:288] T 25598a5ba943428f89b886ce60bfa705 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [CANDIDATE]: Term 1 election: Requested vote from peers 24b485058dad4e0abdacbdf8ae4349bd (127.11.146.1:40303), fb87091e44164cb0ad48f3ca5858ee82 (127.11.146.3:37549)
I20260809 15:30:44.898056 13249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25598a5ba943428f89b886ce60bfa705" candidate_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24b485058dad4e0abdacbdf8ae4349bd"
I20260809 15:30:44.898195 13249 raft_consensus.cc:3037] T 25598a5ba943428f89b886ce60bfa705 P 24b485058dad4e0abdacbdf8ae4349bd [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:30:44.899240 13249 raft_consensus.cc:2454] T 25598a5ba943428f89b886ce60bfa705 P 24b485058dad4e0abdacbdf8ae4349bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a32a7ecc6a5f4bb2a0dc3392a9e6d863 in term 1.
I20260809 15:30:44.899535 13331 leader_election.cc:302] T 25598a5ba943428f89b886ce60bfa705 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24b485058dad4e0abdacbdf8ae4349bd, a32a7ecc6a5f4bb2a0dc3392a9e6d863; no voters:
I20260809 15:30:44.899533 13565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25598a5ba943428f89b886ce60bfa705" candidate_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb87091e44164cb0ad48f3ca5858ee82"
I20260809 15:30:44.899683 13565 raft_consensus.cc:3037] T 25598a5ba943428f89b886ce60bfa705 P fb87091e44164cb0ad48f3ca5858ee82 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:30:44.899750 13647 raft_consensus.cc:2781] T 25598a5ba943428f89b886ce60bfa705 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:30:44.899951 13647 raft_consensus.cc:686] T 25598a5ba943428f89b886ce60bfa705 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [term 1 LEADER]: Becoming Leader. State: Replica: a32a7ecc6a5f4bb2a0dc3392a9e6d863, State: Running, Role: LEADER
I20260809 15:30:44.900249 13647 consensus_queue.cc:237] T 25598a5ba943428f89b886ce60bfa705 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } } peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } }
I20260809 15:30:44.900867 13565 raft_consensus.cc:2454] T 25598a5ba943428f89b886ce60bfa705 P fb87091e44164cb0ad48f3ca5858ee82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a32a7ecc6a5f4bb2a0dc3392a9e6d863 in term 1.
I20260809 15:30:44.902529 13078 catalog_manager.cc:5495] T 25598a5ba943428f89b886ce60bfa705 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 reported cstate change: term changed from 0 to 1, leader changed from <none> to a32a7ecc6a5f4bb2a0dc3392a9e6d863 (127.11.146.2). New cstate: current_term: 1 leader_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } health_report { overall_health: UNKNOWN } } }
Aug 09 15:30:44 dist-test-slave-1jjb krb5kdc[13031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289443, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:30:44.939613 13681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:44.930059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:42045 (local address 127.0.0.1:42936)
0809 15:30:44.930450 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:44.930464 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:44.930604 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:44.930885 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:44.930887 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:44.931304 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:30:44.931405 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:44.931412 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.932234 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.932237 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:44.932787 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:44.932794 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.933260 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.933263 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:44.933344 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:44.933986 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:30:44.933998 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:30:44.935844 (+ 1846us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:30:44.937954 (+ 2110us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:44.937967 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:44.937974 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:44.938213 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:44.938501 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:44.938506 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:44.938508 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:44.938595 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:44.938991 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:30:44.938999 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:30:44.939114 (+ 115us) client_negotiation.cc:769] Sending connection context
0809 15:30:44.939238 (+ 124us) client_negotiation.cc:240] Negotiation successful
0809 15:30:44.939411 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":127,"threads_started":1}
I20260809 15:30:44.939612 13132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:44.930142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42936 (local address 127.11.146.62:42045)
0809 15:30:44.930290 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:44.930294 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:44.930540 (+ 246us) server_negotiation.cc:407] Connection header received
0809 15:30:44.930703 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:44.930707 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:44.930769 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:44.930864 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:44.931526 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.932119 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.932927 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:44.933147 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:44.933255 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:44.936060 (+ 2805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:44.936064 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:44.936065 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:44.936136 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:44.937825 (+ 1689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:44.938315 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:44.938320 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:44.938322 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:44.938403 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:44.938690 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:44.938693 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:44.938695 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:44.938877 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:44.938991 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:44.939286 (+ 295us) server_negotiation.cc:299] Negotiation successful
0809 15:30:44.939488 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":95,"server-negotiator.queue_time_us":62}
I20260809 15:30:44.944293 13078 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:42936:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 15:30:44.945070 13078 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:30:44.950297 13227 tablet_service.cc:1467] Processing CreateTablet for tablet 107d5c2e874b4876b43eeb2110300e29 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e302f7212e7b43349d8090414d38eb23]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 15:30:44.950399 13386 tablet_service.cc:1467] Processing CreateTablet for tablet 107d5c2e874b4876b43eeb2110300e29 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e302f7212e7b43349d8090414d38eb23]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 15:30:44.950750 13227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 107d5c2e874b4876b43eeb2110300e29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:30:44.950839 13386 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 107d5c2e874b4876b43eeb2110300e29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:30:44.953599 13640 tablet_bootstrap.cc:492] T 107d5c2e874b4876b43eeb2110300e29 P 24b485058dad4e0abdacbdf8ae4349bd: Bootstrap starting.
I20260809 15:30:44.954320 13643 tablet_bootstrap.cc:492] T 107d5c2e874b4876b43eeb2110300e29 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: Bootstrap starting.
I20260809 15:30:44.954262 13543 tablet_service.cc:1467] Processing CreateTablet for tablet 107d5c2e874b4876b43eeb2110300e29 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e302f7212e7b43349d8090414d38eb23]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 15:30:44.954643 13543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 107d5c2e874b4876b43eeb2110300e29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:30:44.954663 13640 tablet_bootstrap.cc:654] T 107d5c2e874b4876b43eeb2110300e29 P 24b485058dad4e0abdacbdf8ae4349bd: Neither blocks nor log segments found. Creating new log.
I20260809 15:30:44.955391 13643 tablet_bootstrap.cc:654] T 107d5c2e874b4876b43eeb2110300e29 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: Neither blocks nor log segments found. Creating new log.
I20260809 15:30:44.957815 13643 tablet_bootstrap.cc:492] T 107d5c2e874b4876b43eeb2110300e29 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: No bootstrap required, opened a new log
I20260809 15:30:44.957939 13643 ts_tablet_manager.cc:1397] T 107d5c2e874b4876b43eeb2110300e29 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260809 15:30:44.958606 13643 raft_consensus.cc:348] T 107d5c2e874b4876b43eeb2110300e29 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } } peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } }
I20260809 15:30:44.958756 13643 raft_consensus.cc:374] T 107d5c2e874b4876b43eeb2110300e29 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:30:44.958813 13643 raft_consensus.cc:729] T 107d5c2e874b4876b43eeb2110300e29 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a32a7ecc6a5f4bb2a0dc3392a9e6d863, State: Initialized, Role: FOLLOWER
I20260809 15:30:44.959024 13643 consensus_queue.cc:260] T 107d5c2e874b4876b43eeb2110300e29 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } } peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } }
I20260809 15:30:44.959419 13643 ts_tablet_manager.cc:1428] T 107d5c2e874b4876b43eeb2110300e29 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 15:30:44.959374 13647 tablet_replica.cc:439] T 107d5c2e874b4876b43eeb2110300e29 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } } peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } } }
I20260809 15:30:44.959528 13647 tablet_replica.cc:442] T 107d5c2e874b4876b43eeb2110300e29 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:30:44.959708 13639 tablet_bootstrap.cc:492] T 107d5c2e874b4876b43eeb2110300e29 P fb87091e44164cb0ad48f3ca5858ee82: Bootstrap starting.
I20260809 15:30:44.960772 13640 tablet_bootstrap.cc:492] T 107d5c2e874b4876b43eeb2110300e29 P 24b485058dad4e0abdacbdf8ae4349bd: No bootstrap required, opened a new log
I20260809 15:30:44.960870 13640 ts_tablet_manager.cc:1397] T 107d5c2e874b4876b43eeb2110300e29 P 24b485058dad4e0abdacbdf8ae4349bd: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260809 15:30:44.961066 13639 tablet_bootstrap.cc:654] T 107d5c2e874b4876b43eeb2110300e29 P fb87091e44164cb0ad48f3ca5858ee82: Neither blocks nor log segments found. Creating new log.
I20260809 15:30:44.961376 13640 raft_consensus.cc:348] T 107d5c2e874b4876b43eeb2110300e29 P 24b485058dad4e0abdacbdf8ae4349bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } } peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } }
I20260809 15:30:44.961503 13640 raft_consensus.cc:374] T 107d5c2e874b4876b43eeb2110300e29 P 24b485058dad4e0abdacbdf8ae4349bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:30:44.961535 13640 raft_consensus.cc:729] T 107d5c2e874b4876b43eeb2110300e29 P 24b485058dad4e0abdacbdf8ae4349bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24b485058dad4e0abdacbdf8ae4349bd, State: Initialized, Role: FOLLOWER
I20260809 15:30:44.961969 13640 consensus_queue.cc:260] T 107d5c2e874b4876b43eeb2110300e29 P 24b485058dad4e0abdacbdf8ae4349bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } } peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } }
I20260809 15:30:44.962354 13646 tablet_replica.cc:439] T 107d5c2e874b4876b43eeb2110300e29 P 24b485058dad4e0abdacbdf8ae4349bd: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } } peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } } }
I20260809 15:30:44.962497 13646 tablet_replica.cc:442] T 107d5c2e874b4876b43eeb2110300e29 P 24b485058dad4e0abdacbdf8ae4349bd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:30:44.962656 13639 tablet_bootstrap.cc:492] T 107d5c2e874b4876b43eeb2110300e29 P fb87091e44164cb0ad48f3ca5858ee82: No bootstrap required, opened a new log
I20260809 15:30:44.962754 13639 ts_tablet_manager.cc:1397] T 107d5c2e874b4876b43eeb2110300e29 P fb87091e44164cb0ad48f3ca5858ee82: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 15:30:44.963236 13640 ts_tablet_manager.cc:1428] T 107d5c2e874b4876b43eeb2110300e29 P 24b485058dad4e0abdacbdf8ae4349bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260809 15:30:44.963289 13639 raft_consensus.cc:348] T 107d5c2e874b4876b43eeb2110300e29 P fb87091e44164cb0ad48f3ca5858ee82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } } peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } }
I20260809 15:30:44.963447 13639 raft_consensus.cc:374] T 107d5c2e874b4876b43eeb2110300e29 P fb87091e44164cb0ad48f3ca5858ee82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:30:44.963502 13639 raft_consensus.cc:729] T 107d5c2e874b4876b43eeb2110300e29 P fb87091e44164cb0ad48f3ca5858ee82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb87091e44164cb0ad48f3ca5858ee82, State: Initialized, Role: FOLLOWER
I20260809 15:30:44.963672 13639 consensus_queue.cc:260] T 107d5c2e874b4876b43eeb2110300e29 P fb87091e44164cb0ad48f3ca5858ee82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } } peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } }
I20260809 15:30:44.964022 13639 ts_tablet_manager.cc:1428] T 107d5c2e874b4876b43eeb2110300e29 P fb87091e44164cb0ad48f3ca5858ee82: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260809 15:30:44.964316 13659 tablet_replica.cc:439] T 107d5c2e874b4876b43eeb2110300e29 P fb87091e44164cb0ad48f3ca5858ee82: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } } peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } } }
I20260809 15:30:44.964473 13659 tablet_replica.cc:442] T 107d5c2e874b4876b43eeb2110300e29 P fb87091e44164cb0ad48f3ca5858ee82: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:30:44.989347 13647 raft_consensus.cc:482] T 107d5c2e874b4876b43eeb2110300e29 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:30:44.989523 13647 raft_consensus.cc:504] T 107d5c2e874b4876b43eeb2110300e29 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } } peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } }
I20260809 15:30:44.989960 13647 leader_election.cc:288] T 107d5c2e874b4876b43eeb2110300e29 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24b485058dad4e0abdacbdf8ae4349bd (127.11.146.1:40303), fb87091e44164cb0ad48f3ca5858ee82 (127.11.146.3:37549)
I20260809 15:30:44.990482 13249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "107d5c2e874b4876b43eeb2110300e29" candidate_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24b485058dad4e0abdacbdf8ae4349bd" is_pre_election: true
I20260809 15:30:44.990540 13565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "107d5c2e874b4876b43eeb2110300e29" candidate_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb87091e44164cb0ad48f3ca5858ee82" is_pre_election: true
I20260809 15:30:44.990667 13565 raft_consensus.cc:2454] T 107d5c2e874b4876b43eeb2110300e29 P fb87091e44164cb0ad48f3ca5858ee82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a32a7ecc6a5f4bb2a0dc3392a9e6d863 in term 0.
I20260809 15:30:44.990659 13249 raft_consensus.cc:2454] T 107d5c2e874b4876b43eeb2110300e29 P 24b485058dad4e0abdacbdf8ae4349bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a32a7ecc6a5f4bb2a0dc3392a9e6d863 in term 0.
I20260809 15:30:44.991004 13331 leader_election.cc:302] T 107d5c2e874b4876b43eeb2110300e29 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24b485058dad4e0abdacbdf8ae4349bd, a32a7ecc6a5f4bb2a0dc3392a9e6d863; no voters:
I20260809 15:30:44.991181 13647 raft_consensus.cc:2781] T 107d5c2e874b4876b43eeb2110300e29 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:30:44.991242 13647 raft_consensus.cc:482] T 107d5c2e874b4876b43eeb2110300e29 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:30:44.991291 13647 raft_consensus.cc:3037] T 107d5c2e874b4876b43eeb2110300e29 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:30:44.992383 13647 raft_consensus.cc:504] T 107d5c2e874b4876b43eeb2110300e29 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } } peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } }
I20260809 15:30:44.992780 13647 leader_election.cc:288] T 107d5c2e874b4876b43eeb2110300e29 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [CANDIDATE]: Term 1 election: Requested vote from peers 24b485058dad4e0abdacbdf8ae4349bd (127.11.146.1:40303), fb87091e44164cb0ad48f3ca5858ee82 (127.11.146.3:37549)
I20260809 15:30:44.993196 13249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "107d5c2e874b4876b43eeb2110300e29" candidate_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24b485058dad4e0abdacbdf8ae4349bd"
I20260809 15:30:44.993244 13565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "107d5c2e874b4876b43eeb2110300e29" candidate_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb87091e44164cb0ad48f3ca5858ee82"
I20260809 15:30:44.993350 13249 raft_consensus.cc:3037] T 107d5c2e874b4876b43eeb2110300e29 P 24b485058dad4e0abdacbdf8ae4349bd [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:30:44.993412 13565 raft_consensus.cc:3037] T 107d5c2e874b4876b43eeb2110300e29 P fb87091e44164cb0ad48f3ca5858ee82 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:30:44.994316 13249 raft_consensus.cc:2454] T 107d5c2e874b4876b43eeb2110300e29 P 24b485058dad4e0abdacbdf8ae4349bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a32a7ecc6a5f4bb2a0dc3392a9e6d863 in term 1.
I20260809 15:30:44.994549 13565 raft_consensus.cc:2454] T 107d5c2e874b4876b43eeb2110300e29 P fb87091e44164cb0ad48f3ca5858ee82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a32a7ecc6a5f4bb2a0dc3392a9e6d863 in term 1.
I20260809 15:30:44.994670 13331 leader_election.cc:302] T 107d5c2e874b4876b43eeb2110300e29 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24b485058dad4e0abdacbdf8ae4349bd, a32a7ecc6a5f4bb2a0dc3392a9e6d863; no voters:
I20260809 15:30:44.995029 13647 raft_consensus.cc:2781] T 107d5c2e874b4876b43eeb2110300e29 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:30:44.995129 13647 raft_consensus.cc:686] T 107d5c2e874b4876b43eeb2110300e29 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [term 1 LEADER]: Becoming Leader. State: Replica: a32a7ecc6a5f4bb2a0dc3392a9e6d863, State: Running, Role: LEADER
I20260809 15:30:44.995271 13647 consensus_queue.cc:237] T 107d5c2e874b4876b43eeb2110300e29 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } } peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } }
I20260809 15:30:44.996104 13671 tablet_replica.cc:439] T 107d5c2e874b4876b43eeb2110300e29 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: TxnStatusTablet state changed. Reason: New leader a32a7ecc6a5f4bb2a0dc3392a9e6d863. Latest consensus state: current_term: 1 leader_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } } peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } } }
I20260809 15:30:44.996220 13671 tablet_replica.cc:442] T 107d5c2e874b4876b43eeb2110300e29 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: This TxnStatusTablet replica's current role is: LEADER
I20260809 15:30:44.997278 13687 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 15:30:44.997483 13687 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 15:30:44.997666 13078 catalog_manager.cc:5495] T 107d5c2e874b4876b43eeb2110300e29 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 reported cstate change: term changed from 0 to 1, leader changed from <none> to a32a7ecc6a5f4bb2a0dc3392a9e6d863 (127.11.146.2). New cstate: current_term: 1 leader_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } health_report { overall_health: UNKNOWN } } }
I20260809 15:30:45.020859 13681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:45.015178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:38187 (local address 127.0.0.1:34492)
0809 15:30:45.015570 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:45.015588 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:45.015698 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:45.016502 (+ 804us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:45.016505 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:45.016513 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 15:30:45.016623 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:45.016629 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:45.017681 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:45.017685 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:45.018676 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:45.018688 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:45.019355 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:45.019358 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:45.019486 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:45.019546 (+ 60us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 15:30:45.020516 (+ 970us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 15:30:45.020532 (+ 16us) client_negotiation.cc:769] Sending connection context
0809 15:30:45.020598 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 15:30:45.020703 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272}
I20260809 15:30:45.021377 13637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:45.015940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34492 (local address 127.11.146.2:38187)
0809 15:30:45.016109 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:45.016114 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:45.016128 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:30:45.016202 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:45.016205 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:45.016270 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:45.016360 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:30:45.016751 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:45.017547 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:45.018819 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:45.019170 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:45.019262 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:45.019733 (+ 471us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:30:45.020349 (+ 616us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:30:45.020469 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:45.021189 (+ 720us) server_negotiation.cc:299] Negotiation successful
0809 15:30:45.021251 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 15:30:45.024822 13249 raft_consensus.cc:1261] T 107d5c2e874b4876b43eeb2110300e29 P 24b485058dad4e0abdacbdf8ae4349bd [term 1 FOLLOWER]: Refusing update from remote peer a32a7ecc6a5f4bb2a0dc3392a9e6d863: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:30:45.024963 13565 raft_consensus.cc:1261] T 107d5c2e874b4876b43eeb2110300e29 P fb87091e44164cb0ad48f3ca5858ee82 [term 1 FOLLOWER]: Refusing update from remote peer a32a7ecc6a5f4bb2a0dc3392a9e6d863: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:30:45.025516 13647 consensus_queue.cc:1035] T 107d5c2e874b4876b43eeb2110300e29 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:30:45.025928 13671 consensus_queue.cc:1035] T 107d5c2e874b4876b43eeb2110300e29 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:30:45.027164 13646 tablet_replica.cc:439] T 107d5c2e874b4876b43eeb2110300e29 P 24b485058dad4e0abdacbdf8ae4349bd: TxnStatusTablet state changed. Reason: New leader a32a7ecc6a5f4bb2a0dc3392a9e6d863. Latest consensus state: current_term: 1 leader_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } } peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } } }
I20260809 15:30:45.027288 13646 tablet_replica.cc:442] T 107d5c2e874b4876b43eeb2110300e29 P 24b485058dad4e0abdacbdf8ae4349bd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:30:45.029342 13659 tablet_replica.cc:439] T 107d5c2e874b4876b43eeb2110300e29 P fb87091e44164cb0ad48f3ca5858ee82: TxnStatusTablet state changed. Reason: New leader a32a7ecc6a5f4bb2a0dc3392a9e6d863. Latest consensus state: current_term: 1 leader_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } } peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } } }
I20260809 15:30:45.029506 13659 tablet_replica.cc:442] T 107d5c2e874b4876b43eeb2110300e29 P fb87091e44164cb0ad48f3ca5858ee82: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:30:45.030889 13647 tablet_replica.cc:439] T 107d5c2e874b4876b43eeb2110300e29 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } } peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } } }
I20260809 15:30:45.031020 13647 tablet_replica.cc:442] T 107d5c2e874b4876b43eeb2110300e29 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: This TxnStatusTablet replica's current role is: LEADER
I20260809 15:30:45.030896 13671 tablet_replica.cc:439] T 107d5c2e874b4876b43eeb2110300e29 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } } peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } } }
I20260809 15:30:45.031422 13671 tablet_replica.cc:442] T 107d5c2e874b4876b43eeb2110300e29 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: This TxnStatusTablet replica's current role is: LEADER
I20260809 15:30:45.032015 13646 tablet_replica.cc:439] T 107d5c2e874b4876b43eeb2110300e29 P 24b485058dad4e0abdacbdf8ae4349bd: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } } peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } } }
I20260809 15:30:45.032159 13646 tablet_replica.cc:442] T 107d5c2e874b4876b43eeb2110300e29 P 24b485058dad4e0abdacbdf8ae4349bd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:30:45.032021 13655 mvcc.cc:205] Tried to move back new op lower bound from 7316641566815760384 to 7316641566702071808. Current Snapshot: MvccSnapshot[applied={T|T < 7316641566815760384 or (T in {7316641566815760384})}]
I20260809 15:30:45.033262 13659 tablet_replica.cc:439] T 107d5c2e874b4876b43eeb2110300e29 P fb87091e44164cb0ad48f3ca5858ee82: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 } } peers { permanent_uuid: "a32a7ecc6a5f4bb2a0dc3392a9e6d863" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38187 } } peers { permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 } } }
I20260809 15:30:45.033368 13659 tablet_replica.cc:442] T 107d5c2e874b4876b43eeb2110300e29 P fb87091e44164cb0ad48f3ca5858ee82: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:30:45.040309 13637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:45.037036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34498 (local address 127.11.146.2:38187)
0809 15:30:45.037164 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:45.037170 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:45.037228 (+ 58us) server_negotiation.cc:407] Connection header received
0809 15:30:45.037394 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:45.037399 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:45.037461 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:45.037547 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:30:45.037811 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:45.038358 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:45.039202 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:45.039426 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:45.039538 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:45.039831 (+ 293us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:30:45.039911 (+ 80us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:30:45.039995 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:45.040114 (+ 119us) server_negotiation.cc:299] Negotiation successful
0809 15:30:45.040169 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 15:30:45.052273 13637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:45.048232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:39389 (local address 127.11.146.2:38187)
0809 15:30:45.048362 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:45.048367 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:45.048673 (+ 306us) server_negotiation.cc:407] Connection header received
0809 15:30:45.048786 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:45.048790 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:45.048840 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:45.048923 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:30:45.049172 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:45.049940 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:45.050834 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:45.051175 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:45.051278 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:45.051683 (+ 405us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:30:45.051775 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:30:45.051856 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:45.051989 (+ 133us) server_negotiation.cc:299] Negotiation successful
0809 15:30:45.052043 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":48}
I20260809 15:30:45.052676 13696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:45.048232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:38187 (local address 127.11.146.2:39389)
0809 15:30:45.048587 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:45.048600 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:45.048697 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:45.048943 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:45.048945 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:45.048962 (+ 17us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 15:30:45.049072 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:45.049077 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:45.050053 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:45.050055 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:45.050720 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:45.050729 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:45.051291 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:45.051294 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:45.051429 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:45.051477 (+ 48us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 15:30:45.051898 (+ 421us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 15:30:45.051904 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 15:30:45.051962 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 15:30:45.052047 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"mutex_wait_us":23,"thread_start_us":162,"threads_started":1}
I20260809 15:30:45.059595 13249 raft_consensus.cc:1261] T 25598a5ba943428f89b886ce60bfa705 P 24b485058dad4e0abdacbdf8ae4349bd [term 1 FOLLOWER]: Refusing update from remote peer a32a7ecc6a5f4bb2a0dc3392a9e6d863: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:30:45.059633 13565 raft_consensus.cc:1261] T 25598a5ba943428f89b886ce60bfa705 P fb87091e44164cb0ad48f3ca5858ee82 [term 1 FOLLOWER]: Refusing update from remote peer a32a7ecc6a5f4bb2a0dc3392a9e6d863: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:30:45.060047 13693 consensus_queue.cc:1035] T 25598a5ba943428f89b886ce60bfa705 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb87091e44164cb0ad48f3ca5858ee82" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:30:45.060209 13647 consensus_queue.cc:1035] T 25598a5ba943428f89b886ce60bfa705 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24b485058dad4e0abdacbdf8ae4349bd" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:30:45.106925 13079 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:30:45.107134 13079 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:30:45.109586 13079 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 112bd3dca4fb4e65ba236f3be1e67e1b: Sending DeleteTablet for 3 replicas of tablet 25598a5ba943428f89b886ce60bfa705
I20260809 15:30:45.110172 13227 tablet_service.cc:1514] Processing DeleteTablet for tablet 25598a5ba943428f89b886ce60bfa705 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:30:45 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:43116
I20260809 15:30:45.110191 13386 tablet_service.cc:1514] Processing DeleteTablet for tablet 25598a5ba943428f89b886ce60bfa705 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:30:45 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:34478
I20260809 15:30:45.110381 13664 tablet_replica.cc:330] T 25598a5ba943428f89b886ce60bfa705 P 24b485058dad4e0abdacbdf8ae4349bd: stopping tablet replica
I20260809 15:30:45.110548 13664 raft_consensus.cc:2229] T 25598a5ba943428f89b886ce60bfa705 P 24b485058dad4e0abdacbdf8ae4349bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:30:45.110569 13662 tablet_replica.cc:330] T 25598a5ba943428f89b886ce60bfa705 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: stopping tablet replica
I20260809 15:30:45.110553 13543 tablet_service.cc:1514] Processing DeleteTablet for tablet 25598a5ba943428f89b886ce60bfa705 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:30:45 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:47124
I20260809 15:30:45.110667 13662 raft_consensus.cc:2229] T 25598a5ba943428f89b886ce60bfa705 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:30:45.110682 13664 raft_consensus.cc:2258] T 25598a5ba943428f89b886ce60bfa705 P 24b485058dad4e0abdacbdf8ae4349bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:30:45.110718 13663 tablet_replica.cc:330] T 25598a5ba943428f89b886ce60bfa705 P fb87091e44164cb0ad48f3ca5858ee82: stopping tablet replica
I20260809 15:30:45.110828 13663 raft_consensus.cc:2229] T 25598a5ba943428f89b886ce60bfa705 P fb87091e44164cb0ad48f3ca5858ee82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:30:45.110934 13663 raft_consensus.cc:2258] T 25598a5ba943428f89b886ce60bfa705 P fb87091e44164cb0ad48f3ca5858ee82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:30:45.110953 13662 raft_consensus.cc:2258] T 25598a5ba943428f89b886ce60bfa705 P a32a7ecc6a5f4bb2a0dc3392a9e6d863 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:30:45.111910 13662 ts_tablet_manager.cc:1905] T 25598a5ba943428f89b886ce60bfa705 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:30:45.111960 13663 ts_tablet_manager.cc:1905] T 25598a5ba943428f89b886ce60bfa705 P fb87091e44164cb0ad48f3ca5858ee82: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:30:45.114444 13662 ts_tablet_manager.cc:1918] T 25598a5ba943428f89b886ce60bfa705 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 15:30:45.114542 13662 log.cc:1196] T 25598a5ba943428f89b886ce60bfa705 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-1/wal/wals/25598a5ba943428f89b886ce60bfa705
I20260809 15:30:45.114784 13662 ts_tablet_manager.cc:1939] T 25598a5ba943428f89b886ce60bfa705 P a32a7ecc6a5f4bb2a0dc3392a9e6d863: Deleting consensus metadata
I20260809 15:30:45.114833 13663 ts_tablet_manager.cc:1918] T 25598a5ba943428f89b886ce60bfa705 P fb87091e44164cb0ad48f3ca5858ee82: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 15:30:45.114921 13663 log.cc:1196] T 25598a5ba943428f89b886ce60bfa705 P fb87091e44164cb0ad48f3ca5858ee82: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-2/wal/wals/25598a5ba943428f89b886ce60bfa705
I20260809 15:30:45.115177 13663 ts_tablet_manager.cc:1939] T 25598a5ba943428f89b886ce60bfa705 P fb87091e44164cb0ad48f3ca5858ee82: Deleting consensus metadata
I20260809 15:30:45.115563 13064 catalog_manager.cc:4841] TS a32a7ecc6a5f4bb2a0dc3392a9e6d863 (127.11.146.2:38187): tablet 25598a5ba943428f89b886ce60bfa705 (table test-table [id=0ad3065630ee4e31a8e3b94505ebe95e]) successfully deleted
I20260809 15:30:45.116439 13062 catalog_manager.cc:4841] TS fb87091e44164cb0ad48f3ca5858ee82 (127.11.146.3:37549): tablet 25598a5ba943428f89b886ce60bfa705 (table test-table [id=0ad3065630ee4e31a8e3b94505ebe95e]) successfully deleted
I20260809 15:30:45.117466 13664 ts_tablet_manager.cc:1905] T 25598a5ba943428f89b886ce60bfa705 P 24b485058dad4e0abdacbdf8ae4349bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:30:45.120272 13664 ts_tablet_manager.cc:1918] T 25598a5ba943428f89b886ce60bfa705 P 24b485058dad4e0abdacbdf8ae4349bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 15:30:45.120694 13664 log.cc:1196] T 25598a5ba943428f89b886ce60bfa705 P 24b485058dad4e0abdacbdf8ae4349bd: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786289437399694-11848-0/minicluster-data/ts-0/wal/wals/25598a5ba943428f89b886ce60bfa705
I20260809 15:30:45.120991 13664 ts_tablet_manager.cc:1939] T 25598a5ba943428f89b886ce60bfa705 P 24b485058dad4e0abdacbdf8ae4349bd: Deleting consensus metadata
I20260809 15:30:45.121732 13062 catalog_manager.cc:4841] TS 24b485058dad4e0abdacbdf8ae4349bd (127.11.146.1:40303): tablet 25598a5ba943428f89b886ce60bfa705 (table test-table [id=0ad3065630ee4e31a8e3b94505ebe95e]) successfully deleted
Aug 09 15:30:45 dist-test-slave-1jjb krb5kdc[13031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289444, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.146.1@KRBTEST.COM
I20260809 15:30:45.127323 13638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:45.116933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43130 (local address 127.11.146.1:40303)
0809 15:30:45.117082 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:45.117087 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:45.117323 (+ 236us) server_negotiation.cc:407] Connection header received
0809 15:30:45.117490 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:45.117493 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:45.117545 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:45.117623 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:45.118321 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:45.118835 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:45.119689 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:45.119915 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:45.120027 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:45.123697 (+ 3670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:45.123707 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:45.123719 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:45.123743 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:45.125435 (+ 1692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:45.125895 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:45.125900 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:45.125902 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:45.125986 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:45.126279 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:45.126282 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:45.126284 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:45.126570 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:45.126768 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:45.127051 (+ 283us) server_negotiation.cc:299] Negotiation successful
0809 15:30:45.127170 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
W20260809 15:30:45.128520 13295 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43130
I20260809 15:30:45.138621 13132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:45.130398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42944 (local address 127.11.146.62:42045)
0809 15:30:45.130536 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:45.130540 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:45.130696 (+ 156us) server_negotiation.cc:407] Connection header received
0809 15:30:45.130829 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:45.130833 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:45.130890 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:45.130977 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:45.131661 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:45.132278 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:45.133127 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:45.133356 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:45.133471 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:45.134879 (+ 1408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:45.134883 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:45.134885 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:45.134910 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:45.136815 (+ 1905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:45.137273 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:45.137278 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:45.137280 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:45.137381 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:45.137717 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:45.137720 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:45.137722 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:45.137930 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:45.138073 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:45.138328 (+ 255us) server_negotiation.cc:299] Negotiation successful
0809 15:30:45.138459 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
W20260809 15:30:45.139117 13079 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42944
I20260809 15:30:45.140683 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 13160
I20260809 15:30:45.151847 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 13313
I20260809 15:30:45.161275 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 13468
I20260809 15:30:45.171100 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 13045
2026-08-09T15:30:45Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2902 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:30:45 dist-test-slave-1jjb krb5kdc[13708](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:30:45 dist-test-slave-1jjb krb5kdc[13708](info): set up 2 sockets
Aug 09 15:30:45 dist-test-slave-1jjb krb5kdc[13708](info): commencing operation
krb5kdc: starting...
W20260809 15:30:46.277701 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.080s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:30:46 dist-test-slave-1jjb krb5kdc[13708](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289446, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:30:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:30:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.146.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
I20260809 15:30:46.407864 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:43335
--webserver_interface=127.11.146.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:36449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:43335
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:30:46.525918 13721 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:30:46.526182 13721 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:30:46.526228 13721 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:30:46.530575 13721 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:30:46.530649 13721 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 15:30:46.530668 13721 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:30:46.530685 13721 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:30:46.530701 13721 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:30:46.530717 13721 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:30:46.536229 13721 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:36449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:43335
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:43335
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13721
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:30:46.537376 13721 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:30:46.538429 13721 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:30:46.547374 13729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:46.547394 13727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:46.547766 13721 server_base.cc:1034] running on GCE node
W20260809 15:30:46.547425 13726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:46.548543 13721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:30:46.549651 13721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:30:46.550863 13721 hybrid_clock.cc:648] HybridClock initialized: now 1786289446550845 us; error 33 us; skew 500 ppm
Aug 09 15:30:46 dist-test-slave-1jjb krb5kdc[13708](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289446, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:30:46.553833 13721 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:30:46.554774 13721 webserver.cc:460] Webserver started at http://127.11.146.62:45997/ using document root <none> and password file <none>
I20260809 15:30:46.555369 13721 fs_manager.cc:359] Metadata directory not provided
I20260809 15:30:46.555465 13721 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:30:46.555851 13721 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:30:46.558123 13721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "80459e49beab434085c62eb57e94206c"
format_stamp: "Formatted at 2026-08-09 15:30:46 on dist-test-slave-1jjb"
server_key: "4bdf31aaa60cccce0ce203c79f8db137"
server_key_iv: "8e02fd7e435fbc897ff3be269d89d003"
server_key_version: "encryptionkey@0"
I20260809 15:30:46.558709 13721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "80459e49beab434085c62eb57e94206c"
format_stamp: "Formatted at 2026-08-09 15:30:46 on dist-test-slave-1jjb"
server_key: "4bdf31aaa60cccce0ce203c79f8db137"
server_key_iv: "8e02fd7e435fbc897ff3be269d89d003"
server_key_version: "encryptionkey@0"
I20260809 15:30:46.562493 13721 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.005s
I20260809 15:30:46.565012 13736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:46.566392 13721 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:30:46.566553 13721 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "80459e49beab434085c62eb57e94206c"
format_stamp: "Formatted at 2026-08-09 15:30:46 on dist-test-slave-1jjb"
server_key: "4bdf31aaa60cccce0ce203c79f8db137"
server_key_iv: "8e02fd7e435fbc897ff3be269d89d003"
server_key_version: "encryptionkey@0"
I20260809 15:30:46.566677 13721 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:30:46.595971 13721 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:30:46.599238 13721 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:30:46.599455 13721 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:30:46.607823 13721 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:43335
I20260809 15:30:46.607920 13801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:43335 every 8 connection(s)
I20260809 15:30:46.608880 13721 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:30:46.611775 13802 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:30:46.615396 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 13721
I20260809 15:30:46.615540 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:30:46.615978 11848 external_mini_cluster.cc:1428] Setting key 61f51b808c26e6e426c829edb5a79b1d
I20260809 15:30:46.618053 13802 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80459e49beab434085c62eb57e94206c: Bootstrap starting.
I20260809 15:30:46.620885 13802 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 80459e49beab434085c62eb57e94206c: Neither blocks nor log segments found. Creating new log.
I20260809 15:30:46.621827 13802 log.cc:824] T 00000000000000000000000000000000 P 80459e49beab434085c62eb57e94206c: Log is configured to *not* fsync() on all Append() calls
I20260809 15:30:46.624027 13802 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80459e49beab434085c62eb57e94206c: No bootstrap required, opened a new log
Aug 09 15:30:46 dist-test-slave-1jjb krb5kdc[13708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289446, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:30:46.629354 13802 raft_consensus.cc:348] T 00000000000000000000000000000000 P 80459e49beab434085c62eb57e94206c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80459e49beab434085c62eb57e94206c" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43335 } }
I20260809 15:30:46.629657 13802 raft_consensus.cc:374] T 00000000000000000000000000000000 P 80459e49beab434085c62eb57e94206c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:30:46.629726 13802 raft_consensus.cc:729] T 00000000000000000000000000000000 P 80459e49beab434085c62eb57e94206c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80459e49beab434085c62eb57e94206c, State: Initialized, Role: FOLLOWER
I20260809 15:30:46.630270 13802 consensus_queue.cc:260] T 00000000000000000000000000000000 P 80459e49beab434085c62eb57e94206c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80459e49beab434085c62eb57e94206c" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43335 } }
I20260809 15:30:46.630424 13802 raft_consensus.cc:388] T 00000000000000000000000000000000 P 80459e49beab434085c62eb57e94206c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:30:46.630517 13802 raft_consensus.cc:482] T 00000000000000000000000000000000 P 80459e49beab434085c62eb57e94206c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:30:46.630618 13802 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 80459e49beab434085c62eb57e94206c [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:30:46.631717 13802 raft_consensus.cc:504] T 00000000000000000000000000000000 P 80459e49beab434085c62eb57e94206c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80459e49beab434085c62eb57e94206c" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43335 } }
I20260809 15:30:46.632184 13802 leader_election.cc:302] T 00000000000000000000000000000000 P 80459e49beab434085c62eb57e94206c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 80459e49beab434085c62eb57e94206c; no voters:
I20260809 15:30:46.632572 13802 leader_election.cc:288] T 00000000000000000000000000000000 P 80459e49beab434085c62eb57e94206c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:30:46.632649 13807 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 80459e49beab434085c62eb57e94206c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:30:46.632866 13807 raft_consensus.cc:686] T 00000000000000000000000000000000 P 80459e49beab434085c62eb57e94206c [term 1 LEADER]: Becoming Leader. State: Replica: 80459e49beab434085c62eb57e94206c, State: Running, Role: LEADER
I20260809 15:30:46.633124 13805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:46.617529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50816 (local address 127.11.146.62:43335)
0809 15:30:46.617975 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:46.617997 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:46.618041 (+ 44us) server_negotiation.cc:407] Connection header received
0809 15:30:46.618882 (+ 841us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:46.618907 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:46.619341 (+ 434us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:46.619733 (+ 392us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:46.620588 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:46.622126 (+ 1538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:46.623176 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:46.623858 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:46.624017 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:46.626928 (+ 2911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:46.626934 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:46.626953 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:46.626987 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:46.629433 (+ 2446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:46.630012 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:46.630018 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:46.630024 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:46.630167 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:46.630521 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:46.630524 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:46.630525 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:46.631048 (+ 523us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:46.631286 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:46.631706 (+ 420us) server_negotiation.cc:299] Negotiation successful
0809 15:30:46.632076 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":108,"threads_started":1}
I20260809 15:30:46.633188 13807 consensus_queue.cc:237] T 00000000000000000000000000000000 P 80459e49beab434085c62eb57e94206c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80459e49beab434085c62eb57e94206c" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43335 } }
I20260809 15:30:46.634002 13802 sys_catalog.cc:564] T 00000000000000000000000000000000 P 80459e49beab434085c62eb57e94206c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:30:46.634938 13808 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80459e49beab434085c62eb57e94206c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 80459e49beab434085c62eb57e94206c. Latest consensus state: current_term: 1 leader_uuid: "80459e49beab434085c62eb57e94206c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80459e49beab434085c62eb57e94206c" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43335 } } }
I20260809 15:30:46.635058 13808 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80459e49beab434085c62eb57e94206c [sys.catalog]: This master's current role is: LEADER
I20260809 15:30:46.635344 13809 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80459e49beab434085c62eb57e94206c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "80459e49beab434085c62eb57e94206c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80459e49beab434085c62eb57e94206c" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43335 } } }
I20260809 15:30:46.635438 13809 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80459e49beab434085c62eb57e94206c [sys.catalog]: This master's current role is: LEADER
I20260809 15:30:46.635447 13816 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:30:46.638957 13816 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:30:46.644001 13816 catalog_manager.cc:1347] Generated new cluster ID: 75ebc72070784d169bb667db0ac2b1ff
I20260809 15:30:46.644059 13816 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:30:46.655525 13816 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:30:46.657064 13816 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:30:46.661774 13816 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 80459e49beab434085c62eb57e94206c: Generated new TSK 0
I20260809 15:30:46.662425 13816 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.146.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
I20260809 15:30:46.699863 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.1:0
--local_ip_for_outbound_sockets=127.11.146.1
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:43335
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:36449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:30:46.818972 13830 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:30:46.819252 13830 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:30:46.819301 13830 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:30:46.823418 13830 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:30:46.823498 13830 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:30:46.823539 13830 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 15:30:46.823553 13830 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 15:30:46.823666 13830 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.1
I20260809 15:30:46.829571 13830 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:36449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.146.1
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.146.62:43335
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13830
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.1
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:30:46.830785 13830 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:30:46.831876 13830 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:30:46.842156 13835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:46.842199 13838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:46.842339 13830 server_base.cc:1034] running on GCE node
W20260809 15:30:46.842213 13836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:46.842924 13830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:30:46.843493 13830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:30:46.844657 13830 hybrid_clock.cc:648] HybridClock initialized: now 1786289446844623 us; error 44 us; skew 500 ppm
Aug 09 15:30:46 dist-test-slave-1jjb krb5kdc[13708](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289446, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:30:46.847445 13830 init.cc:377] Logged in from keytab as kudu/127.11.146.1@KRBTEST.COM (short username kudu)
I20260809 15:30:46.848521 13830 webserver.cc:460] Webserver started at http://127.11.146.1:46309/ using document root <none> and password file <none>
I20260809 15:30:46.849123 13830 fs_manager.cc:359] Metadata directory not provided
I20260809 15:30:46.849227 13830 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:30:46.849462 13830 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:30:46.851504 13830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-0/data/instance:
uuid: "fe9090c0b8254c3397a68508dd7450d3"
format_stamp: "Formatted at 2026-08-09 15:30:46 on dist-test-slave-1jjb"
server_key: "bdad7efbd5a61b17e5b46d352574493b"
server_key_iv: "94bd5b5361499afc9056919c2c561575"
server_key_version: "encryptionkey@0"
I20260809 15:30:46.852114 13830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance:
uuid: "fe9090c0b8254c3397a68508dd7450d3"
format_stamp: "Formatted at 2026-08-09 15:30:46 on dist-test-slave-1jjb"
server_key: "bdad7efbd5a61b17e5b46d352574493b"
server_key_iv: "94bd5b5361499afc9056919c2c561575"
server_key_version: "encryptionkey@0"
I20260809 15:30:46.855732 13830 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:30:46.858160 13845 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:46.859454 13830 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:30:46.859608 13830 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-0/wal
uuid: "fe9090c0b8254c3397a68508dd7450d3"
format_stamp: "Formatted at 2026-08-09 15:30:46 on dist-test-slave-1jjb"
server_key: "bdad7efbd5a61b17e5b46d352574493b"
server_key_iv: "94bd5b5361499afc9056919c2c561575"
server_key_version: "encryptionkey@0"
I20260809 15:30:46.859730 13830 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:30:46.872728 13830 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:30:46.875516 13830 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:30:46.875711 13830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:30:46.877256 13830 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:30:46.877326 13830 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:46.877398 13830 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:30:46.877439 13830 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 15:30:46 dist-test-slave-1jjb krb5kdc[13708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289446, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:30:46.889071 13830 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.1:39425
I20260809 15:30:46.889287 13965 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.1:39425 every 8 connection(s)
I20260809 15:30:46.890008 13830 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
I20260809 15:30:46.892664 13805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:46.878028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:41963 (local address 127.11.146.62:43335)
0809 15:30:46.878178 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:46.878185 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:46.879182 (+ 997us) server_negotiation.cc:407] Connection header received
0809 15:30:46.880321 (+ 1139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:46.880326 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:46.880392 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:46.880458 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:46.881918 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:46.882833 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:46.883991 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:46.884411 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:46.884527 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:46.888560 (+ 4033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:46.888565 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:46.888568 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:46.888598 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:46.890375 (+ 1777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:46.890998 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:46.891001 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:46.891002 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:46.891085 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:46.891456 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:46.891476 (+ 20us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:46.891478 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:46.891675 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:46.891786 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:46.892343 (+ 557us) server_negotiation.cc:299] Negotiation successful
0809 15:30:46.892492 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 15:30:46.893389 13854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:46.878558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43335 (local address 127.11.146.1:41963)
0809 15:30:46.879035 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:46.879078 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:46.880053 (+ 975us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:46.880818 (+ 765us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:46.880824 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:46.881142 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:30:46.881737 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:46.881754 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:46.882966 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:46.882972 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:46.883853 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:46.883863 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:46.884619 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:46.884624 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:46.884864 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:46.885576 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:30:46.885605 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:30:46.888358 (+ 2753us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:30:46.890496 (+ 2138us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:46.890502 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:46.890516 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:46.890887 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:46.891205 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:46.891209 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:46.891211 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:46.891355 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:46.891796 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:30:46.891805 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:30:46.892047 (+ 242us) client_negotiation.cc:769] Sending connection context
0809 15:30:46.892298 (+ 251us) client_negotiation.cc:240] Negotiation successful
0809 15:30:46.892613 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":134,"threads_started":1}
I20260809 15:30:46.894770 13966 heartbeater.cc:347] Connected to a master server at 127.11.146.62:43335
I20260809 15:30:46.894923 13966 heartbeater.cc:464] Registering TS with master...
I20260809 15:30:46.895423 13966 heartbeater.cc:511] Master 127.11.146.62:43335 requested a full tablet report, sending...
I20260809 15:30:46.897110 13754 ts_manager.cc:194] Registered new tserver with Master: fe9090c0b8254c3397a68508dd7450d3 (127.11.146.1:39425)
I20260809 15:30:46.897450 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 13830
I20260809 15:30:46.897571 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance
I20260809 15:30:46.897869 11848 external_mini_cluster.cc:1428] Setting key 978754d1ff8c313dcf9e471f0f5e6311
I20260809 15:30:46.898653 13754 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.1@KRBTEST.COM'} at 127.11.146.1:41963
I20260809 15:30:46.905586 13805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:46.898294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:52049 (local address 127.11.146.62:43335)
0809 15:30:46.898433 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:46.898438 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:46.898566 (+ 128us) server_negotiation.cc:407] Connection header received
0809 15:30:46.898742 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:46.898746 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:46.898786 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:46.898866 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:46.899403 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:46.899924 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:46.900782 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:46.900999 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:46.901108 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:46.902432 (+ 1324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:46.902435 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:46.902436 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:46.902458 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:46.903880 (+ 1422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:46.904433 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:46.904436 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:46.904437 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:46.904508 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:46.904810 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:46.904812 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:46.904813 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:46.904974 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:46.905049 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:46.905380 (+ 331us) server_negotiation.cc:299] Negotiation successful
0809 15:30:46.905474 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 15:30:46.906096 13972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:46.897243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43335 (local address 127.11.146.1:52049)
0809 15:30:46.898480 (+ 1237us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:46.898496 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:46.898634 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:46.898906 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:46.898909 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:46.899136 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:30:46.899265 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:46.899274 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:46.900057 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:46.900060 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:46.900649 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:46.900657 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:46.901116 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:46.901119 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:46.901209 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:46.901767 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:30:46.901787 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:30:46.902290 (+ 503us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:30:46.904009 (+ 1719us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:46.904015 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:46.904020 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:46.904330 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:46.904606 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:46.904611 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:46.904616 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:46.904716 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:46.905073 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:30:46.905079 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:30:46.905200 (+ 121us) client_negotiation.cc:769] Sending connection context
0809 15:30:46.905332 (+ 132us) client_negotiation.cc:240] Negotiation successful
0809 15:30:46.905505 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1152,"thread_start_us":80,"threads_started":1}
WARNING: no policy specified for kudu/127.11.146.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
I20260809 15:30:46.928829 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.2:0
--local_ip_for_outbound_sockets=127.11.146.2
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:43335
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:36449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:30:47.047252 13975 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:30:47.047497 13975 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:30:47.047544 13975 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:30:47.051581 13975 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:30:47.051638 13975 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:30:47.051676 13975 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 15:30:47.051690 13975 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 15:30:47.051720 13975 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.2
I20260809 15:30:47.056784 13975 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:36449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.146.2
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.146.62:43335
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13975
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.2
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:30:47.057742 13975 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:30:47.058696 13975 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:30:47.068516 13981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:47.068512 13980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:47.068573 13983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:47.068990 13975 server_base.cc:1034] running on GCE node
I20260809 15:30:47.069439 13975 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:30:47.070148 13975 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:30:47.071327 13975 hybrid_clock.cc:648] HybridClock initialized: now 1786289447071292 us; error 43 us; skew 500 ppm
Aug 09 15:30:47 dist-test-slave-1jjb krb5kdc[13708](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289447, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:30:47.074362 13975 init.cc:377] Logged in from keytab as kudu/127.11.146.2@KRBTEST.COM (short username kudu)
I20260809 15:30:47.075237 13975 webserver.cc:460] Webserver started at http://127.11.146.2:34245/ using document root <none> and password file <none>
I20260809 15:30:47.076011 13975 fs_manager.cc:359] Metadata directory not provided
I20260809 15:30:47.076146 13975 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:30:47.076396 13975 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:30:47.078420 13975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-1/data/instance:
uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0"
format_stamp: "Formatted at 2026-08-09 15:30:47 on dist-test-slave-1jjb"
server_key: "57856fd88950da5fb979234ee1f10d20"
server_key_iv: "8c97f77378c6d3a58c4ca45263eb1695"
server_key_version: "encryptionkey@0"
I20260809 15:30:47.078992 13975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance:
uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0"
format_stamp: "Formatted at 2026-08-09 15:30:47 on dist-test-slave-1jjb"
server_key: "57856fd88950da5fb979234ee1f10d20"
server_key_iv: "8c97f77378c6d3a58c4ca45263eb1695"
server_key_version: "encryptionkey@0"
I20260809 15:30:47.082739 13975 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 15:30:47.085238 13991 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:47.086383 13975 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:30:47.086544 13975 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-1/wal
uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0"
format_stamp: "Formatted at 2026-08-09 15:30:47 on dist-test-slave-1jjb"
server_key: "57856fd88950da5fb979234ee1f10d20"
server_key_iv: "8c97f77378c6d3a58c4ca45263eb1695"
server_key_version: "encryptionkey@0"
I20260809 15:30:47.086661 13975 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:30:47.101696 13975 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:30:47.104918 13975 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:30:47.105122 13975 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:30:47.106515 13975 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:30:47.106588 13975 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:47.106662 13975 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:30:47.106714 13975 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 15:30:47 dist-test-slave-1jjb krb5kdc[13708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289447, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:30:47.117818 13975 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.2:32913
I20260809 15:30:47.117867 14112 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.2:32913 every 8 connection(s)
I20260809 15:30:47.119086 13975 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
I20260809 15:30:47.121942 13805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:47.107532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:60625 (local address 127.11.146.62:43335)
0809 15:30:47.107863 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:47.107867 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:47.108744 (+ 877us) server_negotiation.cc:407] Connection header received
0809 15:30:47.109907 (+ 1163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:47.109911 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:47.109975 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:47.110081 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:47.111743 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.112663 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.114546 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.114837 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.114923 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:47.118145 (+ 3222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:47.118149 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:47.118152 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:47.118181 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:47.120028 (+ 1847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:47.120616 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:47.120618 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:47.120620 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:47.120701 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:47.120996 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:47.120998 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:47.120999 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:47.121182 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:47.121259 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:47.121725 (+ 466us) server_negotiation.cc:299] Negotiation successful
0809 15:30:47.121823 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236}
I20260809 15:30:47.122728 14000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:47.108041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43335 (local address 127.11.146.2:60625)
0809 15:30:47.108587 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:47.108628 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:47.109659 (+ 1031us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:47.110292 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:47.110302 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:47.110785 (+ 483us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:30:47.111511 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:47.111535 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.112811 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.112817 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:47.114406 (+ 1589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:47.114418 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.115021 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.115027 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:47.115250 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:47.116069 (+ 819us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:30:47.116114 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:30:47.117959 (+ 1845us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:30:47.120211 (+ 2252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:47.120217 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:47.120233 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:47.120522 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:47.120786 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:47.120788 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:47.120789 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:47.120917 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:47.121271 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:30:47.121276 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:30:47.121493 (+ 217us) client_negotiation.cc:769] Sending connection context
0809 15:30:47.121649 (+ 156us) client_negotiation.cc:240] Negotiation successful
0809 15:30:47.121889 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":135,"threads_started":1}
I20260809 15:30:47.123978 14113 heartbeater.cc:347] Connected to a master server at 127.11.146.62:43335
I20260809 15:30:47.124135 14113 heartbeater.cc:464] Registering TS with master...
I20260809 15:30:47.124693 14113 heartbeater.cc:511] Master 127.11.146.62:43335 requested a full tablet report, sending...
I20260809 15:30:47.125800 13755 ts_manager.cc:194] Registered new tserver with Master: 1f0f8ae3a1ba4cd6b191651cee5c9fe0 (127.11.146.2:32913)
I20260809 15:30:47.125872 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 13975
I20260809 15:30:47.125994 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance
I20260809 15:30:47.126319 11848 external_mini_cluster.cc:1428] Setting key 7daf45f2a37af07593530964cbdb270a
I20260809 15:30:47.126667 13755 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.2@KRBTEST.COM'} at 127.11.146.2:60625
I20260809 15:30:47.134617 13805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:47.126514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:44969 (local address 127.11.146.62:43335)
0809 15:30:47.126627 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:47.126631 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:47.126913 (+ 282us) server_negotiation.cc:407] Connection header received
0809 15:30:47.127091 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:47.127094 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:47.127132 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:47.127197 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:47.127740 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.128514 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.129781 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.129988 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.130131 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:47.131217 (+ 1086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:47.131223 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:47.131231 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:47.131252 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:47.132776 (+ 1524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:47.133297 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:47.133300 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:47.133301 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:47.133372 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:47.133689 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:47.133691 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:47.133692 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:47.133882 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:47.133959 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:47.134346 (+ 387us) server_negotiation.cc:299] Negotiation successful
0809 15:30:47.134476 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 15:30:47.134894 14119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:47.126418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43335 (local address 127.11.146.2:44969)
0809 15:30:47.126834 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:47.126849 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:47.126981 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:47.127238 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:47.127241 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:47.127471 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:30:47.127603 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:47.127611 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.128655 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.128661 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:47.129646 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:47.129660 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.130135 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.130139 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:47.130246 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:47.130763 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:30:47.130775 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:30:47.131071 (+ 296us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:30:47.132896 (+ 1825us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:47.132902 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:47.132907 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:47.133197 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:47.133487 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:47.133490 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:47.133492 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:47.133595 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:47.133991 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:30:47.133997 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:30:47.134123 (+ 126us) client_negotiation.cc:769] Sending connection context
0809 15:30:47.134298 (+ 175us) client_negotiation.cc:240] Negotiation successful
0809 15:30:47.134485 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"mutex_wait_us":1,"thread_start_us":108,"threads_started":1}
WARNING: no policy specified for kudu/127.11.146.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
I20260809 15:30:47.158820 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.3:0
--local_ip_for_outbound_sockets=127.11.146.3
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:43335
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:36449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:30:47.276659 14122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:30:47.276940 14122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:30:47.277024 14122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:30:47.280992 14122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:30:47.281080 14122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:30:47.281153 14122 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 15:30:47.281198 14122 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 15:30:47.281267 14122 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.3
I20260809 15:30:47.286496 14122 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:36449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.146.3
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.146.62:43335
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14122
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.3
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:30:47.287581 14122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:30:47.288792 14122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:30:47.298650 14130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:47.298646 14127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:47.298642 14128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:47.299000 14122 server_base.cc:1034] running on GCE node
I20260809 15:30:47.299544 14122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:30:47.300341 14122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:30:47.301510 14122 hybrid_clock.cc:648] HybridClock initialized: now 1786289447301494 us; error 24 us; skew 500 ppm
Aug 09 15:30:47 dist-test-slave-1jjb krb5kdc[13708](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289447, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:30:47.304385 14122 init.cc:377] Logged in from keytab as kudu/127.11.146.3@KRBTEST.COM (short username kudu)
I20260809 15:30:47.305271 14122 webserver.cc:460] Webserver started at http://127.11.146.3:44023/ using document root <none> and password file <none>
I20260809 15:30:47.305878 14122 fs_manager.cc:359] Metadata directory not provided
I20260809 15:30:47.305974 14122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:30:47.306222 14122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:30:47.308596 14122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-2/data/instance:
uuid: "9ac945e1feb447e5a5a7e4363e90ab09"
format_stamp: "Formatted at 2026-08-09 15:30:47 on dist-test-slave-1jjb"
server_key: "a6ba466991227bf6e7ad436669c7f7a9"
server_key_iv: "ece2b5b550654e293edb8a37c04ec973"
server_key_version: "encryptionkey@0"
I20260809 15:30:47.309201 14122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance:
uuid: "9ac945e1feb447e5a5a7e4363e90ab09"
format_stamp: "Formatted at 2026-08-09 15:30:47 on dist-test-slave-1jjb"
server_key: "a6ba466991227bf6e7ad436669c7f7a9"
server_key_iv: "ece2b5b550654e293edb8a37c04ec973"
server_key_version: "encryptionkey@0"
I20260809 15:30:47.313205 14122 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 15:30:47.315758 14137 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:47.317096 14122 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:30:47.317255 14122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-2/wal
uuid: "9ac945e1feb447e5a5a7e4363e90ab09"
format_stamp: "Formatted at 2026-08-09 15:30:47 on dist-test-slave-1jjb"
server_key: "a6ba466991227bf6e7ad436669c7f7a9"
server_key_iv: "ece2b5b550654e293edb8a37c04ec973"
server_key_version: "encryptionkey@0"
I20260809 15:30:47.317379 14122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:30:47.335253 14122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:30:47.339152 14122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:30:47.339349 14122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:30:47.341178 14122 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:30:47.341267 14122 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:47.341341 14122 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:30:47.341382 14122 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 15:30:47 dist-test-slave-1jjb krb5kdc[13708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289447, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:30:47.353379 14122 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.3:43489
I20260809 15:30:47.353456 14257 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.3:43489 every 8 connection(s)
I20260809 15:30:47.354522 14122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
I20260809 15:30:47.356433 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 14122
I20260809 15:30:47.356572 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance
I20260809 15:30:47.356868 11848 external_mini_cluster.cc:1428] Setting key 8c906c43bb0851dccd87694c43eddd83
I20260809 15:30:47.357268 13805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:47.342243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:57877 (local address 127.11.146.62:43335)
0809 15:30:47.342386 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:47.342390 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:47.343240 (+ 850us) server_negotiation.cc:407] Connection header received
0809 15:30:47.344492 (+ 1252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:47.344499 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:47.344558 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:47.344648 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:47.346559 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.347414 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.349308 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.349712 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.349861 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:47.353234 (+ 3373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:47.353238 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:47.353241 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:47.353277 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:47.354865 (+ 1588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:47.355446 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:47.355450 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:47.355452 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:47.355553 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:47.356016 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:47.356018 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:47.356019 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:47.356265 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:47.356380 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:47.356967 (+ 587us) server_negotiation.cc:299] Negotiation successful
0809 15:30:47.357096 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 15:30:47.358104 14146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:47.342573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43335 (local address 127.11.146.3:57877)
0809 15:30:47.343089 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:47.343134 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:47.344234 (+ 1100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:47.345109 (+ 875us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:47.345119 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:47.345671 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:30:47.346406 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:47.346430 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.347561 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.347565 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:47.349177 (+ 1612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:47.349189 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.349953 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.349960 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:47.350195 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:47.350926 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:30:47.350943 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:30:47.353015 (+ 2072us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:30:47.354984 (+ 1969us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:47.354990 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:47.355005 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:47.355309 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:47.355684 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:47.355686 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:47.355688 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:47.355907 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:47.356390 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:30:47.356399 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:30:47.356703 (+ 304us) client_negotiation.cc:769] Sending connection context
0809 15:30:47.356897 (+ 194us) client_negotiation.cc:240] Negotiation successful
0809 15:30:47.357220 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":148,"threads_started":1}
I20260809 15:30:47.359304 14258 heartbeater.cc:347] Connected to a master server at 127.11.146.62:43335
I20260809 15:30:47.359447 14258 heartbeater.cc:464] Registering TS with master...
I20260809 15:30:47.360035 14258 heartbeater.cc:511] Master 127.11.146.62:43335 requested a full tablet report, sending...
I20260809 15:30:47.361153 13755 ts_manager.cc:194] Registered new tserver with Master: 9ac945e1feb447e5a5a7e4363e90ab09 (127.11.146.3:43489)
I20260809 15:30:47.361886 13755 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.3@KRBTEST.COM'} at 127.11.146.3:57877
I20260809 15:30:47.368566 13805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:47.361759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:48317 (local address 127.11.146.62:43335)
0809 15:30:47.361882 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:47.361885 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:47.362042 (+ 157us) server_negotiation.cc:407] Connection header received
0809 15:30:47.362159 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:47.362165 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:47.362220 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:47.362296 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:47.362775 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.363281 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.364197 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.364423 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.364533 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:47.365530 (+ 997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:47.365534 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:47.365537 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:47.365560 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:47.366754 (+ 1194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:47.367216 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:47.367219 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:47.367221 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:47.367302 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:47.367692 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:47.367696 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:47.367698 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:47.367886 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:47.368003 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:47.368307 (+ 304us) server_negotiation.cc:299] Negotiation successful
0809 15:30:47.368422 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 15:30:47.368599 14264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:47.361628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43335 (local address 127.11.146.3:48317)
0809 15:30:47.361941 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:47.361957 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:47.362061 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:47.362316 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:47.362319 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:47.362543 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:30:47.362660 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:47.362666 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.363407 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.363410 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:47.364036 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:47.364045 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.364537 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.364541 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:47.364632 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:47.365067 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:30:47.365079 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:30:47.365370 (+ 291us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:30:47.366867 (+ 1497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:47.366872 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:47.366874 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:47.367097 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:47.367395 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:47.367399 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:47.367401 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:47.367495 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:47.367995 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:30:47.367998 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:30:47.368119 (+ 121us) client_negotiation.cc:769] Sending connection context
0809 15:30:47.368249 (+ 130us) client_negotiation.cc:240] Negotiation successful
0809 15:30:47.368397 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":99,"threads_started":1}
I20260809 15:30:47.371338 11848 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 15:30:47 dist-test-slave-1jjb krb5kdc[13708](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289447, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 15:30:47 dist-test-slave-1jjb krb5kdc[13708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289447, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:30:47.401290 13805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:47.392661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50818 (local address 127.11.146.62:43335)
0809 15:30:47.392808 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:47.392811 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:47.392824 (+ 13us) server_negotiation.cc:407] Connection header received
0809 15:30:47.392867 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:47.392869 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:47.392909 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:47.393012 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:47.393744 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.394335 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.395253 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.395479 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.395594 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:47.398137 (+ 2543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:47.398140 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:47.398142 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:47.398168 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:47.399516 (+ 1348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:47.399960 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:47.399965 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:47.399968 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:47.400059 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:47.400376 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:47.400379 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:47.400381 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:47.400590 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:47.400734 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:47.400994 (+ 260us) server_negotiation.cc:299] Negotiation successful
0809 15:30:47.401119 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 15:30:47.404625 13755 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50818:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:30:47.407832 13755 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:30:47.423244 14275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:47.416403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:43489 (local address 127.0.0.1:37014)
0809 15:30:47.416764 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:47.416817 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:47.416946 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:47.417848 (+ 902us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:47.417854 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:47.417881 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:30:47.418035 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:47.418043 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.419687 (+ 1644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.419692 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:47.421229 (+ 1537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:47.421240 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.422348 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.422355 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:47.422587 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:47.422703 (+ 116us) client_negotiation.cc:769] Sending connection context
0809 15:30:47.422816 (+ 113us) client_negotiation.cc:240] Negotiation successful
0809 15:30:47.423060 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":223,"thread_start_us":103,"threads_started":1}
I20260809 15:30:47.423846 14279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:47.417146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:32913 (local address 127.0.0.1:55364)
0809 15:30:47.417457 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:47.417470 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:47.417554 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:47.418367 (+ 813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:47.418369 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:47.418382 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:30:47.418464 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:47.418470 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.419767 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.419773 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:47.421161 (+ 1388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:47.421172 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.422663 (+ 1491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.422668 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:47.422797 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:47.422828 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 15:30:47.422886 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 15:30:47.423620 (+ 734us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"mutex_wait_us":644,"thread_start_us":103,"threads_started":1}
I20260809 15:30:47.424482 14281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:47.417447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55364 (local address 127.11.146.2:32913)
0809 15:30:47.417895 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:47.417906 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:47.417928 (+ 22us) server_negotiation.cc:407] Connection header received
0809 15:30:47.418017 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:47.418023 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:47.418216 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:47.418619 (+ 403us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:30:47.418725 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.419448 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.421291 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.422509 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.423096 (+ 587us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:47.423286 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:47.423351 (+ 65us) server_negotiation.cc:299] Negotiation successful
0809 15:30:47.424294 (+ 943us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":113,"threads_started":1}
I20260809 15:30:47.425549 14277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:47.416587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37014 (local address 127.11.146.3:43489)
0809 15:30:47.417300 (+ 713us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:47.417313 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:47.417338 (+ 25us) server_negotiation.cc:407] Connection header received
0809 15:30:47.417422 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:47.417427 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:47.417673 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:47.418197 (+ 524us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:30:47.418341 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.419508 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.421390 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.422183 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.422954 (+ 771us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:47.424246 (+ 1292us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:47.424306 (+ 60us) server_negotiation.cc:299] Negotiation successful
0809 15:30:47.424434 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":102,"threads_started":1}
I20260809 15:30:47.423244 14278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:47.416860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:39425 (local address 127.0.0.1:37334)
0809 15:30:47.417541 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:47.417560 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:47.417656 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:47.418286 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:47.418292 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:47.418315 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:30:47.418467 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:47.418472 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.419807 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.419810 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:47.421330 (+ 1520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:47.421339 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.422404 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.422407 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:47.422590 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:47.422703 (+ 113us) client_negotiation.cc:769] Sending connection context
0809 15:30:47.422816 (+ 113us) client_negotiation.cc:240] Negotiation successful
0809 15:30:47.423059 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"mutex_wait_us":314,"thread_start_us":102,"threads_started":1}
I20260809 15:30:47.427449 14280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:47.417271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37334 (local address 127.11.146.1:39425)
0809 15:30:47.417819 (+ 548us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:47.417825 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:47.417846 (+ 21us) server_negotiation.cc:407] Connection header received
0809 15:30:47.417914 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:47.417919 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:47.418120 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:47.418280 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:30:47.418588 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.419642 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.421455 (+ 1813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.422283 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.422951 (+ 668us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:47.427158 (+ 4207us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:47.427215 (+ 57us) server_negotiation.cc:299] Negotiation successful
0809 15:30:47.427317 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":91,"threads_started":1}
I20260809 15:30:47.428398 14191 tablet_service.cc:1467] Processing CreateTablet for tablet eb26ebc5b7f6448e9d25a662d025df26 (DEFAULT_TABLE table=test-table [id=64cc9b66fb03453990d03d57ad361863]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:30:47.428382 14043 tablet_service.cc:1467] Processing CreateTablet for tablet eb26ebc5b7f6448e9d25a662d025df26 (DEFAULT_TABLE table=test-table [id=64cc9b66fb03453990d03d57ad361863]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:30:47.429592 14191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb26ebc5b7f6448e9d25a662d025df26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:30:47.429581 14043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb26ebc5b7f6448e9d25a662d025df26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:30:47.430891 13898 tablet_service.cc:1467] Processing CreateTablet for tablet eb26ebc5b7f6448e9d25a662d025df26 (DEFAULT_TABLE table=test-table [id=64cc9b66fb03453990d03d57ad361863]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:30:47.432149 13898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb26ebc5b7f6448e9d25a662d025df26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:30:47.437973 14282 tablet_bootstrap.cc:492] T eb26ebc5b7f6448e9d25a662d025df26 P 9ac945e1feb447e5a5a7e4363e90ab09: Bootstrap starting.
I20260809 15:30:47.438589 14283 tablet_bootstrap.cc:492] T eb26ebc5b7f6448e9d25a662d025df26 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Bootstrap starting.
I20260809 15:30:47.439113 14284 tablet_bootstrap.cc:492] T eb26ebc5b7f6448e9d25a662d025df26 P fe9090c0b8254c3397a68508dd7450d3: Bootstrap starting.
I20260809 15:30:47.440645 14283 tablet_bootstrap.cc:654] T eb26ebc5b7f6448e9d25a662d025df26 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Neither blocks nor log segments found. Creating new log.
I20260809 15:30:47.440645 14282 tablet_bootstrap.cc:654] T eb26ebc5b7f6448e9d25a662d025df26 P 9ac945e1feb447e5a5a7e4363e90ab09: Neither blocks nor log segments found. Creating new log.
I20260809 15:30:47.441254 14284 tablet_bootstrap.cc:654] T eb26ebc5b7f6448e9d25a662d025df26 P fe9090c0b8254c3397a68508dd7450d3: Neither blocks nor log segments found. Creating new log.
I20260809 15:30:47.441581 14283 log.cc:824] T eb26ebc5b7f6448e9d25a662d025df26 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Log is configured to *not* fsync() on all Append() calls
I20260809 15:30:47.441637 14282 log.cc:824] T eb26ebc5b7f6448e9d25a662d025df26 P 9ac945e1feb447e5a5a7e4363e90ab09: Log is configured to *not* fsync() on all Append() calls
I20260809 15:30:47.442152 14284 log.cc:824] T eb26ebc5b7f6448e9d25a662d025df26 P fe9090c0b8254c3397a68508dd7450d3: Log is configured to *not* fsync() on all Append() calls
I20260809 15:30:47.443871 14283 tablet_bootstrap.cc:492] T eb26ebc5b7f6448e9d25a662d025df26 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: No bootstrap required, opened a new log
I20260809 15:30:47.444224 14284 tablet_bootstrap.cc:492] T eb26ebc5b7f6448e9d25a662d025df26 P fe9090c0b8254c3397a68508dd7450d3: No bootstrap required, opened a new log
I20260809 15:30:47.444250 14283 ts_tablet_manager.cc:1397] T eb26ebc5b7f6448e9d25a662d025df26 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 15:30:47.444419 14284 ts_tablet_manager.cc:1397] T eb26ebc5b7f6448e9d25a662d025df26 P fe9090c0b8254c3397a68508dd7450d3: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.004s
I20260809 15:30:47.446107 14282 tablet_bootstrap.cc:492] T eb26ebc5b7f6448e9d25a662d025df26 P 9ac945e1feb447e5a5a7e4363e90ab09: No bootstrap required, opened a new log
I20260809 15:30:47.446394 14282 ts_tablet_manager.cc:1397] T eb26ebc5b7f6448e9d25a662d025df26 P 9ac945e1feb447e5a5a7e4363e90ab09: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260809 15:30:47.449314 14283 raft_consensus.cc:348] T eb26ebc5b7f6448e9d25a662d025df26 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } }
I20260809 15:30:47.449368 14284 raft_consensus.cc:348] T eb26ebc5b7f6448e9d25a662d025df26 P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } }
I20260809 15:30:47.449640 14284 raft_consensus.cc:374] T eb26ebc5b7f6448e9d25a662d025df26 P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:30:47.449695 14284 raft_consensus.cc:729] T eb26ebc5b7f6448e9d25a662d025df26 P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9090c0b8254c3397a68508dd7450d3, State: Initialized, Role: FOLLOWER
I20260809 15:30:47.449774 14283 raft_consensus.cc:374] T eb26ebc5b7f6448e9d25a662d025df26 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:30:47.449855 14283 raft_consensus.cc:729] T eb26ebc5b7f6448e9d25a662d025df26 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f0f8ae3a1ba4cd6b191651cee5c9fe0, State: Initialized, Role: FOLLOWER
I20260809 15:30:47.450171 14284 consensus_queue.cc:260] T eb26ebc5b7f6448e9d25a662d025df26 P fe9090c0b8254c3397a68508dd7450d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } }
I20260809 15:30:47.450371 14283 consensus_queue.cc:260] T eb26ebc5b7f6448e9d25a662d025df26 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } }
I20260809 15:30:47.450884 13966 heartbeater.cc:503] Master 127.11.146.62:43335 was elected leader, sending a full tablet report...
I20260809 15:30:47.451082 14282 raft_consensus.cc:348] T eb26ebc5b7f6448e9d25a662d025df26 P 9ac945e1feb447e5a5a7e4363e90ab09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } }
I20260809 15:30:47.451378 14282 raft_consensus.cc:374] T eb26ebc5b7f6448e9d25a662d025df26 P 9ac945e1feb447e5a5a7e4363e90ab09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:30:47.451471 14282 raft_consensus.cc:729] T eb26ebc5b7f6448e9d25a662d025df26 P 9ac945e1feb447e5a5a7e4363e90ab09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ac945e1feb447e5a5a7e4363e90ab09, State: Initialized, Role: FOLLOWER
I20260809 15:30:47.451519 14283 ts_tablet_manager.cc:1428] T eb26ebc5b7f6448e9d25a662d025df26 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260809 15:30:47.451907 14113 heartbeater.cc:503] Master 127.11.146.62:43335 was elected leader, sending a full tablet report...
I20260809 15:30:47.452064 14282 consensus_queue.cc:260] T eb26ebc5b7f6448e9d25a662d025df26 P 9ac945e1feb447e5a5a7e4363e90ab09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } }
I20260809 15:30:47.452525 14284 ts_tablet_manager.cc:1428] T eb26ebc5b7f6448e9d25a662d025df26 P fe9090c0b8254c3397a68508dd7450d3: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260809 15:30:47.453106 14258 heartbeater.cc:503] Master 127.11.146.62:43335 was elected leader, sending a full tablet report...
I20260809 15:30:47.454177 14282 ts_tablet_manager.cc:1428] T eb26ebc5b7f6448e9d25a662d025df26 P 9ac945e1feb447e5a5a7e4363e90ab09: Time spent starting tablet: real 0.008s user 0.002s sys 0.004s
I20260809 15:30:47.539014 14289 raft_consensus.cc:482] T eb26ebc5b7f6448e9d25a662d025df26 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:30:47.539242 14289 raft_consensus.cc:504] T eb26ebc5b7f6448e9d25a662d025df26 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } }
I20260809 15:30:47.540516 14289 leader_election.cc:288] T eb26ebc5b7f6448e9d25a662d025df26 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ac945e1feb447e5a5a7e4363e90ab09 (127.11.146.3:43489), fe9090c0b8254c3397a68508dd7450d3 (127.11.146.1:39425)
I20260809 15:30:47.544922 14000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:47.540855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:39425 (local address 127.11.146.2:33227)
0809 15:30:47.541086 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:47.541102 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:47.541209 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:47.541543 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:47.541546 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:47.541562 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:30:47.541703 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:47.541710 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.542532 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.542535 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:47.543641 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:47.543652 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.544488 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.544491 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:47.544606 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:47.544629 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 15:30:47.544697 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 15:30:47.544758 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"mutex_wait_us":29}
I20260809 15:30:47.545030 14280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:47.540958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:33227 (local address 127.11.146.1:39425)
0809 15:30:47.541159 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:47.541164 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:47.541183 (+ 19us) server_negotiation.cc:407] Connection header received
0809 15:30:47.541339 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:47.541341 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:47.541387 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:47.541513 (+ 126us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:30:47.541829 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.542390 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.543781 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.544357 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.544482 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:47.544539 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:47.544765 (+ 226us) server_negotiation.cc:299] Negotiation successful
0809 15:30:47.544880 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260809 15:30:47.545645 14277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:47.540965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:41913 (local address 127.11.146.3:43489)
0809 15:30:47.541115 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:47.541122 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:47.541454 (+ 332us) server_negotiation.cc:407] Connection header received
0809 15:30:47.541542 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:47.541545 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:47.541588 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:47.541671 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:30:47.542332 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.542914 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.544221 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.544963 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.545093 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:47.545145 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:47.545471 (+ 326us) server_negotiation.cc:299] Negotiation successful
0809 15:30:47.545540 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 15:30:47.545671 14292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:47.540864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:43489 (local address 127.11.146.2:41913)
0809 15:30:47.541326 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:47.541338 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:47.541443 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:47.541694 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:47.541697 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:47.541710 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:30:47.542204 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:47.542212 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.543045 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.543049 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:47.544106 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:47.544115 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.545229 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.545233 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:47.545331 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:47.545361 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 15:30:47.545447 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 15:30:47.545515 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":393,"mutex_wait_us":64,"thread_start_us":130,"threads_started":1}
I20260809 15:30:47.545684 13919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb26ebc5b7f6448e9d25a662d025df26" candidate_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9090c0b8254c3397a68508dd7450d3" is_pre_election: true
I20260809 15:30:47.546077 13919 raft_consensus.cc:2454] T eb26ebc5b7f6448e9d25a662d025df26 P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f0f8ae3a1ba4cd6b191651cee5c9fe0 in term 0.
I20260809 15:30:47.546372 14212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb26ebc5b7f6448e9d25a662d025df26" candidate_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" is_pre_election: true
I20260809 15:30:47.546687 14212 raft_consensus.cc:2454] T eb26ebc5b7f6448e9d25a662d025df26 P 9ac945e1feb447e5a5a7e4363e90ab09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f0f8ae3a1ba4cd6b191651cee5c9fe0 in term 0.
I20260809 15:30:47.546695 13994 leader_election.cc:302] T eb26ebc5b7f6448e9d25a662d025df26 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f0f8ae3a1ba4cd6b191651cee5c9fe0, fe9090c0b8254c3397a68508dd7450d3; no voters:
I20260809 15:30:47.546991 14289 raft_consensus.cc:2781] T eb26ebc5b7f6448e9d25a662d025df26 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:30:47.547101 14289 raft_consensus.cc:482] T eb26ebc5b7f6448e9d25a662d025df26 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:30:47.547163 14289 raft_consensus.cc:3037] T eb26ebc5b7f6448e9d25a662d025df26 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:30:47.548779 14289 raft_consensus.cc:504] T eb26ebc5b7f6448e9d25a662d025df26 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } }
I20260809 15:30:47.549252 14289 leader_election.cc:288] T eb26ebc5b7f6448e9d25a662d025df26 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [CANDIDATE]: Term 1 election: Requested vote from peers 9ac945e1feb447e5a5a7e4363e90ab09 (127.11.146.3:43489), fe9090c0b8254c3397a68508dd7450d3 (127.11.146.1:39425)
I20260809 15:30:47.549587 14212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb26ebc5b7f6448e9d25a662d025df26" candidate_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac945e1feb447e5a5a7e4363e90ab09"
I20260809 15:30:47.549746 14212 raft_consensus.cc:3037] T eb26ebc5b7f6448e9d25a662d025df26 P 9ac945e1feb447e5a5a7e4363e90ab09 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:30:47.549782 13919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb26ebc5b7f6448e9d25a662d025df26" candidate_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9090c0b8254c3397a68508dd7450d3"
I20260809 15:30:47.549904 13919 raft_consensus.cc:3037] T eb26ebc5b7f6448e9d25a662d025df26 P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:30:47.551152 14212 raft_consensus.cc:2454] T eb26ebc5b7f6448e9d25a662d025df26 P 9ac945e1feb447e5a5a7e4363e90ab09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f0f8ae3a1ba4cd6b191651cee5c9fe0 in term 1.
I20260809 15:30:47.551152 13919 raft_consensus.cc:2454] T eb26ebc5b7f6448e9d25a662d025df26 P fe9090c0b8254c3397a68508dd7450d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f0f8ae3a1ba4cd6b191651cee5c9fe0 in term 1.
I20260809 15:30:47.551527 13995 leader_election.cc:302] T eb26ebc5b7f6448e9d25a662d025df26 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f0f8ae3a1ba4cd6b191651cee5c9fe0, 9ac945e1feb447e5a5a7e4363e90ab09; no voters:
I20260809 15:30:47.551859 14289 raft_consensus.cc:2781] T eb26ebc5b7f6448e9d25a662d025df26 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:30:47.552196 14289 raft_consensus.cc:686] T eb26ebc5b7f6448e9d25a662d025df26 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 1 LEADER]: Becoming Leader. State: Replica: 1f0f8ae3a1ba4cd6b191651cee5c9fe0, State: Running, Role: LEADER
I20260809 15:30:47.552544 14289 consensus_queue.cc:237] T eb26ebc5b7f6448e9d25a662d025df26 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } }
I20260809 15:30:47.555974 13755 catalog_manager.cc:5495] T eb26ebc5b7f6448e9d25a662d025df26 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f0f8ae3a1ba4cd6b191651cee5c9fe0 (127.11.146.2). New cstate: current_term: 1 leader_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } health_report { overall_health: UNKNOWN } } }
W20260809 15:30:47.606467 14259 tablet.cc:2369] T eb26ebc5b7f6448e9d25a662d025df26 P 9ac945e1feb447e5a5a7e4363e90ab09: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 15:30:47 dist-test-slave-1jjb krb5kdc[13708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289446, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:30:47.616894 14300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:47.606299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43335 (local address 127.0.0.1:50820)
0809 15:30:47.606707 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:47.606727 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:47.606883 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:47.607226 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:47.607229 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:47.607798 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:30:47.607912 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:47.607919 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.609162 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.609164 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:47.609863 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:47.609874 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.610474 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.610477 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:47.610547 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:47.611230 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:30:47.611242 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:30:47.612998 (+ 1756us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:30:47.615073 (+ 2075us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:47.615082 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:47.615088 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:47.615328 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:47.615698 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:47.615701 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:47.615702 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:47.615796 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:47.616299 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:30:47.616305 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:30:47.616453 (+ 148us) client_negotiation.cc:769] Sending connection context
0809 15:30:47.616572 (+ 119us) client_negotiation.cc:240] Negotiation successful
0809 15:30:47.616742 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":93,"threads_started":1}
I20260809 15:30:47.617056 13805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:47.606433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50820 (local address 127.11.146.62:43335)
0809 15:30:47.606606 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:47.606613 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:47.606824 (+ 211us) server_negotiation.cc:407] Connection header received
0809 15:30:47.607018 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:47.607021 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:47.607068 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:47.607147 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:47.608064 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.609008 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.609986 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.610328 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.610425 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:47.613156 (+ 2731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:47.613161 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:47.613164 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:47.613190 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:47.614900 (+ 1710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:47.615439 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:47.615442 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:47.615444 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:47.615529 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:47.615894 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:47.615898 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:47.615899 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:47.616164 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:47.616259 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:47.616648 (+ 389us) server_negotiation.cc:299] Negotiation successful
0809 15:30:47.616839 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":51,"server-negotiator.queue_time_us":69}
W20260809 15:30:47.620378 14114 tablet.cc:2369] T eb26ebc5b7f6448e9d25a662d025df26 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:30:47.622996 13755 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:50820:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 15:30:47.623787 13755 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:30:47.629735 14043 tablet_service.cc:1467] Processing CreateTablet for tablet 440a4e2abd3d46d9b24e9b15caa9b1b6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=705488e885f749c086d0b770a27ad38c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 15:30:47.629801 14191 tablet_service.cc:1467] Processing CreateTablet for tablet 440a4e2abd3d46d9b24e9b15caa9b1b6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=705488e885f749c086d0b770a27ad38c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 15:30:47.629652 13898 tablet_service.cc:1467] Processing CreateTablet for tablet 440a4e2abd3d46d9b24e9b15caa9b1b6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=705488e885f749c086d0b770a27ad38c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 15:30:47.630476 14043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 440a4e2abd3d46d9b24e9b15caa9b1b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:30:47.630477 13898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 440a4e2abd3d46d9b24e9b15caa9b1b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:30:47.630477 14191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 440a4e2abd3d46d9b24e9b15caa9b1b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:30:47.633390 14283 tablet_bootstrap.cc:492] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Bootstrap starting.
I20260809 15:30:47.633806 14284 tablet_bootstrap.cc:492] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P fe9090c0b8254c3397a68508dd7450d3: Bootstrap starting.
I20260809 15:30:47.634341 14282 tablet_bootstrap.cc:492] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 9ac945e1feb447e5a5a7e4363e90ab09: Bootstrap starting.
I20260809 15:30:47.634584 14283 tablet_bootstrap.cc:654] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Neither blocks nor log segments found. Creating new log.
I20260809 15:30:47.634889 14284 tablet_bootstrap.cc:654] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P fe9090c0b8254c3397a68508dd7450d3: Neither blocks nor log segments found. Creating new log.
I20260809 15:30:47.635460 14282 tablet_bootstrap.cc:654] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 9ac945e1feb447e5a5a7e4363e90ab09: Neither blocks nor log segments found. Creating new log.
I20260809 15:30:47.636287 14283 tablet_bootstrap.cc:492] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: No bootstrap required, opened a new log
I20260809 15:30:47.636299 14284 tablet_bootstrap.cc:492] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P fe9090c0b8254c3397a68508dd7450d3: No bootstrap required, opened a new log
I20260809 15:30:47.636400 14283 ts_tablet_manager.cc:1397] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 15:30:47.636412 14284 ts_tablet_manager.cc:1397] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P fe9090c0b8254c3397a68508dd7450d3: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 15:30:47.636890 14282 tablet_bootstrap.cc:492] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 9ac945e1feb447e5a5a7e4363e90ab09: No bootstrap required, opened a new log
I20260809 15:30:47.636987 14282 ts_tablet_manager.cc:1397] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 9ac945e1feb447e5a5a7e4363e90ab09: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260809 15:30:47.636930 14283 raft_consensus.cc:348] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:47.637060 14283 raft_consensus.cc:374] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:30:47.637113 14283 raft_consensus.cc:729] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f0f8ae3a1ba4cd6b191651cee5c9fe0, State: Initialized, Role: FOLLOWER
I20260809 15:30:47.637156 14284 raft_consensus.cc:348] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:47.637251 14283 consensus_queue.cc:260] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:47.637291 14284 raft_consensus.cc:374] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:30:47.637346 14284 raft_consensus.cc:729] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9090c0b8254c3397a68508dd7450d3, State: Initialized, Role: FOLLOWER
I20260809 15:30:47.637476 14284 consensus_queue.cc:260] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P fe9090c0b8254c3397a68508dd7450d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:47.637611 14283 ts_tablet_manager.cc:1428] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 15:30:47.637462 14282 raft_consensus.cc:348] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 9ac945e1feb447e5a5a7e4363e90ab09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:47.637720 14282 raft_consensus.cc:374] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 9ac945e1feb447e5a5a7e4363e90ab09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:30:47.637780 14284 ts_tablet_manager.cc:1428] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P fe9090c0b8254c3397a68508dd7450d3: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260809 15:30:47.637781 14282 raft_consensus.cc:729] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 9ac945e1feb447e5a5a7e4363e90ab09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ac945e1feb447e5a5a7e4363e90ab09, State: Initialized, Role: FOLLOWER
I20260809 15:30:47.637923 14282 consensus_queue.cc:260] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 9ac945e1feb447e5a5a7e4363e90ab09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:47.637959 14289 tablet_replica.cc:439] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } } }
I20260809 15:30:47.638098 14289 tablet_replica.cc:442] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:30:47.638047 14288 tablet_replica.cc:439] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P fe9090c0b8254c3397a68508dd7450d3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } } }
I20260809 15:30:47.638185 14288 tablet_replica.cc:442] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P fe9090c0b8254c3397a68508dd7450d3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:30:47.638211 14282 ts_tablet_manager.cc:1428] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 9ac945e1feb447e5a5a7e4363e90ab09: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 15:30:47.638319 14291 tablet_replica.cc:439] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 9ac945e1feb447e5a5a7e4363e90ab09: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } } }
I20260809 15:30:47.638463 14291 tablet_replica.cc:442] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 9ac945e1feb447e5a5a7e4363e90ab09: This TxnStatusTablet replica's current role is: FOLLOWER
W20260809 15:30:47.642081 13967 tablet.cc:2369] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P fe9090c0b8254c3397a68508dd7450d3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:30:47.704811 14288 raft_consensus.cc:482] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:30:47.704994 14288 raft_consensus.cc:504] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:47.706173 14288 leader_election.cc:288] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P fe9090c0b8254c3397a68508dd7450d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f0f8ae3a1ba4cd6b191651cee5c9fe0 (127.11.146.2:32913), 9ac945e1feb447e5a5a7e4363e90ab09 (127.11.146.3:43489)
I20260809 15:30:47.711445 14281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:47.706679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:43605 (local address 127.11.146.2:32913)
0809 15:30:47.706819 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:47.706823 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:47.707069 (+ 246us) server_negotiation.cc:407] Connection header received
0809 15:30:47.707405 (+ 336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:47.707412 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:47.707474 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:47.707576 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:30:47.707985 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.708881 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.710259 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.710876 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.711002 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:47.711049 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:47.711284 (+ 235us) server_negotiation.cc:299] Negotiation successful
0809 15:30:47.711344 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 15:30:47.711509 14305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:47.706596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:32913 (local address 127.11.146.1:43605)
0809 15:30:47.706920 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:47.706938 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:47.707069 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:47.707652 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:47.707655 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:47.707682 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:30:47.707840 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:47.707847 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.709008 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.709012 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:47.710116 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:47.710126 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.711034 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.711038 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:47.711145 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:47.711173 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 15:30:47.711255 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 15:30:47.711332 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"mutex_wait_us":1,"thread_start_us":141,"threads_started":1}
I20260809 15:30:47.712056 14065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "440a4e2abd3d46d9b24e9b15caa9b1b6" candidate_uuid: "fe9090c0b8254c3397a68508dd7450d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" is_pre_election: true
I20260809 15:30:47.712229 14277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:47.707241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:35145 (local address 127.11.146.3:43489)
0809 15:30:47.707403 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:47.707406 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:47.707423 (+ 17us) server_negotiation.cc:407] Connection header received
0809 15:30:47.707658 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:47.707661 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:47.707714 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:47.707803 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:30:47.708829 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.709603 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.710990 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.711596 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.711719 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:47.711779 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:47.712020 (+ 241us) server_negotiation.cc:299] Negotiation successful
0809 15:30:47.712118 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 15:30:47.712246 14306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:47.707047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:43489 (local address 127.11.146.1:35145)
0809 15:30:47.707346 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:47.707363 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:47.707474 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:47.707838 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:47.707841 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:47.707879 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:30:47.708684 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:47.708696 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.709741 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.709744 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:47.710809 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:47.710827 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.711784 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.711789 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:47.711885 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:47.711902 (+ 17us) client_negotiation.cc:769] Sending connection context
0809 15:30:47.712003 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 15:30:47.712109 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"mutex_wait_us":32,"thread_start_us":97,"threads_started":1}
I20260809 15:30:47.712393 14065 raft_consensus.cc:2454] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9090c0b8254c3397a68508dd7450d3 in term 0.
I20260809 15:30:47.712795 14212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "440a4e2abd3d46d9b24e9b15caa9b1b6" candidate_uuid: "fe9090c0b8254c3397a68508dd7450d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" is_pre_election: true
I20260809 15:30:47.712942 14212 raft_consensus.cc:2454] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 9ac945e1feb447e5a5a7e4363e90ab09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9090c0b8254c3397a68508dd7450d3 in term 0.
I20260809 15:30:47.712920 13849 leader_election.cc:302] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P fe9090c0b8254c3397a68508dd7450d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f0f8ae3a1ba4cd6b191651cee5c9fe0, fe9090c0b8254c3397a68508dd7450d3; no voters:
I20260809 15:30:47.713274 14288 raft_consensus.cc:2781] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:30:47.713361 14288 raft_consensus.cc:482] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:30:47.713418 14288 raft_consensus.cc:3037] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:30:47.714452 14288 raft_consensus.cc:504] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P fe9090c0b8254c3397a68508dd7450d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:47.714808 14288 leader_election.cc:288] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P fe9090c0b8254c3397a68508dd7450d3 [CANDIDATE]: Term 1 election: Requested vote from peers 1f0f8ae3a1ba4cd6b191651cee5c9fe0 (127.11.146.2:32913), 9ac945e1feb447e5a5a7e4363e90ab09 (127.11.146.3:43489)
I20260809 15:30:47.715433 14065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "440a4e2abd3d46d9b24e9b15caa9b1b6" candidate_uuid: "fe9090c0b8254c3397a68508dd7450d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0"
I20260809 15:30:47.715463 14212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "440a4e2abd3d46d9b24e9b15caa9b1b6" candidate_uuid: "fe9090c0b8254c3397a68508dd7450d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac945e1feb447e5a5a7e4363e90ab09"
I20260809 15:30:47.715756 14212 raft_consensus.cc:3037] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 9ac945e1feb447e5a5a7e4363e90ab09 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:30:47.715756 14065 raft_consensus.cc:3037] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:30:47.717002 14065 raft_consensus.cc:2454] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9090c0b8254c3397a68508dd7450d3 in term 1.
I20260809 15:30:47.717010 14212 raft_consensus.cc:2454] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 9ac945e1feb447e5a5a7e4363e90ab09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9090c0b8254c3397a68508dd7450d3 in term 1.
I20260809 15:30:47.717311 13849 leader_election.cc:302] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P fe9090c0b8254c3397a68508dd7450d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac945e1feb447e5a5a7e4363e90ab09, fe9090c0b8254c3397a68508dd7450d3; no voters:
I20260809 15:30:47.717507 14288 raft_consensus.cc:2781] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P fe9090c0b8254c3397a68508dd7450d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:30:47.717777 14288 raft_consensus.cc:686] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P fe9090c0b8254c3397a68508dd7450d3 [term 1 LEADER]: Becoming Leader. State: Replica: fe9090c0b8254c3397a68508dd7450d3, State: Running, Role: LEADER
I20260809 15:30:47.718137 14288 consensus_queue.cc:237] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P fe9090c0b8254c3397a68508dd7450d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:47.720836 14307 tablet_replica.cc:439] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P fe9090c0b8254c3397a68508dd7450d3: TxnStatusTablet state changed. Reason: New leader fe9090c0b8254c3397a68508dd7450d3. Latest consensus state: current_term: 1 leader_uuid: "fe9090c0b8254c3397a68508dd7450d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } } }
I20260809 15:30:47.720961 14307 tablet_replica.cc:442] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P fe9090c0b8254c3397a68508dd7450d3: This TxnStatusTablet replica's current role is: LEADER
I20260809 15:30:47.721273 14309 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 15:30:47.721490 14309 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 15:30:47.722055 13755 catalog_manager.cc:5495] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P fe9090c0b8254c3397a68508dd7450d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe9090c0b8254c3397a68508dd7450d3 (127.11.146.1). New cstate: current_term: 1 leader_uuid: "fe9090c0b8254c3397a68508dd7450d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } health_report { overall_health: UNKNOWN } } }
I20260809 15:30:47.747180 14300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:47.742878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:39425 (local address 127.0.0.1:37346)
0809 15:30:47.743153 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:47.743171 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:47.743298 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:47.743655 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:47.743658 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:47.743665 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 15:30:47.743778 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:47.743791 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.744613 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.744617 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:47.745272 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:47.745286 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.745905 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.745908 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:47.745980 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:47.746034 (+ 54us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 15:30:47.746899 (+ 865us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 15:30:47.746917 (+ 18us) client_negotiation.cc:769] Sending connection context
0809 15:30:47.746986 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 15:30:47.747058 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163}
I20260809 15:30:47.747215 14280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:47.742994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37346 (local address 127.11.146.1:39425)
0809 15:30:47.743151 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:47.743156 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:47.743222 (+ 66us) server_negotiation.cc:407] Connection header received
0809 15:30:47.743453 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:47.743457 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:47.743527 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:47.743636 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:30:47.743898 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.744490 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.745407 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.745772 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.745885 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:47.746178 (+ 293us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:30:47.746728 (+ 550us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:30:47.746848 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:47.747023 (+ 175us) server_negotiation.cc:299] Negotiation successful
0809 15:30:47.747080 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 15:30:47.753052 14212 raft_consensus.cc:1261] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 9ac945e1feb447e5a5a7e4363e90ab09 [term 1 FOLLOWER]: Refusing update from remote peer fe9090c0b8254c3397a68508dd7450d3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:30:47.753052 14065 raft_consensus.cc:1261] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 1 FOLLOWER]: Refusing update from remote peer fe9090c0b8254c3397a68508dd7450d3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:30:47.753748 14288 consensus_queue.cc:1035] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P fe9090c0b8254c3397a68508dd7450d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:30:47.754020 14307 consensus_queue.cc:1035] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P fe9090c0b8254c3397a68508dd7450d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:30:47.757251 14289 tablet_replica.cc:439] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: TxnStatusTablet state changed. Reason: New leader fe9090c0b8254c3397a68508dd7450d3. Latest consensus state: current_term: 1 leader_uuid: "fe9090c0b8254c3397a68508dd7450d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } } }
I20260809 15:30:47.757375 14289 tablet_replica.cc:442] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:30:47.758103 14291 tablet_replica.cc:439] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 9ac945e1feb447e5a5a7e4363e90ab09: TxnStatusTablet state changed. Reason: New leader fe9090c0b8254c3397a68508dd7450d3. Latest consensus state: current_term: 1 leader_uuid: "fe9090c0b8254c3397a68508dd7450d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } } }
I20260809 15:30:47.758241 14291 tablet_replica.cc:442] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 9ac945e1feb447e5a5a7e4363e90ab09: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:30:47.761591 14307 tablet_replica.cc:439] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P fe9090c0b8254c3397a68508dd7450d3: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fe9090c0b8254c3397a68508dd7450d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } } }
I20260809 15:30:47.761718 14307 tablet_replica.cc:442] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P fe9090c0b8254c3397a68508dd7450d3: This TxnStatusTablet replica's current role is: LEADER
I20260809 15:30:47.762177 14291 tablet_replica.cc:439] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 9ac945e1feb447e5a5a7e4363e90ab09: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fe9090c0b8254c3397a68508dd7450d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } } }
I20260809 15:30:47.762295 14291 tablet_replica.cc:442] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 9ac945e1feb447e5a5a7e4363e90ab09: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:30:47.762591 14312 mvcc.cc:205] Tried to move back new op lower bound from 7316641577988792320 to 7316641577856139264. Current Snapshot: MvccSnapshot[applied={T|T < 7316641577988792320}]
I20260809 15:30:47.763514 14307 tablet_replica.cc:439] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P fe9090c0b8254c3397a68508dd7450d3: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fe9090c0b8254c3397a68508dd7450d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } } }
I20260809 15:30:47.763614 14307 tablet_replica.cc:442] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P fe9090c0b8254c3397a68508dd7450d3: This TxnStatusTablet replica's current role is: LEADER
I20260809 15:30:47.764904 14289 tablet_replica.cc:439] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fe9090c0b8254c3397a68508dd7450d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } } }
I20260809 15:30:47.765017 14289 tablet_replica.cc:442] T 440a4e2abd3d46d9b24e9b15caa9b1b6 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:30:47.765146 14313 mvcc.cc:205] Tried to move back new op lower bound from 7316641577988792320 to 7316641577856139264. Current Snapshot: MvccSnapshot[applied={T|T < 7316641577988792320}]
I20260809 15:30:47.776008 14281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:47.772000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55380 (local address 127.11.146.2:32913)
0809 15:30:47.772132 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:47.772136 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:47.772150 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:30:47.772226 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:47.772228 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:47.772281 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:47.772366 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:30:47.772665 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.773190 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.774446 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.774663 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.774751 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:47.775076 (+ 325us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:30:47.775496 (+ 420us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:30:47.775732 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:47.775793 (+ 61us) server_negotiation.cc:299] Negotiation successful
0809 15:30:47.775843 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 15:30:47.788120 14280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:47.784506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:35889 (local address 127.11.146.1:39425)
0809 15:30:47.784666 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:47.784671 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:47.784824 (+ 153us) server_negotiation.cc:407] Connection header received
0809 15:30:47.785017 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:47.785021 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:47.785095 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:47.785183 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:30:47.785463 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.785992 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.786883 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.787135 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.787253 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:47.787597 (+ 344us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:30:47.787682 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:30:47.787764 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:47.787886 (+ 122us) server_negotiation.cc:299] Negotiation successful
0809 15:30:47.787937 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 15:30:47.788129 14324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:47.784349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:39425 (local address 127.11.146.2:35889)
0809 15:30:47.784731 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:47.784744 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:47.784912 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:47.785192 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:47.785196 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:47.785204 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 15:30:47.785349 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:47.785355 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.786117 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.786122 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:47.786758 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:47.786766 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.787277 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.787281 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:47.787378 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:47.787422 (+ 44us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 15:30:47.787772 (+ 350us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 15:30:47.787782 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 15:30:47.787871 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 15:30:47.787946 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":139,"threads_started":1}
I20260809 15:30:47.795724 13919 raft_consensus.cc:1261] T eb26ebc5b7f6448e9d25a662d025df26 P fe9090c0b8254c3397a68508dd7450d3 [term 1 FOLLOWER]: Refusing update from remote peer 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:30:47.796310 14212 raft_consensus.cc:1261] T eb26ebc5b7f6448e9d25a662d025df26 P 9ac945e1feb447e5a5a7e4363e90ab09 [term 1 FOLLOWER]: Refusing update from remote peer 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:30:47.796384 14289 consensus_queue.cc:1035] T eb26ebc5b7f6448e9d25a662d025df26 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:30:47.796737 14293 consensus_queue.cc:1035] T eb26ebc5b7f6448e9d25a662d025df26 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:30:47.804366 14314 mvcc.cc:205] Tried to move back new op lower bound from 7316641578166210560 to 7316641577177792512. Current Snapshot: MvccSnapshot[applied={T|T < 7316641578166210560}]
I20260809 15:30:47.824184 14281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:47.820320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:49633 (local address 127.11.146.2:32913)
0809 15:30:47.820465 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:47.820471 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:47.820709 (+ 238us) server_negotiation.cc:407] Connection header received
0809 15:30:47.820817 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:47.820820 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:47.820880 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:47.820967 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:30:47.821418 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.821982 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.822910 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.823137 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.823253 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:47.823621 (+ 368us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:30:47.823716 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:30:47.823766 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:47.823940 (+ 174us) server_negotiation.cc:299] Negotiation successful
0809 15:30:47.824003 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 15:30:47.824759 14330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:47.820138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:32913 (local address 127.11.146.1:49633)
0809 15:30:47.820547 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:47.820562 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:47.820718 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:47.821090 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:47.821092 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:47.821099 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 15:30:47.821267 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:47.821275 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.822155 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.822157 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:47.822780 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:47.822787 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:47.823256 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:47.823259 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:47.823394 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:47.823460 (+ 66us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 15:30:47.823834 (+ 374us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 15:30:47.823839 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 15:30:47.824487 (+ 648us) client_negotiation.cc:240] Negotiation successful
0809 15:30:47.824580 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":112,"threads_started":1}
I20260809 15:30:47.851735 13753 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50818:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:30:47.851950 13753 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50818:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:30:47.855223 13753 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 80459e49beab434085c62eb57e94206c: Sending DeleteTablet for 3 replicas of tablet eb26ebc5b7f6448e9d25a662d025df26
I20260809 15:30:47.856534 13898 tablet_service.cc:1514] Processing DeleteTablet for tablet eb26ebc5b7f6448e9d25a662d025df26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:30:47 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:37334
I20260809 15:30:47.856935 14191 tablet_service.cc:1514] Processing DeleteTablet for tablet eb26ebc5b7f6448e9d25a662d025df26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:30:47 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:37014
I20260809 15:30:47.857395 14043 tablet_service.cc:1514] Processing DeleteTablet for tablet eb26ebc5b7f6448e9d25a662d025df26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:30:47 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:55364
I20260809 15:30:47.858088 14334 tablet_replica.cc:330] T eb26ebc5b7f6448e9d25a662d025df26 P 9ac945e1feb447e5a5a7e4363e90ab09: stopping tablet replica
I20260809 15:30:47.858345 14335 tablet_replica.cc:330] T eb26ebc5b7f6448e9d25a662d025df26 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: stopping tablet replica
I20260809 15:30:47.858743 14335 raft_consensus.cc:2229] T eb26ebc5b7f6448e9d25a662d025df26 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:30:47.858677 13753 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50818:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:30:47.859146 13753 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:30:47.859630 14335 raft_consensus.cc:2258] T eb26ebc5b7f6448e9d25a662d025df26 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:30:47.861393 14335 ts_tablet_manager.cc:1905] T eb26ebc5b7f6448e9d25a662d025df26 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:30:47.861769 14334 raft_consensus.cc:2229] T eb26ebc5b7f6448e9d25a662d025df26 P 9ac945e1feb447e5a5a7e4363e90ab09 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:30:47.862052 14334 raft_consensus.cc:2258] T eb26ebc5b7f6448e9d25a662d025df26 P 9ac945e1feb447e5a5a7e4363e90ab09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:30:47.866756 14334 ts_tablet_manager.cc:1905] T eb26ebc5b7f6448e9d25a662d025df26 P 9ac945e1feb447e5a5a7e4363e90ab09: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:30:47.867233 14043 tablet_service.cc:1467] Processing CreateTablet for tablet 949126a32edf4c4ab6d61461d2ca981b (DEFAULT_TABLE table=test-table [id=64dbbbb10c1c4d0caf3dedbab6e0f204]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:30:47.867491 14043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 949126a32edf4c4ab6d61461d2ca981b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:30:47.868217 13898 tablet_service.cc:1467] Processing CreateTablet for tablet 949126a32edf4c4ab6d61461d2ca981b (DEFAULT_TABLE table=test-table [id=64dbbbb10c1c4d0caf3dedbab6e0f204]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:30:47.868535 13898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 949126a32edf4c4ab6d61461d2ca981b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:30:47.869935 14191 tablet_service.cc:1467] Processing CreateTablet for tablet 949126a32edf4c4ab6d61461d2ca981b (DEFAULT_TABLE table=test-table [id=64dbbbb10c1c4d0caf3dedbab6e0f204]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:30:47.870255 14283 tablet_bootstrap.cc:492] T 949126a32edf4c4ab6d61461d2ca981b P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Bootstrap starting.
I20260809 15:30:47.871202 14283 tablet_bootstrap.cc:654] T 949126a32edf4c4ab6d61461d2ca981b P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Neither blocks nor log segments found. Creating new log.
I20260809 15:30:47.872232 14191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 949126a32edf4c4ab6d61461d2ca981b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:30:47.872555 14284 tablet_bootstrap.cc:492] T 949126a32edf4c4ab6d61461d2ca981b P fe9090c0b8254c3397a68508dd7450d3: Bootstrap starting.
I20260809 15:30:47.874004 14284 tablet_bootstrap.cc:654] T 949126a32edf4c4ab6d61461d2ca981b P fe9090c0b8254c3397a68508dd7450d3: Neither blocks nor log segments found. Creating new log.
I20260809 15:30:47.874585 14282 tablet_bootstrap.cc:492] T 949126a32edf4c4ab6d61461d2ca981b P 9ac945e1feb447e5a5a7e4363e90ab09: Bootstrap starting.
I20260809 15:30:47.875430 14282 tablet_bootstrap.cc:654] T 949126a32edf4c4ab6d61461d2ca981b P 9ac945e1feb447e5a5a7e4363e90ab09: Neither blocks nor log segments found. Creating new log.
I20260809 15:30:47.876466 14284 tablet_bootstrap.cc:492] T 949126a32edf4c4ab6d61461d2ca981b P fe9090c0b8254c3397a68508dd7450d3: No bootstrap required, opened a new log
I20260809 15:30:47.876566 14284 ts_tablet_manager.cc:1397] T 949126a32edf4c4ab6d61461d2ca981b P fe9090c0b8254c3397a68508dd7450d3: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260809 15:30:47.877065 14284 raft_consensus.cc:348] T 949126a32edf4c4ab6d61461d2ca981b P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:47.877194 14284 raft_consensus.cc:374] T 949126a32edf4c4ab6d61461d2ca981b P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:30:47.877238 14284 raft_consensus.cc:729] T 949126a32edf4c4ab6d61461d2ca981b P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9090c0b8254c3397a68508dd7450d3, State: Initialized, Role: FOLLOWER
I20260809 15:30:47.877363 14284 consensus_queue.cc:260] T 949126a32edf4c4ab6d61461d2ca981b P fe9090c0b8254c3397a68508dd7450d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:47.877651 14284 ts_tablet_manager.cc:1428] T 949126a32edf4c4ab6d61461d2ca981b P fe9090c0b8254c3397a68508dd7450d3: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 15:30:47.879370 14334 ts_tablet_manager.cc:1918] T eb26ebc5b7f6448e9d25a662d025df26 P 9ac945e1feb447e5a5a7e4363e90ab09: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 15:30:47.879524 14334 log.cc:1196] T eb26ebc5b7f6448e9d25a662d025df26 P 9ac945e1feb447e5a5a7e4363e90ab09: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-2/wal/wals/eb26ebc5b7f6448e9d25a662d025df26
I20260809 15:30:47.879935 14334 ts_tablet_manager.cc:1939] T eb26ebc5b7f6448e9d25a662d025df26 P 9ac945e1feb447e5a5a7e4363e90ab09: Deleting consensus metadata
I20260809 15:30:47.880648 14333 tablet_replica.cc:330] T eb26ebc5b7f6448e9d25a662d025df26 P fe9090c0b8254c3397a68508dd7450d3: stopping tablet replica
I20260809 15:30:47.880995 14333 raft_consensus.cc:2229] T eb26ebc5b7f6448e9d25a662d025df26 P fe9090c0b8254c3397a68508dd7450d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:30:47.881122 14335 ts_tablet_manager.cc:1918] T eb26ebc5b7f6448e9d25a662d025df26 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 15:30:47.881188 14333 raft_consensus.cc:2258] T eb26ebc5b7f6448e9d25a662d025df26 P fe9090c0b8254c3397a68508dd7450d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:30:47.881307 14335 log.cc:1196] T eb26ebc5b7f6448e9d25a662d025df26 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-1/wal/wals/eb26ebc5b7f6448e9d25a662d025df26
I20260809 15:30:47.881685 14335 ts_tablet_manager.cc:1939] T eb26ebc5b7f6448e9d25a662d025df26 P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Deleting consensus metadata
I20260809 15:30:47.882460 13740 catalog_manager.cc:4841] TS 9ac945e1feb447e5a5a7e4363e90ab09 (127.11.146.3:43489): tablet eb26ebc5b7f6448e9d25a662d025df26 (table test-table [id=64cc9b66fb03453990d03d57ad361863]) successfully deleted
I20260809 15:30:47.883080 14282 tablet_bootstrap.cc:492] T 949126a32edf4c4ab6d61461d2ca981b P 9ac945e1feb447e5a5a7e4363e90ab09: No bootstrap required, opened a new log
I20260809 15:30:47.883167 14282 ts_tablet_manager.cc:1397] T 949126a32edf4c4ab6d61461d2ca981b P 9ac945e1feb447e5a5a7e4363e90ab09: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.002s
I20260809 15:30:47.883594 14282 raft_consensus.cc:348] T 949126a32edf4c4ab6d61461d2ca981b P 9ac945e1feb447e5a5a7e4363e90ab09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:47.883699 14282 raft_consensus.cc:374] T 949126a32edf4c4ab6d61461d2ca981b P 9ac945e1feb447e5a5a7e4363e90ab09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:30:47.883729 14282 raft_consensus.cc:729] T 949126a32edf4c4ab6d61461d2ca981b P 9ac945e1feb447e5a5a7e4363e90ab09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ac945e1feb447e5a5a7e4363e90ab09, State: Initialized, Role: FOLLOWER
I20260809 15:30:47.883847 14282 consensus_queue.cc:260] T 949126a32edf4c4ab6d61461d2ca981b P 9ac945e1feb447e5a5a7e4363e90ab09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:47.884141 14282 ts_tablet_manager.cc:1428] T 949126a32edf4c4ab6d61461d2ca981b P 9ac945e1feb447e5a5a7e4363e90ab09: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 15:30:47.884261 14333 ts_tablet_manager.cc:1905] T eb26ebc5b7f6448e9d25a662d025df26 P fe9090c0b8254c3397a68508dd7450d3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:30:47.885603 14283 tablet_bootstrap.cc:492] T 949126a32edf4c4ab6d61461d2ca981b P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: No bootstrap required, opened a new log
I20260809 15:30:47.885990 14283 ts_tablet_manager.cc:1397] T 949126a32edf4c4ab6d61461d2ca981b P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20260809 15:30:47.886461 14283 raft_consensus.cc:348] T 949126a32edf4c4ab6d61461d2ca981b P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:47.886577 14283 raft_consensus.cc:374] T 949126a32edf4c4ab6d61461d2ca981b P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:30:47.886608 14283 raft_consensus.cc:729] T 949126a32edf4c4ab6d61461d2ca981b P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f0f8ae3a1ba4cd6b191651cee5c9fe0, State: Initialized, Role: FOLLOWER
I20260809 15:30:47.886734 14283 consensus_queue.cc:260] T 949126a32edf4c4ab6d61461d2ca981b P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:47.886970 14283 ts_tablet_manager.cc:1428] T 949126a32edf4c4ab6d61461d2ca981b P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 15:30:47.888317 14333 ts_tablet_manager.cc:1918] T eb26ebc5b7f6448e9d25a662d025df26 P fe9090c0b8254c3397a68508dd7450d3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 15:30:47.888406 14333 log.cc:1196] T eb26ebc5b7f6448e9d25a662d025df26 P fe9090c0b8254c3397a68508dd7450d3: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-0/wal/wals/eb26ebc5b7f6448e9d25a662d025df26
I20260809 15:30:47.889650 14333 ts_tablet_manager.cc:1939] T eb26ebc5b7f6448e9d25a662d025df26 P fe9090c0b8254c3397a68508dd7450d3: Deleting consensus metadata
I20260809 15:30:47.890209 13740 catalog_manager.cc:4841] TS 1f0f8ae3a1ba4cd6b191651cee5c9fe0 (127.11.146.2:32913): tablet eb26ebc5b7f6448e9d25a662d025df26 (table test-table [id=64cc9b66fb03453990d03d57ad361863]) successfully deleted
I20260809 15:30:47.890761 13739 catalog_manager.cc:4841] TS fe9090c0b8254c3397a68508dd7450d3 (127.11.146.1:39425): tablet eb26ebc5b7f6448e9d25a662d025df26 (table test-table [id=64cc9b66fb03453990d03d57ad361863]) successfully deleted
I20260809 15:30:48.020985 14319 raft_consensus.cc:482] T 949126a32edf4c4ab6d61461d2ca981b P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:30:48.021132 14319 raft_consensus.cc:504] T 949126a32edf4c4ab6d61461d2ca981b P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:48.021744 14319 leader_election.cc:288] T 949126a32edf4c4ab6d61461d2ca981b P fe9090c0b8254c3397a68508dd7450d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f0f8ae3a1ba4cd6b191651cee5c9fe0 (127.11.146.2:32913), 9ac945e1feb447e5a5a7e4363e90ab09 (127.11.146.3:43489)
I20260809 15:30:48.022369 14065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "949126a32edf4c4ab6d61461d2ca981b" candidate_uuid: "fe9090c0b8254c3397a68508dd7450d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" is_pre_election: true
I20260809 15:30:48.022356 14212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "949126a32edf4c4ab6d61461d2ca981b" candidate_uuid: "fe9090c0b8254c3397a68508dd7450d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" is_pre_election: true
I20260809 15:30:48.022547 14065 raft_consensus.cc:2454] T 949126a32edf4c4ab6d61461d2ca981b P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9090c0b8254c3397a68508dd7450d3 in term 0.
I20260809 15:30:48.022558 14212 raft_consensus.cc:2454] T 949126a32edf4c4ab6d61461d2ca981b P 9ac945e1feb447e5a5a7e4363e90ab09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9090c0b8254c3397a68508dd7450d3 in term 0.
I20260809 15:30:48.022913 13849 leader_election.cc:302] T 949126a32edf4c4ab6d61461d2ca981b P fe9090c0b8254c3397a68508dd7450d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f0f8ae3a1ba4cd6b191651cee5c9fe0, fe9090c0b8254c3397a68508dd7450d3; no voters:
I20260809 15:30:48.023120 14319 raft_consensus.cc:2781] T 949126a32edf4c4ab6d61461d2ca981b P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:30:48.023214 14319 raft_consensus.cc:482] T 949126a32edf4c4ab6d61461d2ca981b P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:30:48.023272 14319 raft_consensus.cc:3037] T 949126a32edf4c4ab6d61461d2ca981b P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:30:48.024642 14319 raft_consensus.cc:504] T 949126a32edf4c4ab6d61461d2ca981b P fe9090c0b8254c3397a68508dd7450d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:48.024991 14319 leader_election.cc:288] T 949126a32edf4c4ab6d61461d2ca981b P fe9090c0b8254c3397a68508dd7450d3 [CANDIDATE]: Term 1 election: Requested vote from peers 1f0f8ae3a1ba4cd6b191651cee5c9fe0 (127.11.146.2:32913), 9ac945e1feb447e5a5a7e4363e90ab09 (127.11.146.3:43489)
I20260809 15:30:48.025555 14065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "949126a32edf4c4ab6d61461d2ca981b" candidate_uuid: "fe9090c0b8254c3397a68508dd7450d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0"
I20260809 15:30:48.025555 14212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "949126a32edf4c4ab6d61461d2ca981b" candidate_uuid: "fe9090c0b8254c3397a68508dd7450d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac945e1feb447e5a5a7e4363e90ab09"
I20260809 15:30:48.025701 14065 raft_consensus.cc:3037] T 949126a32edf4c4ab6d61461d2ca981b P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:30:48.025701 14212 raft_consensus.cc:3037] T 949126a32edf4c4ab6d61461d2ca981b P 9ac945e1feb447e5a5a7e4363e90ab09 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:30:48.026932 14065 raft_consensus.cc:2454] T 949126a32edf4c4ab6d61461d2ca981b P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9090c0b8254c3397a68508dd7450d3 in term 1.
I20260809 15:30:48.026942 14212 raft_consensus.cc:2454] T 949126a32edf4c4ab6d61461d2ca981b P 9ac945e1feb447e5a5a7e4363e90ab09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9090c0b8254c3397a68508dd7450d3 in term 1.
I20260809 15:30:48.027303 13849 leader_election.cc:302] T 949126a32edf4c4ab6d61461d2ca981b P fe9090c0b8254c3397a68508dd7450d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac945e1feb447e5a5a7e4363e90ab09, fe9090c0b8254c3397a68508dd7450d3; no voters:
I20260809 15:30:48.027519 14319 raft_consensus.cc:2781] T 949126a32edf4c4ab6d61461d2ca981b P fe9090c0b8254c3397a68508dd7450d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:30:48.027803 14319 raft_consensus.cc:686] T 949126a32edf4c4ab6d61461d2ca981b P fe9090c0b8254c3397a68508dd7450d3 [term 1 LEADER]: Becoming Leader. State: Replica: fe9090c0b8254c3397a68508dd7450d3, State: Running, Role: LEADER
I20260809 15:30:48.027987 14319 consensus_queue.cc:237] T 949126a32edf4c4ab6d61461d2ca981b P fe9090c0b8254c3397a68508dd7450d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:48.029783 13755 catalog_manager.cc:5495] T 949126a32edf4c4ab6d61461d2ca981b P fe9090c0b8254c3397a68508dd7450d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe9090c0b8254c3397a68508dd7450d3 (127.11.146.1). New cstate: current_term: 1 leader_uuid: "fe9090c0b8254c3397a68508dd7450d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } health_report { overall_health: UNKNOWN } } }
I20260809 15:30:48.078833 14280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:48.075467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37362 (local address 127.11.146.1:39425)
0809 15:30:48.075714 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:48.075717 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:48.075731 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:30:48.075775 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:48.075778 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:48.075827 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:48.075899 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:30:48.076224 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:48.076830 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:48.077748 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:48.077971 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:48.078056 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:48.078350 (+ 294us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:30:48.078439 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:30:48.078518 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:48.078662 (+ 144us) server_negotiation.cc:299] Negotiation successful
0809 15:30:48.078715 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 15:30:48.088559 14330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:48.085204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:39425 (local address 127.11.146.1:46987)
0809 15:30:48.085364 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:48.085383 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:48.085473 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:48.085776 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:48.085780 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:48.085795 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 15:30:48.085881 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:48.085886 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:48.086593 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:48.086596 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:48.087164 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:48.087172 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:48.087778 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:48.087781 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:48.087847 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:48.087873 (+ 26us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 15:30:48.088286 (+ 413us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 15:30:48.088292 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 15:30:48.088351 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 15:30:48.088443 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 15:30:48.088560 14280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:48.085282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:46987 (local address 127.11.146.1:39425)
0809 15:30:48.085412 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:48.085433 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:48.085446 (+ 13us) server_negotiation.cc:407] Connection header received
0809 15:30:48.085561 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:48.085564 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:48.085605 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:48.085671 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:30:48.085983 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:48.086473 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:48.087286 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:48.087496 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:48.087589 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:48.088019 (+ 430us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:30:48.088182 (+ 163us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:30:48.088262 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:48.088409 (+ 147us) server_negotiation.cc:299] Negotiation successful
0809 15:30:48.088461 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 15:30:48.095952 14212 raft_consensus.cc:1261] T 949126a32edf4c4ab6d61461d2ca981b P 9ac945e1feb447e5a5a7e4363e90ab09 [term 1 FOLLOWER]: Refusing update from remote peer fe9090c0b8254c3397a68508dd7450d3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:30:48.096153 14065 raft_consensus.cc:1261] T 949126a32edf4c4ab6d61461d2ca981b P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 1 FOLLOWER]: Refusing update from remote peer fe9090c0b8254c3397a68508dd7450d3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:30:48.096480 14319 consensus_queue.cc:1035] T 949126a32edf4c4ab6d61461d2ca981b P fe9090c0b8254c3397a68508dd7450d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:30:48.096669 14307 consensus_queue.cc:1035] T 949126a32edf4c4ab6d61461d2ca981b P fe9090c0b8254c3397a68508dd7450d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 15:30:48.111488 14312 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 15:30:49.677554 13753 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50818:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:30:49.677724 13753 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50818:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:30:49.680650 13753 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 80459e49beab434085c62eb57e94206c: Sending DeleteTablet for 3 replicas of tablet 949126a32edf4c4ab6d61461d2ca981b
I20260809 15:30:49.681378 13897 tablet_service.cc:1514] Processing DeleteTablet for tablet 949126a32edf4c4ab6d61461d2ca981b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:30:49 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:37334
I20260809 15:30:49.681535 14043 tablet_service.cc:1514] Processing DeleteTablet for tablet 949126a32edf4c4ab6d61461d2ca981b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:30:49 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:55364
I20260809 15:30:49.681557 14191 tablet_service.cc:1514] Processing DeleteTablet for tablet 949126a32edf4c4ab6d61461d2ca981b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:30:49 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:37014
I20260809 15:30:49.681892 14368 tablet_replica.cc:330] T 949126a32edf4c4ab6d61461d2ca981b P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: stopping tablet replica
I20260809 15:30:49.681983 14369 tablet_replica.cc:330] T 949126a32edf4c4ab6d61461d2ca981b P 9ac945e1feb447e5a5a7e4363e90ab09: stopping tablet replica
I20260809 15:30:49.682047 14368 raft_consensus.cc:2229] T 949126a32edf4c4ab6d61461d2ca981b P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:30:49.682106 14369 raft_consensus.cc:2229] T 949126a32edf4c4ab6d61461d2ca981b P 9ac945e1feb447e5a5a7e4363e90ab09 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:30:49.682176 14368 raft_consensus.cc:2258] T 949126a32edf4c4ab6d61461d2ca981b P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:30:49.682224 14369 raft_consensus.cc:2258] T 949126a32edf4c4ab6d61461d2ca981b P 9ac945e1feb447e5a5a7e4363e90ab09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:30:49.682475 14367 tablet_replica.cc:330] T 949126a32edf4c4ab6d61461d2ca981b P fe9090c0b8254c3397a68508dd7450d3: stopping tablet replica
I20260809 15:30:49.682610 14367 raft_consensus.cc:2229] T 949126a32edf4c4ab6d61461d2ca981b P fe9090c0b8254c3397a68508dd7450d3 [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:30:49.682926 14367 raft_consensus.cc:2258] T 949126a32edf4c4ab6d61461d2ca981b P fe9090c0b8254c3397a68508dd7450d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:30:49.683660 14369 ts_tablet_manager.cc:1905] T 949126a32edf4c4ab6d61461d2ca981b P 9ac945e1feb447e5a5a7e4363e90ab09: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:30:49.683868 14367 ts_tablet_manager.cc:1905] T 949126a32edf4c4ab6d61461d2ca981b P fe9090c0b8254c3397a68508dd7450d3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:30:49.686051 14368 ts_tablet_manager.cc:1905] T 949126a32edf4c4ab6d61461d2ca981b P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:30:49.687018 14369 ts_tablet_manager.cc:1918] T 949126a32edf4c4ab6d61461d2ca981b P 9ac945e1feb447e5a5a7e4363e90ab09: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 15:30:49.687106 14369 log.cc:1196] T 949126a32edf4c4ab6d61461d2ca981b P 9ac945e1feb447e5a5a7e4363e90ab09: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-2/wal/wals/949126a32edf4c4ab6d61461d2ca981b
I20260809 15:30:49.687386 14369 ts_tablet_manager.cc:1939] T 949126a32edf4c4ab6d61461d2ca981b P 9ac945e1feb447e5a5a7e4363e90ab09: Deleting consensus metadata
I20260809 15:30:49.688781 13740 catalog_manager.cc:4841] TS 9ac945e1feb447e5a5a7e4363e90ab09 (127.11.146.3:43489): tablet 949126a32edf4c4ab6d61461d2ca981b (table test-table [id=64dbbbb10c1c4d0caf3dedbab6e0f204]) successfully deleted
I20260809 15:30:49.689018 14367 ts_tablet_manager.cc:1918] T 949126a32edf4c4ab6d61461d2ca981b P fe9090c0b8254c3397a68508dd7450d3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 15:30:49.689378 14367 log.cc:1196] T 949126a32edf4c4ab6d61461d2ca981b P fe9090c0b8254c3397a68508dd7450d3: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-0/wal/wals/949126a32edf4c4ab6d61461d2ca981b
I20260809 15:30:49.689880 14367 ts_tablet_manager.cc:1939] T 949126a32edf4c4ab6d61461d2ca981b P fe9090c0b8254c3397a68508dd7450d3: Deleting consensus metadata
I20260809 15:30:49.690060 14368 ts_tablet_manager.cc:1918] T 949126a32edf4c4ab6d61461d2ca981b P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 15:30:49.690161 14368 log.cc:1196] T 949126a32edf4c4ab6d61461d2ca981b P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-1/wal/wals/949126a32edf4c4ab6d61461d2ca981b
I20260809 15:30:49.690423 14368 ts_tablet_manager.cc:1939] T 949126a32edf4c4ab6d61461d2ca981b P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Deleting consensus metadata
I20260809 15:30:49.691016 13739 catalog_manager.cc:4841] TS fe9090c0b8254c3397a68508dd7450d3 (127.11.146.1:39425): tablet 949126a32edf4c4ab6d61461d2ca981b (table test-table [id=64dbbbb10c1c4d0caf3dedbab6e0f204]) successfully deleted
I20260809 15:30:49.691206 13740 catalog_manager.cc:4841] TS 1f0f8ae3a1ba4cd6b191651cee5c9fe0 (127.11.146.2:32913): tablet 949126a32edf4c4ab6d61461d2ca981b (table test-table [id=64dbbbb10c1c4d0caf3dedbab6e0f204]) successfully deleted
Aug 09 15:30:49 dist-test-slave-1jjb krb5kdc[13708](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289449, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 15:30:49 dist-test-slave-1jjb krb5kdc[13708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289449, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:30:49.720043 14377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:49.706994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50836 (local address 127.11.146.62:43335)
0809 15:30:49.707274 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:49.707280 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:49.707296 (+ 16us) server_negotiation.cc:407] Connection header received
0809 15:30:49.707344 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:49.707346 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:49.707392 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:49.707484 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:49.708244 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:49.708817 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:49.709713 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:49.709948 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:49.710031 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:49.717032 (+ 7001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:49.717036 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:49.717038 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:49.717067 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:49.718451 (+ 1384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:49.718870 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:49.718872 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:49.718874 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:49.718953 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:49.719242 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:49.719244 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:49.719245 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:49.719429 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:49.719549 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:49.719770 (+ 221us) server_negotiation.cc:299] Negotiation successful
0809 15:30:49.719881 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":123,"threads_started":1}
I20260809 15:30:49.722944 13753 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50836:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:30:49.723413 13753 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:30:49.728571 13897 tablet_service.cc:1467] Processing CreateTablet for tablet a683d2bc0c0349ab8741568732b2bddc (DEFAULT_TABLE table=test-table [id=8981dfcc534e4c23b5b00bf5f460fa82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:30:49.728597 14191 tablet_service.cc:1467] Processing CreateTablet for tablet a683d2bc0c0349ab8741568732b2bddc (DEFAULT_TABLE table=test-table [id=8981dfcc534e4c23b5b00bf5f460fa82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:30:49.728896 14191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a683d2bc0c0349ab8741568732b2bddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:30:49.728907 13897 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a683d2bc0c0349ab8741568732b2bddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:30:49.731480 14378 tablet_bootstrap.cc:492] T a683d2bc0c0349ab8741568732b2bddc P 9ac945e1feb447e5a5a7e4363e90ab09: Bootstrap starting.
I20260809 15:30:49.731801 14043 tablet_service.cc:1467] Processing CreateTablet for tablet a683d2bc0c0349ab8741568732b2bddc (DEFAULT_TABLE table=test-table [id=8981dfcc534e4c23b5b00bf5f460fa82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:30:49.732183 14043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a683d2bc0c0349ab8741568732b2bddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:30:49.732697 14378 tablet_bootstrap.cc:654] T a683d2bc0c0349ab8741568732b2bddc P 9ac945e1feb447e5a5a7e4363e90ab09: Neither blocks nor log segments found. Creating new log.
I20260809 15:30:49.733359 14379 tablet_bootstrap.cc:492] T a683d2bc0c0349ab8741568732b2bddc P fe9090c0b8254c3397a68508dd7450d3: Bootstrap starting.
I20260809 15:30:49.734185 14379 tablet_bootstrap.cc:654] T a683d2bc0c0349ab8741568732b2bddc P fe9090c0b8254c3397a68508dd7450d3: Neither blocks nor log segments found. Creating new log.
I20260809 15:30:49.734505 14381 tablet_bootstrap.cc:492] T a683d2bc0c0349ab8741568732b2bddc P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Bootstrap starting.
I20260809 15:30:49.735239 14378 tablet_bootstrap.cc:492] T a683d2bc0c0349ab8741568732b2bddc P 9ac945e1feb447e5a5a7e4363e90ab09: No bootstrap required, opened a new log
I20260809 15:30:49.735348 14378 ts_tablet_manager.cc:1397] T a683d2bc0c0349ab8741568732b2bddc P 9ac945e1feb447e5a5a7e4363e90ab09: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260809 15:30:49.735719 14381 tablet_bootstrap.cc:654] T a683d2bc0c0349ab8741568732b2bddc P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Neither blocks nor log segments found. Creating new log.
I20260809 15:30:49.736022 14378 raft_consensus.cc:348] T a683d2bc0c0349ab8741568732b2bddc P 9ac945e1feb447e5a5a7e4363e90ab09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:49.736227 14378 raft_consensus.cc:374] T a683d2bc0c0349ab8741568732b2bddc P 9ac945e1feb447e5a5a7e4363e90ab09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:30:49.736280 14378 raft_consensus.cc:729] T a683d2bc0c0349ab8741568732b2bddc P 9ac945e1feb447e5a5a7e4363e90ab09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ac945e1feb447e5a5a7e4363e90ab09, State: Initialized, Role: FOLLOWER
I20260809 15:30:49.736435 14378 consensus_queue.cc:260] T a683d2bc0c0349ab8741568732b2bddc P 9ac945e1feb447e5a5a7e4363e90ab09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:49.736908 14378 ts_tablet_manager.cc:1428] T a683d2bc0c0349ab8741568732b2bddc P 9ac945e1feb447e5a5a7e4363e90ab09: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260809 15:30:49.737145 14381 tablet_bootstrap.cc:492] T a683d2bc0c0349ab8741568732b2bddc P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: No bootstrap required, opened a new log
I20260809 15:30:49.737249 14381 ts_tablet_manager.cc:1397] T a683d2bc0c0349ab8741568732b2bddc P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 15:30:49.737689 14381 raft_consensus.cc:348] T a683d2bc0c0349ab8741568732b2bddc P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:49.737798 14381 raft_consensus.cc:374] T a683d2bc0c0349ab8741568732b2bddc P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:30:49.737807 14379 tablet_bootstrap.cc:492] T a683d2bc0c0349ab8741568732b2bddc P fe9090c0b8254c3397a68508dd7450d3: No bootstrap required, opened a new log
I20260809 15:30:49.737833 14381 raft_consensus.cc:729] T a683d2bc0c0349ab8741568732b2bddc P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f0f8ae3a1ba4cd6b191651cee5c9fe0, State: Initialized, Role: FOLLOWER
I20260809 15:30:49.737905 14379 ts_tablet_manager.cc:1397] T a683d2bc0c0349ab8741568732b2bddc P fe9090c0b8254c3397a68508dd7450d3: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260809 15:30:49.737999 14381 consensus_queue.cc:260] T a683d2bc0c0349ab8741568732b2bddc P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:49.738375 14381 ts_tablet_manager.cc:1428] T a683d2bc0c0349ab8741568732b2bddc P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260809 15:30:49.738379 14379 raft_consensus.cc:348] T a683d2bc0c0349ab8741568732b2bddc P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:49.738488 14379 raft_consensus.cc:374] T a683d2bc0c0349ab8741568732b2bddc P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:30:49.738554 14379 raft_consensus.cc:729] T a683d2bc0c0349ab8741568732b2bddc P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9090c0b8254c3397a68508dd7450d3, State: Initialized, Role: FOLLOWER
I20260809 15:30:49.739085 14379 consensus_queue.cc:260] T a683d2bc0c0349ab8741568732b2bddc P fe9090c0b8254c3397a68508dd7450d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:49.739400 14379 ts_tablet_manager.cc:1428] T a683d2bc0c0349ab8741568732b2bddc P fe9090c0b8254c3397a68508dd7450d3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 15:30:49.909880 14353 raft_consensus.cc:482] T a683d2bc0c0349ab8741568732b2bddc P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:30:49.910054 14353 raft_consensus.cc:504] T a683d2bc0c0349ab8741568732b2bddc P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:49.910522 14353 leader_election.cc:288] T a683d2bc0c0349ab8741568732b2bddc P fe9090c0b8254c3397a68508dd7450d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f0f8ae3a1ba4cd6b191651cee5c9fe0 (127.11.146.2:32913), 9ac945e1feb447e5a5a7e4363e90ab09 (127.11.146.3:43489)
I20260809 15:30:49.911125 14212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a683d2bc0c0349ab8741568732b2bddc" candidate_uuid: "fe9090c0b8254c3397a68508dd7450d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" is_pre_election: true
I20260809 15:30:49.911242 14384 raft_consensus.cc:482] T a683d2bc0c0349ab8741568732b2bddc P 9ac945e1feb447e5a5a7e4363e90ab09 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:30:49.911183 14065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a683d2bc0c0349ab8741568732b2bddc" candidate_uuid: "fe9090c0b8254c3397a68508dd7450d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" is_pre_election: true
I20260809 15:30:49.911326 14384 raft_consensus.cc:504] T a683d2bc0c0349ab8741568732b2bddc P 9ac945e1feb447e5a5a7e4363e90ab09 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:49.911372 14065 raft_consensus.cc:2454] T a683d2bc0c0349ab8741568732b2bddc P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9090c0b8254c3397a68508dd7450d3 in term 0.
I20260809 15:30:49.911840 13849 leader_election.cc:302] T a683d2bc0c0349ab8741568732b2bddc P fe9090c0b8254c3397a68508dd7450d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f0f8ae3a1ba4cd6b191651cee5c9fe0, fe9090c0b8254c3397a68508dd7450d3; no voters:
I20260809 15:30:49.911919 14212 raft_consensus.cc:2454] T a683d2bc0c0349ab8741568732b2bddc P 9ac945e1feb447e5a5a7e4363e90ab09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9090c0b8254c3397a68508dd7450d3 in term 0.
I20260809 15:30:49.912112 14353 raft_consensus.cc:2781] T a683d2bc0c0349ab8741568732b2bddc P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:30:49.912207 14353 raft_consensus.cc:482] T a683d2bc0c0349ab8741568732b2bddc P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:30:49.912267 14353 raft_consensus.cc:3037] T a683d2bc0c0349ab8741568732b2bddc P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:30:49.912796 14384 leader_election.cc:288] T a683d2bc0c0349ab8741568732b2bddc P 9ac945e1feb447e5a5a7e4363e90ab09 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9090c0b8254c3397a68508dd7450d3 (127.11.146.1:39425), 1f0f8ae3a1ba4cd6b191651cee5c9fe0 (127.11.146.2:32913)
I20260809 15:30:49.913861 14353 raft_consensus.cc:504] T a683d2bc0c0349ab8741568732b2bddc P fe9090c0b8254c3397a68508dd7450d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:49.914359 14353 leader_election.cc:288] T a683d2bc0c0349ab8741568732b2bddc P fe9090c0b8254c3397a68508dd7450d3 [CANDIDATE]: Term 1 election: Requested vote from peers 1f0f8ae3a1ba4cd6b191651cee5c9fe0 (127.11.146.2:32913), 9ac945e1feb447e5a5a7e4363e90ab09 (127.11.146.3:43489)
I20260809 15:30:49.914562 14065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a683d2bc0c0349ab8741568732b2bddc" candidate_uuid: "fe9090c0b8254c3397a68508dd7450d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0"
I20260809 15:30:49.914700 14065 raft_consensus.cc:3037] T a683d2bc0c0349ab8741568732b2bddc P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:30:49.914815 14212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a683d2bc0c0349ab8741568732b2bddc" candidate_uuid: "fe9090c0b8254c3397a68508dd7450d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac945e1feb447e5a5a7e4363e90ab09"
I20260809 15:30:49.914975 14212 raft_consensus.cc:3037] T a683d2bc0c0349ab8741568732b2bddc P 9ac945e1feb447e5a5a7e4363e90ab09 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:30:49.916186 14065 raft_consensus.cc:2454] T a683d2bc0c0349ab8741568732b2bddc P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9090c0b8254c3397a68508dd7450d3 in term 1.
I20260809 15:30:49.916298 14212 raft_consensus.cc:2454] T a683d2bc0c0349ab8741568732b2bddc P 9ac945e1feb447e5a5a7e4363e90ab09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9090c0b8254c3397a68508dd7450d3 in term 1.
I20260809 15:30:49.916591 13849 leader_election.cc:302] T a683d2bc0c0349ab8741568732b2bddc P fe9090c0b8254c3397a68508dd7450d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac945e1feb447e5a5a7e4363e90ab09, fe9090c0b8254c3397a68508dd7450d3; no voters:
I20260809 15:30:49.916905 14353 raft_consensus.cc:2781] T a683d2bc0c0349ab8741568732b2bddc P fe9090c0b8254c3397a68508dd7450d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:30:49.917081 14353 raft_consensus.cc:686] T a683d2bc0c0349ab8741568732b2bddc P fe9090c0b8254c3397a68508dd7450d3 [term 1 LEADER]: Becoming Leader. State: Replica: fe9090c0b8254c3397a68508dd7450d3, State: Running, Role: LEADER
I20260809 15:30:49.917222 14353 consensus_queue.cc:237] T a683d2bc0c0349ab8741568732b2bddc P fe9090c0b8254c3397a68508dd7450d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:49.918131 14388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:49.913206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:58499 (local address 127.11.146.2:32913)
0809 15:30:49.913713 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:49.913725 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:49.913743 (+ 18us) server_negotiation.cc:407] Connection header received
0809 15:30:49.913798 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:49.913803 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:49.913855 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:49.913967 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:30:49.914312 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:49.915162 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:49.916922 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:49.917565 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:49.917703 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:49.917761 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:49.917926 (+ 165us) server_negotiation.cc:299] Negotiation successful
0809 15:30:49.918014 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":94,"threads_started":1}
I20260809 15:30:49.918135 14386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:49.913014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:32913 (local address 127.11.146.3:58499)
0809 15:30:49.913497 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:49.913510 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:49.913582 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:49.914003 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:49.914008 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:49.914032 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:30:49.914174 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:49.914182 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:49.915278 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:49.915282 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:49.916778 (+ 1496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:49.916791 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:49.917687 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:49.917690 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:49.917786 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:49.917813 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 15:30:49.917888 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 15:30:49.917968 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":135,"threads_started":1}
I20260809 15:30:49.918831 14065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a683d2bc0c0349ab8741568732b2bddc" candidate_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" is_pre_election: true
I20260809 15:30:49.919021 14065 raft_consensus.cc:2379] T a683d2bc0c0349ab8741568732b2bddc P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ac945e1feb447e5a5a7e4363e90ab09 in current term 1: Already voted for candidate fe9090c0b8254c3397a68508dd7450d3 in this term.
I20260809 15:30:49.919149 13755 catalog_manager.cc:5495] T a683d2bc0c0349ab8741568732b2bddc P fe9090c0b8254c3397a68508dd7450d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe9090c0b8254c3397a68508dd7450d3 (127.11.146.1). New cstate: current_term: 1 leader_uuid: "fe9090c0b8254c3397a68508dd7450d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } health_report { overall_health: UNKNOWN } } }
I20260809 15:30:49.919873 14389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:49.913393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:50831 (local address 127.11.146.1:39425)
0809 15:30:49.913793 (+ 400us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:49.913799 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:49.913811 (+ 12us) server_negotiation.cc:407] Connection header received
0809 15:30:49.913847 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:49.913849 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:49.913885 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:49.914071 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:30:49.915167 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:49.916035 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:49.917578 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:49.918767 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:49.918893 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:49.919192 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:49.919664 (+ 472us) server_negotiation.cc:299] Negotiation successful
0809 15:30:49.919743 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":110,"threads_started":1}
I20260809 15:30:49.919873 14387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:49.912996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:39425 (local address 127.11.146.3:50831)
0809 15:30:49.913406 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:49.913423 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:49.913550 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:49.914197 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:49.914201 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:49.914221 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:30:49.914914 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:49.914927 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:49.916215 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:49.916218 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:49.917438 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:49.917448 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:49.919019 (+ 1571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:49.919023 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:49.919496 (+ 473us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:49.919529 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 15:30:49.919627 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 15:30:49.919700 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":157,"threads_started":1}
I20260809 15:30:49.920517 13919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a683d2bc0c0349ab8741568732b2bddc" candidate_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9090c0b8254c3397a68508dd7450d3" is_pre_election: true
I20260809 15:30:49.921020 14140 leader_election.cc:302] T a683d2bc0c0349ab8741568732b2bddc P 9ac945e1feb447e5a5a7e4363e90ab09 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ac945e1feb447e5a5a7e4363e90ab09; no voters: 1f0f8ae3a1ba4cd6b191651cee5c9fe0, fe9090c0b8254c3397a68508dd7450d3
I20260809 15:30:49.921316 14384 raft_consensus.cc:2726] T a683d2bc0c0349ab8741568732b2bddc P 9ac945e1feb447e5a5a7e4363e90ab09 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260809 15:30:49.978870 14389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:49.975841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37364 (local address 127.11.146.1:39425)
0809 15:30:49.976007 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:49.976010 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:49.976023 (+ 13us) server_negotiation.cc:407] Connection header received
0809 15:30:49.976063 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:49.976065 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:49.976127 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:49.976192 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:30:49.976434 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:49.976949 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:49.977775 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:49.978002 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:49.978094 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:49.978355 (+ 261us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:30:49.978432 (+ 77us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:30:49.978504 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:49.978619 (+ 115us) server_negotiation.cc:299] Negotiation successful
0809 15:30:49.978701 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260809 15:30:49.985633 14212 raft_consensus.cc:1261] T a683d2bc0c0349ab8741568732b2bddc P 9ac945e1feb447e5a5a7e4363e90ab09 [term 1 FOLLOWER]: Refusing update from remote peer fe9090c0b8254c3397a68508dd7450d3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:30:49.985692 14065 raft_consensus.cc:1261] T a683d2bc0c0349ab8741568732b2bddc P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 1 FOLLOWER]: Refusing update from remote peer fe9090c0b8254c3397a68508dd7450d3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:30:49.986042 14348 consensus_queue.cc:1035] T a683d2bc0c0349ab8741568732b2bddc P fe9090c0b8254c3397a68508dd7450d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:30:49.986196 14353 consensus_queue.cc:1035] T a683d2bc0c0349ab8741568732b2bddc P fe9090c0b8254c3397a68508dd7450d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:30:50.016865 13755 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50836:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:30:50.017016 13755 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50836:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:30:50.018896 13755 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 80459e49beab434085c62eb57e94206c: Sending DeleteTablet for 3 replicas of tablet a683d2bc0c0349ab8741568732b2bddc
I20260809 15:30:50.019435 13898 tablet_service.cc:1514] Processing DeleteTablet for tablet a683d2bc0c0349ab8741568732b2bddc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:30:50 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:37334
I20260809 15:30:50.019495 14043 tablet_service.cc:1514] Processing DeleteTablet for tablet a683d2bc0c0349ab8741568732b2bddc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:30:50 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:55364
I20260809 15:30:50.019596 14191 tablet_service.cc:1514] Processing DeleteTablet for tablet a683d2bc0c0349ab8741568732b2bddc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:30:50 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:37014
I20260809 15:30:50.019675 14368 tablet_replica.cc:330] T a683d2bc0c0349ab8741568732b2bddc P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: stopping tablet replica
I20260809 15:30:50.019677 14367 tablet_replica.cc:330] T a683d2bc0c0349ab8741568732b2bddc P fe9090c0b8254c3397a68508dd7450d3: stopping tablet replica
I20260809 15:30:50.019773 14369 tablet_replica.cc:330] T a683d2bc0c0349ab8741568732b2bddc P 9ac945e1feb447e5a5a7e4363e90ab09: stopping tablet replica
I20260809 15:30:50.019784 14367 raft_consensus.cc:2229] T a683d2bc0c0349ab8741568732b2bddc P fe9090c0b8254c3397a68508dd7450d3 [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:30:50.019784 14368 raft_consensus.cc:2229] T a683d2bc0c0349ab8741568732b2bddc P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:30:50.019881 14368 raft_consensus.cc:2258] T a683d2bc0c0349ab8741568732b2bddc P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:30:50.019898 14369 raft_consensus.cc:2229] T a683d2bc0c0349ab8741568732b2bddc P 9ac945e1feb447e5a5a7e4363e90ab09 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:30:50.019950 14367 raft_consensus.cc:2258] T a683d2bc0c0349ab8741568732b2bddc P fe9090c0b8254c3397a68508dd7450d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:30:50.020011 14369 raft_consensus.cc:2258] T a683d2bc0c0349ab8741568732b2bddc P 9ac945e1feb447e5a5a7e4363e90ab09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:30:50.020202 13755 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50836:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:30:50.020601 13755 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:30:50.020646 14367 ts_tablet_manager.cc:1905] T a683d2bc0c0349ab8741568732b2bddc P fe9090c0b8254c3397a68508dd7450d3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:30:50.020841 14369 ts_tablet_manager.cc:1905] T a683d2bc0c0349ab8741568732b2bddc P 9ac945e1feb447e5a5a7e4363e90ab09: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:30:50.021199 14368 ts_tablet_manager.cc:1905] T a683d2bc0c0349ab8741568732b2bddc P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:30:50.023193 14369 ts_tablet_manager.cc:1918] T a683d2bc0c0349ab8741568732b2bddc P 9ac945e1feb447e5a5a7e4363e90ab09: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 15:30:50.023206 14367 ts_tablet_manager.cc:1918] T a683d2bc0c0349ab8741568732b2bddc P fe9090c0b8254c3397a68508dd7450d3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 15:30:50.023268 14369 log.cc:1196] T a683d2bc0c0349ab8741568732b2bddc P 9ac945e1feb447e5a5a7e4363e90ab09: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-2/wal/wals/a683d2bc0c0349ab8741568732b2bddc
I20260809 15:30:50.023269 14367 log.cc:1196] T a683d2bc0c0349ab8741568732b2bddc P fe9090c0b8254c3397a68508dd7450d3: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-0/wal/wals/a683d2bc0c0349ab8741568732b2bddc
I20260809 15:30:50.023372 14368 ts_tablet_manager.cc:1918] T a683d2bc0c0349ab8741568732b2bddc P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 15:30:50.023438 14368 log.cc:1196] T a683d2bc0c0349ab8741568732b2bddc P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-1/wal/wals/a683d2bc0c0349ab8741568732b2bddc
I20260809 15:30:50.023543 14369 ts_tablet_manager.cc:1939] T a683d2bc0c0349ab8741568732b2bddc P 9ac945e1feb447e5a5a7e4363e90ab09: Deleting consensus metadata
I20260809 15:30:50.023543 14367 ts_tablet_manager.cc:1939] T a683d2bc0c0349ab8741568732b2bddc P fe9090c0b8254c3397a68508dd7450d3: Deleting consensus metadata
I20260809 15:30:50.023622 14368 ts_tablet_manager.cc:1939] T a683d2bc0c0349ab8741568732b2bddc P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Deleting consensus metadata
I20260809 15:30:50.024340 13740 catalog_manager.cc:4841] TS 1f0f8ae3a1ba4cd6b191651cee5c9fe0 (127.11.146.2:32913): tablet a683d2bc0c0349ab8741568732b2bddc (table test-table [id=8981dfcc534e4c23b5b00bf5f460fa82]) successfully deleted
I20260809 15:30:50.024340 13739 catalog_manager.cc:4841] TS fe9090c0b8254c3397a68508dd7450d3 (127.11.146.1:39425): tablet a683d2bc0c0349ab8741568732b2bddc (table test-table [id=8981dfcc534e4c23b5b00bf5f460fa82]) successfully deleted
I20260809 15:30:50.025032 13740 catalog_manager.cc:4841] TS 9ac945e1feb447e5a5a7e4363e90ab09 (127.11.146.3:43489): tablet a683d2bc0c0349ab8741568732b2bddc (table test-table [id=8981dfcc534e4c23b5b00bf5f460fa82]) successfully deleted
I20260809 15:30:50.026814 13898 tablet_service.cc:1467] Processing CreateTablet for tablet 8c41d7916475450cb4b0b915a5a7bc6a (DEFAULT_TABLE table=test-table [id=933107f930464320ba36df387b294045]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:30:50.026868 14043 tablet_service.cc:1467] Processing CreateTablet for tablet 8c41d7916475450cb4b0b915a5a7bc6a (DEFAULT_TABLE table=test-table [id=933107f930464320ba36df387b294045]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:30:50.027024 14191 tablet_service.cc:1467] Processing CreateTablet for tablet 8c41d7916475450cb4b0b915a5a7bc6a (DEFAULT_TABLE table=test-table [id=933107f930464320ba36df387b294045]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:30:50.027082 13898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c41d7916475450cb4b0b915a5a7bc6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:30:50.027082 14043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c41d7916475450cb4b0b915a5a7bc6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:30:50.027285 14191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c41d7916475450cb4b0b915a5a7bc6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:30:50.029239 14378 tablet_bootstrap.cc:492] T 8c41d7916475450cb4b0b915a5a7bc6a P 9ac945e1feb447e5a5a7e4363e90ab09: Bootstrap starting.
I20260809 15:30:50.029461 14379 tablet_bootstrap.cc:492] T 8c41d7916475450cb4b0b915a5a7bc6a P fe9090c0b8254c3397a68508dd7450d3: Bootstrap starting.
I20260809 15:30:50.030120 14378 tablet_bootstrap.cc:654] T 8c41d7916475450cb4b0b915a5a7bc6a P 9ac945e1feb447e5a5a7e4363e90ab09: Neither blocks nor log segments found. Creating new log.
I20260809 15:30:50.030236 14379 tablet_bootstrap.cc:654] T 8c41d7916475450cb4b0b915a5a7bc6a P fe9090c0b8254c3397a68508dd7450d3: Neither blocks nor log segments found. Creating new log.
I20260809 15:30:50.030706 14381 tablet_bootstrap.cc:492] T 8c41d7916475450cb4b0b915a5a7bc6a P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Bootstrap starting.
I20260809 15:30:50.031260 14378 tablet_bootstrap.cc:492] T 8c41d7916475450cb4b0b915a5a7bc6a P 9ac945e1feb447e5a5a7e4363e90ab09: No bootstrap required, opened a new log
I20260809 15:30:50.031353 14378 ts_tablet_manager.cc:1397] T 8c41d7916475450cb4b0b915a5a7bc6a P 9ac945e1feb447e5a5a7e4363e90ab09: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260809 15:30:50.031507 14379 tablet_bootstrap.cc:492] T 8c41d7916475450cb4b0b915a5a7bc6a P fe9090c0b8254c3397a68508dd7450d3: No bootstrap required, opened a new log
I20260809 15:30:50.031608 14381 tablet_bootstrap.cc:654] T 8c41d7916475450cb4b0b915a5a7bc6a P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Neither blocks nor log segments found. Creating new log.
I20260809 15:30:50.031701 14379 ts_tablet_manager.cc:1397] T 8c41d7916475450cb4b0b915a5a7bc6a P fe9090c0b8254c3397a68508dd7450d3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 15:30:50.031852 14378 raft_consensus.cc:348] T 8c41d7916475450cb4b0b915a5a7bc6a P 9ac945e1feb447e5a5a7e4363e90ab09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:50.031971 14378 raft_consensus.cc:374] T 8c41d7916475450cb4b0b915a5a7bc6a P 9ac945e1feb447e5a5a7e4363e90ab09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:30:50.032029 14378 raft_consensus.cc:729] T 8c41d7916475450cb4b0b915a5a7bc6a P 9ac945e1feb447e5a5a7e4363e90ab09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ac945e1feb447e5a5a7e4363e90ab09, State: Initialized, Role: FOLLOWER
I20260809 15:30:50.032137 14379 raft_consensus.cc:348] T 8c41d7916475450cb4b0b915a5a7bc6a P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:50.032258 14379 raft_consensus.cc:374] T 8c41d7916475450cb4b0b915a5a7bc6a P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:30:50.032229 14378 consensus_queue.cc:260] T 8c41d7916475450cb4b0b915a5a7bc6a P 9ac945e1feb447e5a5a7e4363e90ab09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:50.032297 14379 raft_consensus.cc:729] T 8c41d7916475450cb4b0b915a5a7bc6a P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9090c0b8254c3397a68508dd7450d3, State: Initialized, Role: FOLLOWER
I20260809 15:30:50.032428 14379 consensus_queue.cc:260] T 8c41d7916475450cb4b0b915a5a7bc6a P fe9090c0b8254c3397a68508dd7450d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:50.032577 14378 ts_tablet_manager.cc:1428] T 8c41d7916475450cb4b0b915a5a7bc6a P 9ac945e1feb447e5a5a7e4363e90ab09: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 15:30:50.032737 14379 ts_tablet_manager.cc:1428] T 8c41d7916475450cb4b0b915a5a7bc6a P fe9090c0b8254c3397a68508dd7450d3: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260809 15:30:50.032908 14381 tablet_bootstrap.cc:492] T 8c41d7916475450cb4b0b915a5a7bc6a P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: No bootstrap required, opened a new log
I20260809 15:30:50.032985 14381 ts_tablet_manager.cc:1397] T 8c41d7916475450cb4b0b915a5a7bc6a P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 15:30:50.033365 14381 raft_consensus.cc:348] T 8c41d7916475450cb4b0b915a5a7bc6a P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:50.033506 14381 raft_consensus.cc:374] T 8c41d7916475450cb4b0b915a5a7bc6a P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:30:50.033571 14381 raft_consensus.cc:729] T 8c41d7916475450cb4b0b915a5a7bc6a P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f0f8ae3a1ba4cd6b191651cee5c9fe0, State: Initialized, Role: FOLLOWER
I20260809 15:30:50.033721 14381 consensus_queue.cc:260] T 8c41d7916475450cb4b0b915a5a7bc6a P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:50.033986 14381 ts_tablet_manager.cc:1428] T 8c41d7916475450cb4b0b915a5a7bc6a P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 15:30:50.168251 14353 raft_consensus.cc:482] T 8c41d7916475450cb4b0b915a5a7bc6a P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:30:50.168462 14353 raft_consensus.cc:504] T 8c41d7916475450cb4b0b915a5a7bc6a P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:50.169034 14353 leader_election.cc:288] T 8c41d7916475450cb4b0b915a5a7bc6a P fe9090c0b8254c3397a68508dd7450d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f0f8ae3a1ba4cd6b191651cee5c9fe0 (127.11.146.2:32913), 9ac945e1feb447e5a5a7e4363e90ab09 (127.11.146.3:43489)
I20260809 15:30:50.169703 14212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c41d7916475450cb4b0b915a5a7bc6a" candidate_uuid: "fe9090c0b8254c3397a68508dd7450d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" is_pre_election: true
I20260809 15:30:50.169710 14064 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c41d7916475450cb4b0b915a5a7bc6a" candidate_uuid: "fe9090c0b8254c3397a68508dd7450d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" is_pre_election: true
I20260809 15:30:50.169850 14212 raft_consensus.cc:2454] T 8c41d7916475450cb4b0b915a5a7bc6a P 9ac945e1feb447e5a5a7e4363e90ab09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9090c0b8254c3397a68508dd7450d3 in term 0.
I20260809 15:30:50.169905 14064 raft_consensus.cc:2454] T 8c41d7916475450cb4b0b915a5a7bc6a P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9090c0b8254c3397a68508dd7450d3 in term 0.
I20260809 15:30:50.170251 13849 leader_election.cc:302] T 8c41d7916475450cb4b0b915a5a7bc6a P fe9090c0b8254c3397a68508dd7450d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac945e1feb447e5a5a7e4363e90ab09, fe9090c0b8254c3397a68508dd7450d3; no voters:
I20260809 15:30:50.170491 14353 raft_consensus.cc:2781] T 8c41d7916475450cb4b0b915a5a7bc6a P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:30:50.170555 14353 raft_consensus.cc:482] T 8c41d7916475450cb4b0b915a5a7bc6a P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:30:50.170585 14353 raft_consensus.cc:3037] T 8c41d7916475450cb4b0b915a5a7bc6a P fe9090c0b8254c3397a68508dd7450d3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:30:50.171869 14353 raft_consensus.cc:504] T 8c41d7916475450cb4b0b915a5a7bc6a P fe9090c0b8254c3397a68508dd7450d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:50.172268 14353 leader_election.cc:288] T 8c41d7916475450cb4b0b915a5a7bc6a P fe9090c0b8254c3397a68508dd7450d3 [CANDIDATE]: Term 1 election: Requested vote from peers 1f0f8ae3a1ba4cd6b191651cee5c9fe0 (127.11.146.2:32913), 9ac945e1feb447e5a5a7e4363e90ab09 (127.11.146.3:43489)
I20260809 15:30:50.172750 14064 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c41d7916475450cb4b0b915a5a7bc6a" candidate_uuid: "fe9090c0b8254c3397a68508dd7450d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0"
I20260809 15:30:50.172791 14212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c41d7916475450cb4b0b915a5a7bc6a" candidate_uuid: "fe9090c0b8254c3397a68508dd7450d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ac945e1feb447e5a5a7e4363e90ab09"
I20260809 15:30:50.172887 14064 raft_consensus.cc:3037] T 8c41d7916475450cb4b0b915a5a7bc6a P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:30:50.172921 14212 raft_consensus.cc:3037] T 8c41d7916475450cb4b0b915a5a7bc6a P 9ac945e1feb447e5a5a7e4363e90ab09 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:30:50.173835 14212 raft_consensus.cc:2454] T 8c41d7916475450cb4b0b915a5a7bc6a P 9ac945e1feb447e5a5a7e4363e90ab09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9090c0b8254c3397a68508dd7450d3 in term 1.
I20260809 15:30:50.173928 14064 raft_consensus.cc:2454] T 8c41d7916475450cb4b0b915a5a7bc6a P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9090c0b8254c3397a68508dd7450d3 in term 1.
I20260809 15:30:50.174196 13849 leader_election.cc:302] T 8c41d7916475450cb4b0b915a5a7bc6a P fe9090c0b8254c3397a68508dd7450d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ac945e1feb447e5a5a7e4363e90ab09, fe9090c0b8254c3397a68508dd7450d3; no voters:
I20260809 15:30:50.174382 14353 raft_consensus.cc:2781] T 8c41d7916475450cb4b0b915a5a7bc6a P fe9090c0b8254c3397a68508dd7450d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:30:50.174477 14353 raft_consensus.cc:686] T 8c41d7916475450cb4b0b915a5a7bc6a P fe9090c0b8254c3397a68508dd7450d3 [term 1 LEADER]: Becoming Leader. State: Replica: fe9090c0b8254c3397a68508dd7450d3, State: Running, Role: LEADER
I20260809 15:30:50.174626 14353 consensus_queue.cc:237] T 8c41d7916475450cb4b0b915a5a7bc6a P fe9090c0b8254c3397a68508dd7450d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } }
I20260809 15:30:50.176621 13755 catalog_manager.cc:5495] T 8c41d7916475450cb4b0b915a5a7bc6a P fe9090c0b8254c3397a68508dd7450d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe9090c0b8254c3397a68508dd7450d3 (127.11.146.1). New cstate: current_term: 1 leader_uuid: "fe9090c0b8254c3397a68508dd7450d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9090c0b8254c3397a68508dd7450d3" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 39425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 } health_report { overall_health: UNKNOWN } } }
I20260809 15:30:50.196310 14211 raft_consensus.cc:1261] T 8c41d7916475450cb4b0b915a5a7bc6a P 9ac945e1feb447e5a5a7e4363e90ab09 [term 1 FOLLOWER]: Refusing update from remote peer fe9090c0b8254c3397a68508dd7450d3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:30:50.196301 14064 raft_consensus.cc:1261] T 8c41d7916475450cb4b0b915a5a7bc6a P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 1 FOLLOWER]: Refusing update from remote peer fe9090c0b8254c3397a68508dd7450d3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:30:50.196722 14319 consensus_queue.cc:1035] T 8c41d7916475450cb4b0b915a5a7bc6a P fe9090c0b8254c3397a68508dd7450d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f0f8ae3a1ba4cd6b191651cee5c9fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 32913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:30:50.196880 14353 consensus_queue.cc:1035] T 8c41d7916475450cb4b0b915a5a7bc6a P fe9090c0b8254c3397a68508dd7450d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ac945e1feb447e5a5a7e4363e90ab09" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 15:30:50.209208 14346 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 15:30:51.761520 13755 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50836:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:30:51.761672 13755 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50836:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:30:51.764194 13755 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 80459e49beab434085c62eb57e94206c: Sending DeleteTablet for 3 replicas of tablet 8c41d7916475450cb4b0b915a5a7bc6a
I20260809 15:30:51.764722 13898 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c41d7916475450cb4b0b915a5a7bc6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:30:51 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:37334
I20260809 15:30:51.764783 14043 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c41d7916475450cb4b0b915a5a7bc6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:30:51 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:55364
I20260809 15:30:51.765077 14191 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c41d7916475450cb4b0b915a5a7bc6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:30:51 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:37014
I20260809 15:30:51.765239 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 13830
I20260809 15:30:51.765130 14422 tablet_replica.cc:330] T 8c41d7916475450cb4b0b915a5a7bc6a P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: stopping tablet replica
I20260809 15:30:51.767902 14424 tablet_replica.cc:330] T 8c41d7916475450cb4b0b915a5a7bc6a P 9ac945e1feb447e5a5a7e4363e90ab09: stopping tablet replica
I20260809 15:30:51.768059 14424 raft_consensus.cc:2229] T 8c41d7916475450cb4b0b915a5a7bc6a P 9ac945e1feb447e5a5a7e4363e90ab09 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:30:51.768220 14424 raft_consensus.cc:2258] T 8c41d7916475450cb4b0b915a5a7bc6a P 9ac945e1feb447e5a5a7e4363e90ab09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:30:51.768239 14422 raft_consensus.cc:2229] T 8c41d7916475450cb4b0b915a5a7bc6a P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:30:51.768388 14422 raft_consensus.cc:2258] T 8c41d7916475450cb4b0b915a5a7bc6a P 1f0f8ae3a1ba4cd6b191651cee5c9fe0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:30:51.768956 14424 ts_tablet_manager.cc:1905] T 8c41d7916475450cb4b0b915a5a7bc6a P 9ac945e1feb447e5a5a7e4363e90ab09: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:30:51.768975 14422 ts_tablet_manager.cc:1905] T 8c41d7916475450cb4b0b915a5a7bc6a P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:30:51.771414 14422 ts_tablet_manager.cc:1918] T 8c41d7916475450cb4b0b915a5a7bc6a P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 15:30:51.771509 14422 log.cc:1196] T 8c41d7916475450cb4b0b915a5a7bc6a P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-1/wal/wals/8c41d7916475450cb4b0b915a5a7bc6a
I20260809 15:30:51.771955 14422 ts_tablet_manager.cc:1939] T 8c41d7916475450cb4b0b915a5a7bc6a P 1f0f8ae3a1ba4cd6b191651cee5c9fe0: Deleting consensus metadata
I20260809 15:30:51.772506 14424 ts_tablet_manager.cc:1918] T 8c41d7916475450cb4b0b915a5a7bc6a P 9ac945e1feb447e5a5a7e4363e90ab09: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 15:30:51.772593 14424 log.cc:1196] T 8c41d7916475450cb4b0b915a5a7bc6a P 9ac945e1feb447e5a5a7e4363e90ab09: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786289437399694-11848-0/minicluster-data/ts-2/wal/wals/8c41d7916475450cb4b0b915a5a7bc6a
I20260809 15:30:51.772686 13740 catalog_manager.cc:4841] TS 1f0f8ae3a1ba4cd6b191651cee5c9fe0 (127.11.146.2:32913): tablet 8c41d7916475450cb4b0b915a5a7bc6a (table test-table [id=933107f930464320ba36df387b294045]) successfully deleted
I20260809 15:30:51.772852 14424 ts_tablet_manager.cc:1939] T 8c41d7916475450cb4b0b915a5a7bc6a P 9ac945e1feb447e5a5a7e4363e90ab09: Deleting consensus metadata
I20260809 15:30:51.773710 13740 catalog_manager.cc:4841] TS 9ac945e1feb447e5a5a7e4363e90ab09 (127.11.146.3:43489): tablet 8c41d7916475450cb4b0b915a5a7bc6a (table test-table [id=933107f930464320ba36df387b294045]) successfully deleted
W20260809 15:30:51.778031 13739 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.146.1:39425 (error 108)
I20260809 15:30:51.778218 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 13975
I20260809 15:30:51.781859 14426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:51.781113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:39425 (local address 127.0.0.1:48644)
0809 15:30:51.781603 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:51.781720 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.1:39425: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":222,"threads_started":1}
W20260809 15:30:51.782052 13739 catalog_manager.cc:4584] TS fe9090c0b8254c3397a68508dd7450d3 (127.11.146.1:39425): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8c41d7916475450cb4b0b915a5a7bc6a: Network error: Client connection negotiation failed: client connection to 127.11.146.1:39425: connect: Connection refused (error 111)
I20260809 15:30:51.789144 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 14122
I20260809 15:30:51.798293 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 13721
2026-08-09T15:30:51Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6628 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:30:51 dist-test-slave-1jjb krb5kdc[14431](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:30:51 dist-test-slave-1jjb krb5kdc[14431](info): set up 2 sockets
Aug 09 15:30:51 dist-test-slave-1jjb krb5kdc[14431](info): commencing operation
krb5kdc: starting...
W20260809 15:30:52.923450 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.097s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:30:53 dist-test-slave-1jjb krb5kdc[14431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289453, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:30:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:30:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.146.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
I20260809 15:30:53.063704 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:36175
--webserver_interface=127.11.146.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:45687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:36175
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:30:53.182085 14445 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:30:53.182346 14445 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:30:53.182387 14445 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:30:53.186529 14445 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:30:53.186589 14445 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:30:53.186607 14445 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:30:53.186625 14445 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:30:53.186640 14445 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:30:53.192615 14445 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:45687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:36175
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:36175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14445
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:30:53.193674 14445 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:30:53.194733 14445 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:30:53.203694 14452 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:53.203999 14445 server_base.cc:1034] running on GCE node
W20260809 15:30:53.203794 14454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:53.203840 14451 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:53.204684 14445 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:30:53.205839 14445 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:30:53.207041 14445 hybrid_clock.cc:648] HybridClock initialized: now 1786289453207006 us; error 40 us; skew 500 ppm
Aug 09 15:30:53 dist-test-slave-1jjb krb5kdc[14431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289453, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:30:53.210171 14445 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:30:53.211091 14445 webserver.cc:460] Webserver started at http://127.11.146.62:32909/ using document root <none> and password file <none>
I20260809 15:30:53.211725 14445 fs_manager.cc:359] Metadata directory not provided
I20260809 15:30:53.211807 14445 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:30:53.211982 14445 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:30:53.214068 14445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "bf87cb109ad24ee3ae96a5be7b3ba359"
format_stamp: "Formatted at 2026-08-09 15:30:53 on dist-test-slave-1jjb"
server_key: "939a2dcd5e6e161491cb26f931eb1ed5"
server_key_iv: "12683aa11110b291cf3855d964d48ca2"
server_key_version: "encryptionkey@0"
I20260809 15:30:53.214577 14445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "bf87cb109ad24ee3ae96a5be7b3ba359"
format_stamp: "Formatted at 2026-08-09 15:30:53 on dist-test-slave-1jjb"
server_key: "939a2dcd5e6e161491cb26f931eb1ed5"
server_key_iv: "12683aa11110b291cf3855d964d48ca2"
server_key_version: "encryptionkey@0"
I20260809 15:30:53.218369 14445 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 15:30:53.220862 14461 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:53.222113 14445 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:30:53.222245 14445 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "bf87cb109ad24ee3ae96a5be7b3ba359"
format_stamp: "Formatted at 2026-08-09 15:30:53 on dist-test-slave-1jjb"
server_key: "939a2dcd5e6e161491cb26f931eb1ed5"
server_key_iv: "12683aa11110b291cf3855d964d48ca2"
server_key_version: "encryptionkey@0"
I20260809 15:30:53.222357 14445 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:30:53.252048 14445 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:30:53.255312 14445 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:30:53.255528 14445 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:30:53.263230 14445 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:36175
I20260809 15:30:53.263257 14525 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:36175 every 8 connection(s)
I20260809 15:30:53.264247 14445 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:30:53.267038 14526 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:30:53.271714 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 14445
I20260809 15:30:53.271804 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:30:53.272127 11848 external_mini_cluster.cc:1428] Setting key b9b007e774443c3ebbe10cd31bc134ff
I20260809 15:30:53.273423 14526 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf87cb109ad24ee3ae96a5be7b3ba359: Bootstrap starting.
I20260809 15:30:53.275760 14526 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bf87cb109ad24ee3ae96a5be7b3ba359: Neither blocks nor log segments found. Creating new log.
I20260809 15:30:53.276636 14526 log.cc:824] T 00000000000000000000000000000000 P bf87cb109ad24ee3ae96a5be7b3ba359: Log is configured to *not* fsync() on all Append() calls
I20260809 15:30:53.278860 14526 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf87cb109ad24ee3ae96a5be7b3ba359: No bootstrap required, opened a new log
Aug 09 15:30:53 dist-test-slave-1jjb krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289453, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:30:53.283516 14526 raft_consensus.cc:348] T 00000000000000000000000000000000 P bf87cb109ad24ee3ae96a5be7b3ba359 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf87cb109ad24ee3ae96a5be7b3ba359" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 36175 } }
I20260809 15:30:53.283768 14526 raft_consensus.cc:374] T 00000000000000000000000000000000 P bf87cb109ad24ee3ae96a5be7b3ba359 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:30:53.283854 14526 raft_consensus.cc:729] T 00000000000000000000000000000000 P bf87cb109ad24ee3ae96a5be7b3ba359 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf87cb109ad24ee3ae96a5be7b3ba359, State: Initialized, Role: FOLLOWER
I20260809 15:30:53.284353 14526 consensus_queue.cc:260] T 00000000000000000000000000000000 P bf87cb109ad24ee3ae96a5be7b3ba359 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf87cb109ad24ee3ae96a5be7b3ba359" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 36175 } }
I20260809 15:30:53.284510 14526 raft_consensus.cc:388] T 00000000000000000000000000000000 P bf87cb109ad24ee3ae96a5be7b3ba359 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:30:53.284602 14526 raft_consensus.cc:482] T 00000000000000000000000000000000 P bf87cb109ad24ee3ae96a5be7b3ba359 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:30:53.284709 14526 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bf87cb109ad24ee3ae96a5be7b3ba359 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:30:53.285605 14526 raft_consensus.cc:504] T 00000000000000000000000000000000 P bf87cb109ad24ee3ae96a5be7b3ba359 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf87cb109ad24ee3ae96a5be7b3ba359" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 36175 } }
I20260809 15:30:53.285952 14526 leader_election.cc:302] T 00000000000000000000000000000000 P bf87cb109ad24ee3ae96a5be7b3ba359 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bf87cb109ad24ee3ae96a5be7b3ba359; no voters:
I20260809 15:30:53.286319 14526 leader_election.cc:288] T 00000000000000000000000000000000 P bf87cb109ad24ee3ae96a5be7b3ba359 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:30:53.286419 14531 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bf87cb109ad24ee3ae96a5be7b3ba359 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:30:53.286609 14531 raft_consensus.cc:686] T 00000000000000000000000000000000 P bf87cb109ad24ee3ae96a5be7b3ba359 [term 1 LEADER]: Becoming Leader. State: Replica: bf87cb109ad24ee3ae96a5be7b3ba359, State: Running, Role: LEADER
I20260809 15:30:53.287009 14531 consensus_queue.cc:237] T 00000000000000000000000000000000 P bf87cb109ad24ee3ae96a5be7b3ba359 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf87cb109ad24ee3ae96a5be7b3ba359" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 36175 } }
I20260809 15:30:53.287324 14529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:53.273608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51514 (local address 127.11.146.62:36175)
0809 15:30:53.274017 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:53.274033 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:53.274067 (+ 34us) server_negotiation.cc:407] Connection header received
0809 15:30:53.274695 (+ 628us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:53.274711 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:53.275017 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:53.275275 (+ 258us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:53.276275 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:53.277541 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:53.278729 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:53.279277 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:53.279421 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:53.282248 (+ 2827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:53.282253 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:53.282266 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:53.282292 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:53.284183 (+ 1891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:53.284644 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:53.284650 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:53.284656 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:53.284817 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:53.285089 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:53.285092 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:53.285094 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:53.285488 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:53.285688 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:53.285961 (+ 273us) server_negotiation.cc:299] Negotiation successful
0809 15:30:53.286269 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251,"thread_start_us":124,"threads_started":1}
I20260809 15:30:53.287688 14526 sys_catalog.cc:564] T 00000000000000000000000000000000 P bf87cb109ad24ee3ae96a5be7b3ba359 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:30:53.288757 14533 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf87cb109ad24ee3ae96a5be7b3ba359 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bf87cb109ad24ee3ae96a5be7b3ba359. Latest consensus state: current_term: 1 leader_uuid: "bf87cb109ad24ee3ae96a5be7b3ba359" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf87cb109ad24ee3ae96a5be7b3ba359" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 36175 } } }
I20260809 15:30:53.288875 14533 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf87cb109ad24ee3ae96a5be7b3ba359 [sys.catalog]: This master's current role is: LEADER
I20260809 15:30:53.289255 14532 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf87cb109ad24ee3ae96a5be7b3ba359 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bf87cb109ad24ee3ae96a5be7b3ba359" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf87cb109ad24ee3ae96a5be7b3ba359" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 36175 } } }
I20260809 15:30:53.289357 14532 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf87cb109ad24ee3ae96a5be7b3ba359 [sys.catalog]: This master's current role is: LEADER
I20260809 15:30:53.289623 14540 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:30:53.292779 14540 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:30:53.298422 14540 catalog_manager.cc:1347] Generated new cluster ID: 96b4962d92354d199652d7301175581e
I20260809 15:30:53.298502 14540 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:30:53.317406 14540 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:30:53.318464 14540 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:30:53.326931 14540 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bf87cb109ad24ee3ae96a5be7b3ba359: Generated new TSK 0
I20260809 15:30:53.327868 14540 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.146.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
I20260809 15:30:53.368119 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.1:0
--local_ip_for_outbound_sockets=127.11.146.1
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:36175
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:45687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:30:53.487463 14552 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:30:53.487946 14552 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:30:53.488013 14552 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:30:53.492306 14552 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:30:53.492369 14552 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:30:53.492431 14552 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.1
I20260809 15:30:53.498001 14552 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:45687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:36175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14552
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.1
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:30:53.499104 14552 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:30:53.500362 14552 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:30:53.510701 14560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:53.510782 14552 server_base.cc:1034] running on GCE node
W20260809 15:30:53.510900 14562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:53.510706 14559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:53.511402 14552 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:30:53.512285 14552 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:30:53.513468 14552 hybrid_clock.cc:648] HybridClock initialized: now 1786289453513437 us; error 43 us; skew 500 ppm
Aug 09 15:30:53 dist-test-slave-1jjb krb5kdc[14431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289453, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:30:53.516363 14552 init.cc:377] Logged in from keytab as kudu/127.11.146.1@KRBTEST.COM (short username kudu)
I20260809 15:30:53.517243 14552 webserver.cc:460] Webserver started at http://127.11.146.1:33095/ using document root <none> and password file <none>
I20260809 15:30:53.517822 14552 fs_manager.cc:359] Metadata directory not provided
I20260809 15:30:53.517913 14552 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:30:53.518159 14552 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:30:53.520583 14552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-0/data/instance:
uuid: "52d9957299ef4d49a866bb88814a618e"
format_stamp: "Formatted at 2026-08-09 15:30:53 on dist-test-slave-1jjb"
server_key: "b65efbd9d85325df8584f2e3c3f6bd30"
server_key_iv: "380bf7f6be2a0e61f06251ed54956a7a"
server_key_version: "encryptionkey@0"
I20260809 15:30:53.521209 14552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance:
uuid: "52d9957299ef4d49a866bb88814a618e"
format_stamp: "Formatted at 2026-08-09 15:30:53 on dist-test-slave-1jjb"
server_key: "b65efbd9d85325df8584f2e3c3f6bd30"
server_key_iv: "380bf7f6be2a0e61f06251ed54956a7a"
server_key_version: "encryptionkey@0"
I20260809 15:30:53.525213 14552 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 15:30:53.528231 14571 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:53.529542 14552 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:30:53.529699 14552 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-0/wal
uuid: "52d9957299ef4d49a866bb88814a618e"
format_stamp: "Formatted at 2026-08-09 15:30:53 on dist-test-slave-1jjb"
server_key: "b65efbd9d85325df8584f2e3c3f6bd30"
server_key_iv: "380bf7f6be2a0e61f06251ed54956a7a"
server_key_version: "encryptionkey@0"
I20260809 15:30:53.529825 14552 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:30:53.553784 14552 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:30:53.557350 14552 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:30:53.557592 14552 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:30:53.558245 14552 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:30:53.559150 14552 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:30:53.559237 14552 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:53.559338 14552 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:30:53.559393 14552 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:53.569852 14552 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.1:39857
I20260809 15:30:53.569878 14689 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.1:39857 every 8 connection(s)
I20260809 15:30:53.570799 14552 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
I20260809 15:30:53.576270 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 14552
I20260809 15:30:53.576399 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance
I20260809 15:30:53.576696 11848 external_mini_cluster.cc:1428] Setting key 9c74d1f3f2790ff5afaed8c9e9dc971a
Aug 09 15:30:53 dist-test-slave-1jjb krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289453, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:30:53.586706 14529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:53.572757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:51191 (local address 127.11.146.62:36175)
0809 15:30:53.572913 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:53.572917 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:53.573743 (+ 826us) server_negotiation.cc:407] Connection header received
0809 15:30:53.575241 (+ 1498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:53.575244 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:53.575307 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:53.575416 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:53.577098 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:53.577731 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:53.578921 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:53.579161 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:53.579272 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:53.582250 (+ 2978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:53.582256 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:53.582262 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:53.582298 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:53.584100 (+ 1802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:53.584746 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:53.584753 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:53.584756 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:53.584861 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:53.585215 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:53.585221 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:53.585224 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:53.585531 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:53.585659 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:53.586317 (+ 658us) server_negotiation.cc:299] Negotiation successful
0809 15:30:53.586476 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 15:30:53.587842 14692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:53.573120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:36175 (local address 127.11.146.1:51191)
0809 15:30:53.573590 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:53.573634 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:53.575017 (+ 1383us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:53.575778 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:53.575787 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:53.576283 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:30:53.576941 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:53.576959 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:53.577866 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:53.577874 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:53.578776 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:53.578786 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:53.579331 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:53.579335 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:53.579516 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:53.580263 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:30:53.580293 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:30:53.582063 (+ 1770us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:30:53.584286 (+ 2223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:53.584292 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:53.584305 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:53.584627 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:53.584972 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:53.584974 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:53.584976 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:53.585115 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:53.585740 (+ 625us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:30:53.585746 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:30:53.586036 (+ 290us) client_negotiation.cc:769] Sending connection context
0809 15:30:53.586222 (+ 186us) client_negotiation.cc:240] Negotiation successful
0809 15:30:53.586535 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":120,"threads_started":1}
WARNING: no policy specified for kudu/127.11.146.2@KRBTEST.COM; defaulting to no policy
I20260809 15:30:53.589295 14690 heartbeater.cc:347] Connected to a master server at 127.11.146.62:36175
I20260809 15:30:53.589572 14690 heartbeater.cc:464] Registering TS with master...
I20260809 15:30:53.590109 14690 heartbeater.cc:511] Master 127.11.146.62:36175 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.2@KRBTEST.COM" created.
I20260809 15:30:53.592020 14481 ts_manager.cc:194] Registered new tserver with Master: 52d9957299ef4d49a866bb88814a618e (127.11.146.1:39857)
I20260809 15:30:53.593231 14481 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.1@KRBTEST.COM'} at 127.11.146.1:51191
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
I20260809 15:30:53.610678 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.2:0
--local_ip_for_outbound_sockets=127.11.146.2
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:36175
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:45687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:30:53.726747 14695 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:30:53.727021 14695 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:30:53.727101 14695 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:30:53.731243 14695 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:30:53.731300 14695 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:30:53.731359 14695 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.2
I20260809 15:30:53.737385 14695 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:45687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:36175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14695
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.2
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:30:53.738510 14695 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:30:53.739565 14695 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:30:53.749584 14701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:53.749758 14695 server_base.cc:1034] running on GCE node
W20260809 15:30:53.749609 14700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:53.749624 14703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:53.750344 14695 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:30:53.750988 14695 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:30:53.752202 14695 hybrid_clock.cc:648] HybridClock initialized: now 1786289453752169 us; error 30 us; skew 500 ppm
Aug 09 15:30:53 dist-test-slave-1jjb krb5kdc[14431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289453, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:30:53.755895 14695 init.cc:377] Logged in from keytab as kudu/127.11.146.2@KRBTEST.COM (short username kudu)
I20260809 15:30:53.756836 14695 webserver.cc:460] Webserver started at http://127.11.146.2:34633/ using document root <none> and password file <none>
I20260809 15:30:53.757403 14695 fs_manager.cc:359] Metadata directory not provided
I20260809 15:30:53.757496 14695 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:30:53.757759 14695 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:30:53.759807 14695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-1/data/instance:
uuid: "da63285139494783bce1ddf12d50673c"
format_stamp: "Formatted at 2026-08-09 15:30:53 on dist-test-slave-1jjb"
server_key: "25f318e3a6ff2960cbf476e0ecf5e1e8"
server_key_iv: "9a822e93fe371036b56742f8bc8f8786"
server_key_version: "encryptionkey@0"
I20260809 15:30:53.760386 14695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance:
uuid: "da63285139494783bce1ddf12d50673c"
format_stamp: "Formatted at 2026-08-09 15:30:53 on dist-test-slave-1jjb"
server_key: "25f318e3a6ff2960cbf476e0ecf5e1e8"
server_key_iv: "9a822e93fe371036b56742f8bc8f8786"
server_key_version: "encryptionkey@0"
I20260809 15:30:53.764295 14695 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 15:30:53.766921 14711 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:53.768496 14695 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:30:53.768641 14695 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-1/wal
uuid: "da63285139494783bce1ddf12d50673c"
format_stamp: "Formatted at 2026-08-09 15:30:53 on dist-test-slave-1jjb"
server_key: "25f318e3a6ff2960cbf476e0ecf5e1e8"
server_key_iv: "9a822e93fe371036b56742f8bc8f8786"
server_key_version: "encryptionkey@0"
I20260809 15:30:53.768761 14695 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:30:53.785120 14695 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:30:53.788772 14695 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:30:53.789011 14695 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:30:53.789716 14695 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:30:53.790578 14695 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:30:53.790661 14695 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:53.790736 14695 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:30:53.790771 14695 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:53.800400 14695 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.2:40605
I20260809 15:30:53.800496 14831 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.2:40605 every 8 connection(s)
I20260809 15:30:53.801379 14695 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
I20260809 15:30:53.808797 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 14695
I20260809 15:30:53.808914 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance
I20260809 15:30:53.809274 11848 external_mini_cluster.cc:1428] Setting key 0fd932c98cd5034ae1de5ccac6dfcbc2
Aug 09 15:30:53 dist-test-slave-1jjb krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289453, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:30:53.816443 14529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:53.803261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:52381 (local address 127.11.146.62:36175)
0809 15:30:53.803402 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:53.803406 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:53.804327 (+ 921us) server_negotiation.cc:407] Connection header received
0809 15:30:53.805615 (+ 1288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:53.805619 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:53.805666 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:53.805742 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:53.806877 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:53.807399 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:53.808592 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:53.808930 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:53.809067 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:53.811996 (+ 2929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:53.812003 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:53.812006 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:53.812038 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:53.813865 (+ 1827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:53.814555 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:53.814558 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:53.814559 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:53.814638 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:53.815069 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:53.815071 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:53.815072 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:53.815251 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:53.815326 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:53.816211 (+ 885us) server_negotiation.cc:299] Negotiation successful
0809 15:30:53.816319 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 15:30:53.817770 14834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:53.803649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:36175 (local address 127.11.146.2:52381)
0809 15:30:53.804174 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:53.804217 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:53.805375 (+ 1158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:53.805906 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:53.805912 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:53.806257 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:30:53.806745 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:53.806758 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:53.807516 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:53.807519 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:53.808432 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:53.808442 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:53.809101 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:53.809104 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:53.809255 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:53.809957 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:30:53.809977 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:30:53.811809 (+ 1832us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:30:53.814004 (+ 2195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:53.814014 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:53.814034 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:53.814429 (+ 395us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:53.814736 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:53.814742 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:53.814746 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:53.814967 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:53.815383 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:30:53.815392 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:30:53.815870 (+ 478us) client_negotiation.cc:769] Sending connection context
0809 15:30:53.816137 (+ 267us) client_negotiation.cc:240] Negotiation successful
0809 15:30:53.816534 (+ 397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":121,"threads_started":1}
I20260809 15:30:53.819038 14832 heartbeater.cc:347] Connected to a master server at 127.11.146.62:36175
I20260809 15:30:53.819303 14832 heartbeater.cc:464] Registering TS with master...
I20260809 15:30:53.819859 14832 heartbeater.cc:511] Master 127.11.146.62:36175 requested a full tablet report, sending...
I20260809 15:30:53.821049 14481 ts_manager.cc:194] Registered new tserver with Master: da63285139494783bce1ddf12d50673c (127.11.146.2:40605)
WARNING: no policy specified for kudu/127.11.146.3@KRBTEST.COM; defaulting to no policy
I20260809 15:30:53.821908 14481 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.2@KRBTEST.COM'} at 127.11.146.2:52381
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
I20260809 15:30:53.843533 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.3:0
--local_ip_for_outbound_sockets=127.11.146.3
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:36175
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:45687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:30:53.961091 14837 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:30:53.961351 14837 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:30:53.961395 14837 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:30:53.965464 14837 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:30:53.965525 14837 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:30:53.965582 14837 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.3
I20260809 15:30:53.970768 14837 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:45687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:36175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14837
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.3
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:30:53.971827 14837 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:30:53.972950 14837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:30:53.983026 14843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:53.983049 14844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:53.983209 14837 server_base.cc:1034] running on GCE node
W20260809 15:30:53.983376 14846 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:53.983893 14837 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:30:53.984644 14837 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:30:53.985845 14837 hybrid_clock.cc:648] HybridClock initialized: now 1786289453985826 us; error 30 us; skew 500 ppm
Aug 09 15:30:53 dist-test-slave-1jjb krb5kdc[14431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289453, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:30:53.989300 14837 init.cc:377] Logged in from keytab as kudu/127.11.146.3@KRBTEST.COM (short username kudu)
I20260809 15:30:53.990355 14837 webserver.cc:460] Webserver started at http://127.11.146.3:43633/ using document root <none> and password file <none>
I20260809 15:30:53.990957 14837 fs_manager.cc:359] Metadata directory not provided
I20260809 15:30:53.991047 14837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:30:53.991300 14837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:30:53.993513 14837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-2/data/instance:
uuid: "5f296ad340c64cb7b31d012ec3c1e4e2"
format_stamp: "Formatted at 2026-08-09 15:30:53 on dist-test-slave-1jjb"
server_key: "e874e8b7b4a1efffa1551a279d2d267a"
server_key_iv: "bb996b12334cd2ce2890cfe159cc6b2d"
server_key_version: "encryptionkey@0"
I20260809 15:30:53.994098 14837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance:
uuid: "5f296ad340c64cb7b31d012ec3c1e4e2"
format_stamp: "Formatted at 2026-08-09 15:30:53 on dist-test-slave-1jjb"
server_key: "e874e8b7b4a1efffa1551a279d2d267a"
server_key_iv: "bb996b12334cd2ce2890cfe159cc6b2d"
server_key_version: "encryptionkey@0"
I20260809 15:30:53.998219 14837 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 15:30:54.000880 14853 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:54.002245 14837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 15:30:54.002404 14837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-2/wal
uuid: "5f296ad340c64cb7b31d012ec3c1e4e2"
format_stamp: "Formatted at 2026-08-09 15:30:53 on dist-test-slave-1jjb"
server_key: "e874e8b7b4a1efffa1551a279d2d267a"
server_key_iv: "bb996b12334cd2ce2890cfe159cc6b2d"
server_key_version: "encryptionkey@0"
I20260809 15:30:54.002529 14837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:30:54.030550 14837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:30:54.033828 14837 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:30:54.034065 14837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:30:54.034755 14837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:30:54.035640 14837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:30:54.035714 14837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:54.035789 14837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:30:54.035841 14837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:54.045643 14837 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.3:41517
I20260809 15:30:54.045666 14972 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.3:41517 every 8 connection(s)
I20260809 15:30:54.046609 14837 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
I20260809 15:30:54.051473 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 14837
I20260809 15:30:54.051595 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance
I20260809 15:30:54.051885 11848 external_mini_cluster.cc:1428] Setting key c25ec29d9e8bc5d58b7f300db7070c50
Aug 09 15:30:54 dist-test-slave-1jjb krb5kdc[14431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289453, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:30:54.061285 14529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:54.048703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:52041 (local address 127.11.146.62:36175)
0809 15:30:54.048888 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:54.048892 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:54.049728 (+ 836us) server_negotiation.cc:407] Connection header received
0809 15:30:54.051112 (+ 1384us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:54.051115 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:54.051185 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:54.051328 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:54.053040 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:54.053668 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:54.054895 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:54.055118 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:54.055228 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:54.057737 (+ 2509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:54.057747 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:54.057749 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:54.057772 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:54.059033 (+ 1261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:54.059548 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:54.059551 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:54.059552 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:54.059729 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:54.060176 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:54.060181 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:54.060188 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:54.060365 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:54.060506 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:54.060995 (+ 489us) server_negotiation.cc:299] Negotiation successful
0809 15:30:54.061118 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 15:30:54.062044 14975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:54.049071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:36175 (local address 127.11.146.3:52041)
0809 15:30:54.049564 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:54.049609 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:54.050884 (+ 1275us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:54.051500 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:54.051507 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:54.052064 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:30:54.052882 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:54.052901 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:54.053795 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:54.053799 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:54.054765 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:54.054775 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:54.055269 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:54.055273 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:54.055453 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:54.056041 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:30:54.056064 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:30:54.057577 (+ 1513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:30:54.059150 (+ 1573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:54.059156 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:54.059170 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:54.059419 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:54.059863 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:54.059866 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:54.059868 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:54.060030 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:54.060502 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:30:54.060508 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:30:54.060746 (+ 238us) client_negotiation.cc:769] Sending connection context
0809 15:30:54.060939 (+ 193us) client_negotiation.cc:240] Negotiation successful
0809 15:30:54.061251 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":123,"threads_started":1}
I20260809 15:30:54.063162 14973 heartbeater.cc:347] Connected to a master server at 127.11.146.62:36175
I20260809 15:30:54.063380 14973 heartbeater.cc:464] Registering TS with master...
I20260809 15:30:54.063812 14973 heartbeater.cc:511] Master 127.11.146.62:36175 requested a full tablet report, sending...
I20260809 15:30:54.064955 14481 ts_manager.cc:194] Registered new tserver with Master: 5f296ad340c64cb7b31d012ec3c1e4e2 (127.11.146.3:41517)
I20260809 15:30:54.065542 14481 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.3@KRBTEST.COM'} at 127.11.146.3:52041
I20260809 15:30:54.065949 11848 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 15:30:54.082095 14529 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:30:54.080630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51522 (local address 127.11.146.62:36175)
0809 15:30:54.080829 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:54.080832 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:54.080900 (+ 68us) server_negotiation.cc:407] Connection header received
0809 15:30:54.081015 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:54.081018 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:54.081065 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:54.081137 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:54.081941 (+ 804us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51522: BlockingRecv error: recv got EOF from 127.0.0.1:51522 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
I20260809 15:30:54.083449 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 14552
I20260809 15:30:54.093511 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 14695
I20260809 15:30:54.103137 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 14837
I20260809 15:30:54.110805 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 14445
2026-08-09T15:30:54Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2308 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:30:54 dist-test-slave-1jjb krb5kdc[14986](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:30:54 dist-test-slave-1jjb krb5kdc[14986](info): set up 2 sockets
Aug 09 15:30:54 dist-test-slave-1jjb krb5kdc[14986](info): commencing operation
krb5kdc: starting...
W20260809 15:30:55.348290 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.213s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
W20260809 15:30:55.481678 11848 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.133s user 0.001s sys 0.001s
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260809 15:30:55.625165 11848 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.143s user 0.001s sys 0.001s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260809 15:30:55.808904 11848 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.184s user 0.001s sys 0.001s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786289437399694-11848-0/krb5kdc/test-user.keytab.
W20260809 15:30:56.331193 11848 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.522s user 0.001s sys 0.001s
Aug 09 15:30:56 dist-test-slave-1jjb krb5kdc[14986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:30:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:30:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.146.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
I20260809 15:30:56.386876 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:41711
--webserver_interface=127.11.146.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:33465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:41711
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:30:56.508903 14999 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:30:56.509506 14999 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:30:56.509639 14999 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:30:56.514052 14999 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:30:56.514146 14999 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:30:56.514185 14999 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:30:56.514240 14999 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:30:56.514277 14999 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:30:56.519891 14999 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:33465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:41711
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:41711
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14999
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:30:56.521116 14999 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:30:56.522224 14999 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:30:56.531054 15004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:56.531091 15008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:56.531150 15005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:56.531499 14999 server_base.cc:1034] running on GCE node
I20260809 15:30:56.532380 14999 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:30:56.533489 14999 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:30:56.534701 14999 hybrid_clock.cc:648] HybridClock initialized: now 1786289456534677 us; error 36 us; skew 500 ppm
Aug 09 15:30:56 dist-test-slave-1jjb krb5kdc[14986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289456, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:30:56.542057 14999 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:30:56.543102 14999 webserver.cc:460] Webserver started at http://127.11.146.62:44353/ using document root <none> and password file <none>
I20260809 15:30:56.543695 14999 fs_manager.cc:359] Metadata directory not provided
I20260809 15:30:56.543797 14999 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:30:56.544049 14999 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:30:56.546218 14999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "39ddbf7b391b4f198d969372e7f236bd"
format_stamp: "Formatted at 2026-08-09 15:30:56 on dist-test-slave-1jjb"
server_key: "1ed980b0ec0ca59f88783d28a1aee6c4"
server_key_iv: "f270cb1a90032b9f0226bcf89a5b64b6"
server_key_version: "encryptionkey@0"
I20260809 15:30:56.546788 14999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "39ddbf7b391b4f198d969372e7f236bd"
format_stamp: "Formatted at 2026-08-09 15:30:56 on dist-test-slave-1jjb"
server_key: "1ed980b0ec0ca59f88783d28a1aee6c4"
server_key_iv: "f270cb1a90032b9f0226bcf89a5b64b6"
server_key_version: "encryptionkey@0"
I20260809 15:30:56.550738 14999 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 15:30:56.553244 15021 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:56.554589 14999 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:30:56.554736 14999 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "39ddbf7b391b4f198d969372e7f236bd"
format_stamp: "Formatted at 2026-08-09 15:30:56 on dist-test-slave-1jjb"
server_key: "1ed980b0ec0ca59f88783d28a1aee6c4"
server_key_iv: "f270cb1a90032b9f0226bcf89a5b64b6"
server_key_version: "encryptionkey@0"
I20260809 15:30:56.554870 14999 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:30:56.571992 14999 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:30:56.575676 14999 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:30:56.575939 14999 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:30:56.584205 14999 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:41711
I20260809 15:30:56.584630 15075 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:41711 every 8 connection(s)
I20260809 15:30:56.585366 14999 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:30:56.588855 15076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:30:56.594812 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 14999
I20260809 15:30:56.594960 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:30:56.594974 15076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39ddbf7b391b4f198d969372e7f236bd: Bootstrap starting.
I20260809 15:30:56.595249 11848 external_mini_cluster.cc:1428] Setting key 34f3aa9ac6268fb5a25217028b84ccee
I20260809 15:30:56.597956 15076 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 39ddbf7b391b4f198d969372e7f236bd: Neither blocks nor log segments found. Creating new log.
I20260809 15:30:56.598739 15076 log.cc:824] T 00000000000000000000000000000000 P 39ddbf7b391b4f198d969372e7f236bd: Log is configured to *not* fsync() on all Append() calls
I20260809 15:30:56.600780 15076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39ddbf7b391b4f198d969372e7f236bd: No bootstrap required, opened a new log
Aug 09 15:30:56 dist-test-slave-1jjb krb5kdc[14986](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:30:56.605561 15076 raft_consensus.cc:348] T 00000000000000000000000000000000 P 39ddbf7b391b4f198d969372e7f236bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39ddbf7b391b4f198d969372e7f236bd" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 41711 } }
I20260809 15:30:56.605891 15076 raft_consensus.cc:374] T 00000000000000000000000000000000 P 39ddbf7b391b4f198d969372e7f236bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:30:56.606021 15076 raft_consensus.cc:729] T 00000000000000000000000000000000 P 39ddbf7b391b4f198d969372e7f236bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39ddbf7b391b4f198d969372e7f236bd, State: Initialized, Role: FOLLOWER
I20260809 15:30:56.606635 15076 consensus_queue.cc:260] T 00000000000000000000000000000000 P 39ddbf7b391b4f198d969372e7f236bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39ddbf7b391b4f198d969372e7f236bd" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 41711 } }
I20260809 15:30:56.606837 15076 raft_consensus.cc:388] T 00000000000000000000000000000000 P 39ddbf7b391b4f198d969372e7f236bd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:30:56.606915 15076 raft_consensus.cc:482] T 00000000000000000000000000000000 P 39ddbf7b391b4f198d969372e7f236bd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:30:56.607039 15076 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 39ddbf7b391b4f198d969372e7f236bd [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:30:56.608367 15076 raft_consensus.cc:504] T 00000000000000000000000000000000 P 39ddbf7b391b4f198d969372e7f236bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39ddbf7b391b4f198d969372e7f236bd" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 41711 } }
I20260809 15:30:56.608794 15076 leader_election.cc:302] T 00000000000000000000000000000000 P 39ddbf7b391b4f198d969372e7f236bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 39ddbf7b391b4f198d969372e7f236bd; no voters:
I20260809 15:30:56.609164 15076 leader_election.cc:288] T 00000000000000000000000000000000 P 39ddbf7b391b4f198d969372e7f236bd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:30:56.609318 15081 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 39ddbf7b391b4f198d969372e7f236bd [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:30:56.609563 15081 raft_consensus.cc:686] T 00000000000000000000000000000000 P 39ddbf7b391b4f198d969372e7f236bd [term 1 LEADER]: Becoming Leader. State: Replica: 39ddbf7b391b4f198d969372e7f236bd, State: Running, Role: LEADER
I20260809 15:30:56.609923 15081 consensus_queue.cc:237] T 00000000000000000000000000000000 P 39ddbf7b391b4f198d969372e7f236bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39ddbf7b391b4f198d969372e7f236bd" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 41711 } }
I20260809 15:30:56.610641 15076 sys_catalog.cc:564] T 00000000000000000000000000000000 P 39ddbf7b391b4f198d969372e7f236bd [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:30:56.611826 15079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:56.596818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44018 (local address 127.11.146.62:41711)
0809 15:30:56.597322 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:56.597338 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:56.597376 (+ 38us) server_negotiation.cc:407] Connection header received
0809 15:30:56.598150 (+ 774us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:56.598170 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:56.598510 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:56.598879 (+ 369us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:56.599806 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:56.600896 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:56.602081 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:56.602621 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:56.602743 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:56.605795 (+ 3052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:56.605802 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:56.605820 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:56.605855 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:56.608196 (+ 2341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:56.608688 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:56.608695 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:56.608701 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:56.608847 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:56.609253 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:56.609260 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:56.609262 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:56.609803 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:56.610048 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:56.610354 (+ 306us) server_negotiation.cc:299] Negotiation successful
0809 15:30:56.610661 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":134,"threads_started":1}
I20260809 15:30:56.612233 15083 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39ddbf7b391b4f198d969372e7f236bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39ddbf7b391b4f198d969372e7f236bd. Latest consensus state: current_term: 1 leader_uuid: "39ddbf7b391b4f198d969372e7f236bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39ddbf7b391b4f198d969372e7f236bd" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 41711 } } }
I20260809 15:30:56.612322 15083 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39ddbf7b391b4f198d969372e7f236bd [sys.catalog]: This master's current role is: LEADER
I20260809 15:30:56.612025 15082 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39ddbf7b391b4f198d969372e7f236bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "39ddbf7b391b4f198d969372e7f236bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39ddbf7b391b4f198d969372e7f236bd" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 41711 } } }
I20260809 15:30:56.612665 15082 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39ddbf7b391b4f198d969372e7f236bd [sys.catalog]: This master's current role is: LEADER
I20260809 15:30:56.613054 15090 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:30:56.615283 11848 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:30:56.617051 15090 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:30:56.623286 15090 catalog_manager.cc:1347] Generated new cluster ID: 13ab5eff37584a3bb1c89796181a1b01
I20260809 15:30:56.623421 15090 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:30:56.637318 15090 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:30:56.638644 15090 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:30:56.645359 15079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:56.639784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44024 (local address 127.11.146.62:41711)
0809 15:30:56.639928 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:56.639933 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:56.640253 (+ 320us) server_negotiation.cc:407] Connection header received
0809 15:30:56.640423 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:56.640426 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:56.640478 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:56.640567 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:56.641112 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:56.641681 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:56.642904 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:56.643164 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:56.643279 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:56.644235 (+ 956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:56.644239 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:56.644243 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:30:56.644846 (+ 603us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:56.644884 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:30:56.644905 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:56.644992 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:56.645143 (+ 151us) server_negotiation.cc:299] Negotiation successful
0809 15:30:56.645211 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 15:30:56.646054 15090 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 39ddbf7b391b4f198d969372e7f236bd: Generated new TSK 0
I20260809 15:30:56.646854 15090 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:30:56.653719 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 14999
2026-08-09T15:30:56Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2545 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:30:56 dist-test-slave-1jjb krb5kdc[15110](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:30:56 dist-test-slave-1jjb krb5kdc[15110](info): set up 2 sockets
Aug 09 15:30:56 dist-test-slave-1jjb krb5kdc[15110](info): commencing operation
krb5kdc: starting...
W20260809 15:30:57.797456 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.117s user 0.005s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:30:57 dist-test-slave-1jjb krb5kdc[15110](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:30:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:30:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.146.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
I20260809 15:30:57.935302 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:46735
--webserver_interface=127.11.146.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:43317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:46735
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:30:58.052526 15123 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:30:58.052779 15123 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:30:58.052820 15123 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:30:58.056738 15123 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:30:58.056784 15123 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:30:58.056803 15123 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:30:58.056819 15123 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:30:58.056834 15123 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:30:58.061940 15123 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:43317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:46735
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:46735
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15123
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:30:58.062942 15123 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:30:58.063973 15123 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:30:58.072759 15131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:58.072772 15129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:58.072772 15128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:58.073376 15123 server_base.cc:1034] running on GCE node
I20260809 15:30:58.073933 15123 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:30:58.075169 15123 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:30:58.076412 15123 hybrid_clock.cc:648] HybridClock initialized: now 1786289458076389 us; error 33 us; skew 500 ppm
Aug 09 15:30:58 dist-test-slave-1jjb krb5kdc[15110](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289458, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:30:58.079382 15123 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:30:58.080413 15123 webserver.cc:460] Webserver started at http://127.11.146.62:37625/ using document root <none> and password file <none>
I20260809 15:30:58.080998 15123 fs_manager.cc:359] Metadata directory not provided
I20260809 15:30:58.081091 15123 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:30:58.081336 15123 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:30:58.083452 15123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "57483eac6534480195e70a44863faa0e"
format_stamp: "Formatted at 2026-08-09 15:30:58 on dist-test-slave-1jjb"
server_key: "b4d1139e098a8e64b9fa111507d180fe"
server_key_iv: "8f5bb4e66711a564e2002fc3c1ae4665"
server_key_version: "encryptionkey@0"
I20260809 15:30:58.084038 15123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "57483eac6534480195e70a44863faa0e"
format_stamp: "Formatted at 2026-08-09 15:30:58 on dist-test-slave-1jjb"
server_key: "b4d1139e098a8e64b9fa111507d180fe"
server_key_iv: "8f5bb4e66711a564e2002fc3c1ae4665"
server_key_version: "encryptionkey@0"
I20260809 15:30:58.087867 15123 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:30:58.090324 15138 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:58.091501 15123 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:30:58.091740 15123 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "57483eac6534480195e70a44863faa0e"
format_stamp: "Formatted at 2026-08-09 15:30:58 on dist-test-slave-1jjb"
server_key: "b4d1139e098a8e64b9fa111507d180fe"
server_key_iv: "8f5bb4e66711a564e2002fc3c1ae4665"
server_key_version: "encryptionkey@0"
I20260809 15:30:58.091874 15123 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:30:58.105113 15123 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:30:58.108702 15123 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:30:58.108927 15123 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:30:58.116062 15123 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:46735
I20260809 15:30:58.116389 15191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:46735 every 8 connection(s)
I20260809 15:30:58.117164 15123 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:30:58.120025 15192 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:30:58.123054 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 15123
I20260809 15:30:58.123212 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:30:58.123499 11848 external_mini_cluster.cc:1428] Setting key 9efb39b423a0a44e93d03b3f2dfbaad4
I20260809 15:30:58.126082 15192 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57483eac6534480195e70a44863faa0e: Bootstrap starting.
I20260809 15:30:58.128866 15192 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57483eac6534480195e70a44863faa0e: Neither blocks nor log segments found. Creating new log.
I20260809 15:30:58.129737 15192 log.cc:824] T 00000000000000000000000000000000 P 57483eac6534480195e70a44863faa0e: Log is configured to *not* fsync() on all Append() calls
I20260809 15:30:58.131839 15192 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57483eac6534480195e70a44863faa0e: No bootstrap required, opened a new log
Aug 09 15:30:58 dist-test-slave-1jjb krb5kdc[15110](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:30:58.135205 15192 raft_consensus.cc:348] T 00000000000000000000000000000000 P 57483eac6534480195e70a44863faa0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57483eac6534480195e70a44863faa0e" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 46735 } }
I20260809 15:30:58.135457 15192 raft_consensus.cc:374] T 00000000000000000000000000000000 P 57483eac6534480195e70a44863faa0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:30:58.135558 15192 raft_consensus.cc:729] T 00000000000000000000000000000000 P 57483eac6534480195e70a44863faa0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57483eac6534480195e70a44863faa0e, State: Initialized, Role: FOLLOWER
I20260809 15:30:58.136068 15192 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57483eac6534480195e70a44863faa0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57483eac6534480195e70a44863faa0e" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 46735 } }
I20260809 15:30:58.136277 15192 raft_consensus.cc:388] T 00000000000000000000000000000000 P 57483eac6534480195e70a44863faa0e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:30:58.136370 15192 raft_consensus.cc:482] T 00000000000000000000000000000000 P 57483eac6534480195e70a44863faa0e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:30:58.136472 15192 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 57483eac6534480195e70a44863faa0e [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:30:58.137385 15192 raft_consensus.cc:504] T 00000000000000000000000000000000 P 57483eac6534480195e70a44863faa0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57483eac6534480195e70a44863faa0e" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 46735 } }
I20260809 15:30:58.137749 15192 leader_election.cc:302] T 00000000000000000000000000000000 P 57483eac6534480195e70a44863faa0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57483eac6534480195e70a44863faa0e; no voters:
I20260809 15:30:58.138124 15192 leader_election.cc:288] T 00000000000000000000000000000000 P 57483eac6534480195e70a44863faa0e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:30:58.138175 15197 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 57483eac6534480195e70a44863faa0e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:30:58.138403 15197 raft_consensus.cc:686] T 00000000000000000000000000000000 P 57483eac6534480195e70a44863faa0e [term 1 LEADER]: Becoming Leader. State: Replica: 57483eac6534480195e70a44863faa0e, State: Running, Role: LEADER
I20260809 15:30:58.138700 15197 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57483eac6534480195e70a44863faa0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57483eac6534480195e70a44863faa0e" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 46735 } }
I20260809 15:30:58.139456 15192 sys_catalog.cc:564] T 00000000000000000000000000000000 P 57483eac6534480195e70a44863faa0e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:30:58.139770 15195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:58.124993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44350 (local address 127.11.146.62:46735)
0809 15:30:58.125431 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:58.125450 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:58.125492 (+ 42us) server_negotiation.cc:407] Connection header received
0809 15:30:58.126293 (+ 801us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:58.126321 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:58.126741 (+ 420us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:58.127084 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:58.127786 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:58.129330 (+ 1544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:58.130282 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:58.130777 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:58.130957 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:58.133978 (+ 3021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:58.133983 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:58.134004 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:58.134032 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:58.136608 (+ 2576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:58.137075 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:58.137081 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:58.137086 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:58.137215 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:58.137509 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:58.137515 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:58.137518 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:58.137971 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:58.138196 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:58.138589 (+ 393us) server_negotiation.cc:299] Negotiation successful
0809 15:30:58.138962 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":281,"thread_start_us":108,"threads_started":1}
I20260809 15:30:58.139930 15197 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57483eac6534480195e70a44863faa0e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "57483eac6534480195e70a44863faa0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57483eac6534480195e70a44863faa0e" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 46735 } } }
I20260809 15:30:58.140055 15197 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57483eac6534480195e70a44863faa0e [sys.catalog]: This master's current role is: LEADER
I20260809 15:30:58.140241 15198 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57483eac6534480195e70a44863faa0e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57483eac6534480195e70a44863faa0e. Latest consensus state: current_term: 1 leader_uuid: "57483eac6534480195e70a44863faa0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57483eac6534480195e70a44863faa0e" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 46735 } } }
I20260809 15:30:58.140339 15198 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57483eac6534480195e70a44863faa0e [sys.catalog]: This master's current role is: LEADER
I20260809 15:30:58.140493 15201 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:30:58.143719 15201 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:30:58.149154 15201 catalog_manager.cc:1347] Generated new cluster ID: 52ba2116301741158556d611fe407810
I20260809 15:30:58.149223 15201 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:30:58.163038 15201 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:30:58.163996 15201 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:30:58.171348 15201 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 57483eac6534480195e70a44863faa0e: Generated new TSK 0
I20260809 15:30:58.172300 15201 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.146.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
I20260809 15:30:58.202978 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.1:0
--local_ip_for_outbound_sockets=127.11.146.1
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:46735
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:43317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:30:58.323385 15219 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:30:58.323779 15219 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:30:58.323832 15219 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:30:58.327980 15219 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:30:58.328047 15219 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:30:58.328187 15219 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.1
I20260809 15:30:58.333609 15219 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:43317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:46735
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15219
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.1
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:30:58.334586 15219 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:30:58.335553 15219 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:30:58.345389 15224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:58.345484 15227 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:58.345503 15225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:58.345628 15219 server_base.cc:1034] running on GCE node
I20260809 15:30:58.346117 15219 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:30:58.346746 15219 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:30:58.347965 15219 hybrid_clock.cc:648] HybridClock initialized: now 1786289458347948 us; error 34 us; skew 500 ppm
Aug 09 15:30:58 dist-test-slave-1jjb krb5kdc[15110](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289458, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:30:58.351095 15219 init.cc:377] Logged in from keytab as kudu/127.11.146.1@KRBTEST.COM (short username kudu)
I20260809 15:30:58.352254 15219 webserver.cc:460] Webserver started at http://127.11.146.1:42925/ using document root <none> and password file <none>
I20260809 15:30:58.352833 15219 fs_manager.cc:359] Metadata directory not provided
I20260809 15:30:58.352895 15219 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:30:58.353140 15219 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:30:58.355180 15219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-0/data/instance:
uuid: "c3dc13a2af874904a01dafc14d7409c7"
format_stamp: "Formatted at 2026-08-09 15:30:58 on dist-test-slave-1jjb"
server_key: "0a6151f1f0627cf24147246ee81fb91b"
server_key_iv: "64449548fe4e91dc22c1c475c00213e9"
server_key_version: "encryptionkey@0"
I20260809 15:30:58.355901 15219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance:
uuid: "c3dc13a2af874904a01dafc14d7409c7"
format_stamp: "Formatted at 2026-08-09 15:30:58 on dist-test-slave-1jjb"
server_key: "0a6151f1f0627cf24147246ee81fb91b"
server_key_iv: "64449548fe4e91dc22c1c475c00213e9"
server_key_version: "encryptionkey@0"
I20260809 15:30:58.359650 15219 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260809 15:30:58.362255 15234 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:58.363682 15219 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:30:58.363932 15219 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-0/wal
uuid: "c3dc13a2af874904a01dafc14d7409c7"
format_stamp: "Formatted at 2026-08-09 15:30:58 on dist-test-slave-1jjb"
server_key: "0a6151f1f0627cf24147246ee81fb91b"
server_key_iv: "64449548fe4e91dc22c1c475c00213e9"
server_key_version: "encryptionkey@0"
I20260809 15:30:58.364082 15219 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:30:58.384004 15219 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:30:58.387570 15219 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:30:58.387789 15219 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:30:58.388485 15219 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:30:58.389377 15219 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:30:58.389470 15219 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:58.389567 15219 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:30:58.389621 15219 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:58.399263 15219 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.1:46109
I20260809 15:30:58.399303 15353 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.1:46109 every 8 connection(s)
I20260809 15:30:58.400343 15219 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
I20260809 15:30:58.400563 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 15219
I20260809 15:30:58.400686 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance
I20260809 15:30:58.401067 11848 external_mini_cluster.cc:1428] Setting key 204b7bdbda4856d86b6d0e44c2359331
Aug 09 15:30:58 dist-test-slave-1jjb krb5kdc[15110](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289458, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.146.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.2@KRBTEST.COM" created.
I20260809 15:30:58.415300 15195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:58.402369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:36017 (local address 127.11.146.62:46735)
0809 15:30:58.402532 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:58.402537 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:58.403537 (+ 1000us) server_negotiation.cc:407] Connection header received
0809 15:30:58.404972 (+ 1435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:58.404978 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:58.405051 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:58.405148 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:58.406344 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:58.406902 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:58.408207 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:58.408471 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:58.408587 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:58.411185 (+ 2598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:58.411189 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:58.411191 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:58.411217 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:58.412961 (+ 1744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:58.413506 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:58.413510 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:58.413512 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:58.413603 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:58.413997 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:58.414000 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:58.414002 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:58.414254 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:58.414372 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:58.414982 (+ 610us) server_negotiation.cc:299] Negotiation successful
0809 15:30:58.415126 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 15:30:58.416306 15356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:58.402854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:46735 (local address 127.11.146.1:36017)
0809 15:30:58.403349 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:58.403404 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:58.404757 (+ 1353us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:58.405306 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:58.405314 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:58.405691 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:30:58.406185 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:58.406198 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:58.407039 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:58.407043 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:58.408040 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:58.408051 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:58.408631 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:58.408635 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:58.408813 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:58.409516 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:30:58.409533 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:30:58.411000 (+ 1467us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:30:58.413104 (+ 2104us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:58.413110 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:58.413126 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:58.413392 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:58.413702 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:58.413706 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:58.413708 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:58.413895 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:58.414372 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:30:58.414380 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:30:58.414719 (+ 339us) client_negotiation.cc:769] Sending connection context
0809 15:30:58.414939 (+ 220us) client_negotiation.cc:240] Negotiation successful
0809 15:30:58.415282 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":150,"threads_started":1}
I20260809 15:30:58.417644 15354 heartbeater.cc:347] Connected to a master server at 127.11.146.62:46735
I20260809 15:30:58.417917 15354 heartbeater.cc:464] Registering TS with master...
I20260809 15:30:58.418470 15354 heartbeater.cc:511] Master 127.11.146.62:46735 requested a full tablet report, sending...
I20260809 15:30:58.420122 15155 ts_manager.cc:194] Registered new tserver with Master: c3dc13a2af874904a01dafc14d7409c7 (127.11.146.1:46109)
I20260809 15:30:58.421290 15155 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.1@KRBTEST.COM'} at 127.11.146.1:36017
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
I20260809 15:30:58.431460 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.2:0
--local_ip_for_outbound_sockets=127.11.146.2
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:46735
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:43317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:30:58.551050 15359 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:30:58.551301 15359 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:30:58.551343 15359 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:30:58.555503 15359 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:30:58.555673 15359 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:30:58.555755 15359 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.2
I20260809 15:30:58.561691 15359 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:43317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:46735
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15359
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.2
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:30:58.562704 15359 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:30:58.563711 15359 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:30:58.573524 15367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:58.573582 15364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:58.573526 15365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:58.573874 15359 server_base.cc:1034] running on GCE node
I20260809 15:30:58.574433 15359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:30:58.575019 15359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:30:58.576216 15359 hybrid_clock.cc:648] HybridClock initialized: now 1786289458576185 us; error 46 us; skew 500 ppm
Aug 09 15:30:58 dist-test-slave-1jjb krb5kdc[15110](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289458, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:30:58.579079 15359 init.cc:377] Logged in from keytab as kudu/127.11.146.2@KRBTEST.COM (short username kudu)
I20260809 15:30:58.580044 15359 webserver.cc:460] Webserver started at http://127.11.146.2:36499/ using document root <none> and password file <none>
I20260809 15:30:58.580710 15359 fs_manager.cc:359] Metadata directory not provided
I20260809 15:30:58.580773 15359 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:30:58.580943 15359 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:30:58.582919 15359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-1/data/instance:
uuid: "95c1e2e126c4467da08e7a38ae2b794d"
format_stamp: "Formatted at 2026-08-09 15:30:58 on dist-test-slave-1jjb"
server_key: "eb88c11d7fbb1409b14b1e0821ab224b"
server_key_iv: "eb95938748bf006478ec3b78bee1ca74"
server_key_version: "encryptionkey@0"
I20260809 15:30:58.583441 15359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance:
uuid: "95c1e2e126c4467da08e7a38ae2b794d"
format_stamp: "Formatted at 2026-08-09 15:30:58 on dist-test-slave-1jjb"
server_key: "eb88c11d7fbb1409b14b1e0821ab224b"
server_key_iv: "eb95938748bf006478ec3b78bee1ca74"
server_key_version: "encryptionkey@0"
I20260809 15:30:58.587110 15359 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 15:30:58.589668 15374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:58.591113 15359 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260809 15:30:58.591217 15359 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-1/wal
uuid: "95c1e2e126c4467da08e7a38ae2b794d"
format_stamp: "Formatted at 2026-08-09 15:30:58 on dist-test-slave-1jjb"
server_key: "eb88c11d7fbb1409b14b1e0821ab224b"
server_key_iv: "eb95938748bf006478ec3b78bee1ca74"
server_key_version: "encryptionkey@0"
I20260809 15:30:58.591297 15359 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:30:58.608295 15359 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:30:58.611418 15359 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:30:58.611639 15359 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:30:58.612310 15359 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:30:58.613179 15359 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:30:58.613253 15359 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:58.613327 15359 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:30:58.613379 15359 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:58.622653 15359 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.2:34325
I20260809 15:30:58.622675 15493 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.2:34325 every 8 connection(s)
I20260809 15:30:58.623566 15359 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
I20260809 15:30:58.629581 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 15359
I20260809 15:30:58.629726 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance
I20260809 15:30:58.630017 11848 external_mini_cluster.cc:1428] Setting key c1a2eb3755913e239b6134220b810861
Aug 09 15:30:58 dist-test-slave-1jjb krb5kdc[15110](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289458, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:30:58.638610 15195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:58.625527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:59049 (local address 127.11.146.62:46735)
0809 15:30:58.625683 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:58.625687 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:58.626543 (+ 856us) server_negotiation.cc:407] Connection header received
0809 15:30:58.627910 (+ 1367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:58.627913 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:58.627965 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:58.628042 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:58.629359 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:58.630158 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:58.631541 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:58.631831 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:58.631955 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:58.634702 (+ 2747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:58.634705 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:58.634707 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:58.634731 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:58.636466 (+ 1735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:58.637010 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:58.637014 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:58.637017 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:58.637102 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:58.637481 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:58.637486 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:58.637487 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:58.637682 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:58.637793 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:58.638313 (+ 520us) server_negotiation.cc:299] Negotiation successful
0809 15:30:58.638445 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 15:30:58.639710 15496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:58.625912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:46735 (local address 127.11.146.2:59049)
0809 15:30:58.626383 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:58.626426 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:58.627688 (+ 1262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:58.628276 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:58.628283 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:58.628662 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:30:58.629168 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:58.629183 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:58.630286 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:58.630289 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:58.631404 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:58.631417 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:58.631986 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:58.631989 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:58.632193 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:58.632848 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:30:58.632865 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:30:58.634516 (+ 1651us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:30:58.636595 (+ 2079us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:58.636601 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:58.636619 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:58.636899 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:58.637198 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:58.637202 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:58.637204 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:58.637376 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:58.637792 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:30:58.637800 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:30:58.638066 (+ 266us) client_negotiation.cc:769] Sending connection context
0809 15:30:58.638268 (+ 202us) client_negotiation.cc:240] Negotiation successful
0809 15:30:58.638622 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":125,"threads_started":1}
WARNING: no policy specified for kudu/127.11.146.3@KRBTEST.COM; defaulting to no policy
I20260809 15:30:58.641121 15494 heartbeater.cc:347] Connected to a master server at 127.11.146.62:46735
I20260809 15:30:58.641440 15494 heartbeater.cc:464] Registering TS with master...
I20260809 15:30:58.642088 15494 heartbeater.cc:511] Master 127.11.146.62:46735 requested a full tablet report, sending...
I20260809 15:30:58.643276 15155 ts_manager.cc:194] Registered new tserver with Master: 95c1e2e126c4467da08e7a38ae2b794d (127.11.146.2:34325)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.3@KRBTEST.COM" created.
I20260809 15:30:58.643940 15155 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.2@KRBTEST.COM'} at 127.11.146.2:59049
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
I20260809 15:30:58.661409 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.3:0
--local_ip_for_outbound_sockets=127.11.146.3
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:46735
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:43317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:30:58.788843 15499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:30:58.789142 15499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:30:58.789191 15499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:30:58.793632 15499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:30:58.793710 15499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:30:58.793808 15499 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.3
I20260809 15:30:58.799800 15499 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:43317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:46735
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15499
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.3
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:30:58.801095 15499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:30:58.802239 15499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:30:58.812945 15507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:58.813057 15499 server_base.cc:1034] running on GCE node
W20260809 15:30:58.812999 15504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:30:58.812999 15505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:30:58.813733 15499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:30:58.814390 15499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:30:58.815605 15499 hybrid_clock.cc:648] HybridClock initialized: now 1786289458815588 us; error 27 us; skew 500 ppm
Aug 09 15:30:58 dist-test-slave-1jjb krb5kdc[15110](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289458, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:30:58.818694 15499 init.cc:377] Logged in from keytab as kudu/127.11.146.3@KRBTEST.COM (short username kudu)
I20260809 15:30:58.819679 15499 webserver.cc:460] Webserver started at http://127.11.146.3:45733/ using document root <none> and password file <none>
I20260809 15:30:58.820305 15499 fs_manager.cc:359] Metadata directory not provided
I20260809 15:30:58.820372 15499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:30:58.820542 15499 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:30:58.822587 15499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-2/data/instance:
uuid: "82b454c9faca4804a40f547ae0319174"
format_stamp: "Formatted at 2026-08-09 15:30:58 on dist-test-slave-1jjb"
server_key: "a76d932db48c6ecbfd1b7dc256bf54ff"
server_key_iv: "d6056caa6fcfb0aa7d3a4f82a3a11592"
server_key_version: "encryptionkey@0"
I20260809 15:30:58.823124 15499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance:
uuid: "82b454c9faca4804a40f547ae0319174"
format_stamp: "Formatted at 2026-08-09 15:30:58 on dist-test-slave-1jjb"
server_key: "a76d932db48c6ecbfd1b7dc256bf54ff"
server_key_iv: "d6056caa6fcfb0aa7d3a4f82a3a11592"
server_key_version: "encryptionkey@0"
I20260809 15:30:58.827052 15499 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260809 15:30:58.830006 15515 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:58.831440 15499 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:30:58.831723 15499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-2/wal
uuid: "82b454c9faca4804a40f547ae0319174"
format_stamp: "Formatted at 2026-08-09 15:30:58 on dist-test-slave-1jjb"
server_key: "a76d932db48c6ecbfd1b7dc256bf54ff"
server_key_iv: "d6056caa6fcfb0aa7d3a4f82a3a11592"
server_key_version: "encryptionkey@0"
I20260809 15:30:58.831883 15499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:30:58.855592 15499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:30:58.859239 15499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:30:58.859409 15499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:30:58.860368 15499 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:30:58.861346 15499 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:30:58.861413 15499 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:58.861483 15499 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:30:58.861521 15499 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:30:58.871140 15499 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.3:45295
I20260809 15:30:58.871212 15634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.3:45295 every 8 connection(s)
I20260809 15:30:58.872395 15499 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
I20260809 15:30:58.880347 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 15499
I20260809 15:30:58.880492 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance
I20260809 15:30:58.880795 11848 external_mini_cluster.cc:1428] Setting key 8d47b9079ea644e1d73157e87c957ed5
Aug 09 15:30:58 dist-test-slave-1jjb krb5kdc[15110](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289458, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:30:58.887218 15195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:58.874435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:60075 (local address 127.11.146.62:46735)
0809 15:30:58.874597 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:58.874608 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:58.875491 (+ 883us) server_negotiation.cc:407] Connection header received
0809 15:30:58.877175 (+ 1684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:58.877179 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:58.877241 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:58.877351 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:58.878549 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:58.879086 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:58.880343 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:58.880659 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:58.880772 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:58.883823 (+ 3051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:58.883826 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:58.883828 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:58.883854 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:58.885202 (+ 1348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:58.885706 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:58.885708 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:58.885709 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:58.885782 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:58.886096 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:58.886098 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:58.886099 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:58.886275 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:58.886350 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:58.886955 (+ 605us) server_negotiation.cc:299] Negotiation successful
0809 15:30:58.887078 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 15:30:58.888293 15637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:58.874843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:46735 (local address 127.11.146.3:60075)
0809 15:30:58.875326 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0809 15:30:58.875369 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 15:30:58.876935 (+ 1566us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:30:58.877526 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:30:58.877532 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:30:58.877912 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:30:58.878401 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:58.878413 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:58.879215 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:58.879225 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:58.880207 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:30:58.880220 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:30:58.880828 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:30:58.880832 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:30:58.881019 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:58.881701 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:30:58.881718 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:30:58.883664 (+ 1946us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:30:58.885323 (+ 1659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:58.885328 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:58.885341 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:58.885616 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:58.885862 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:30:58.885865 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:30:58.885867 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:30:58.886008 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:30:58.886396 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:30:58.886401 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:30:58.886662 (+ 261us) client_negotiation.cc:769] Sending connection context
0809 15:30:58.886828 (+ 166us) client_negotiation.cc:240] Negotiation successful
0809 15:30:58.887101 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":122,"threads_started":1}
I20260809 15:30:58.889618 15635 heartbeater.cc:347] Connected to a master server at 127.11.146.62:46735
I20260809 15:30:58.889894 15635 heartbeater.cc:464] Registering TS with master...
I20260809 15:30:58.890443 15635 heartbeater.cc:511] Master 127.11.146.62:46735 requested a full tablet report, sending...
I20260809 15:30:58.891536 15155 ts_manager.cc:194] Registered new tserver with Master: 82b454c9faca4804a40f547ae0319174 (127.11.146.3:45295)
I20260809 15:30:58.892206 15155 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.3@KRBTEST.COM'} at 127.11.146.3:60075
I20260809 15:30:58.895751 11848 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 15:30:58 dist-test-slave-1jjb krb5kdc[15110](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289458, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 09 15:30:58 dist-test-slave-1jjb krb5kdc[15110](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289458, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:30:58.925165 15195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:30:58.916070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44356 (local address 127.11.146.62:46735)
0809 15:30:58.916287 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 15:30:58.916292 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:30:58.916470 (+ 178us) server_negotiation.cc:407] Connection header received
0809 15:30:58.916661 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:30:58.916671 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:30:58.916719 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:30:58.916810 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:30:58.917691 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:58.918231 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:58.919092 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:30:58.919318 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:30:58.919432 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:30:58.921952 (+ 2520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:30:58.921961 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:30:58.921963 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:30:58.921990 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:30:58.923344 (+ 1354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:58.923780 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:58.923784 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:58.923786 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:58.923871 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:30:58.924210 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:30:58.924214 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:30:58.924215 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:30:58.924457 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:30:58.924621 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 15:30:58.924870 (+ 249us) server_negotiation.cc:299] Negotiation successful
0809 15:30:58.924995 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
W20260809 15:30:58.925639 15155 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:44356
I20260809 15:30:58.926761 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 15219
I20260809 15:30:58.935736 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 15359
I20260809 15:30:58.944114 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 15499
I20260809 15:30:58.952415 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 15123
2026-08-09T15:30:58Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2297 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:30:59 dist-test-slave-1jjb krb5kdc[15648](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:30:59 dist-test-slave-1jjb krb5kdc[15648](info): set up 2 sockets
Aug 09 15:30:59 dist-test-slave-1jjb krb5kdc[15648](info): commencing operation
krb5kdc: starting...
W20260809 15:31:00.068220 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.090s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:31:00 dist-test-slave-1jjb krb5kdc[15648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:31:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:31:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.146.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
I20260809 15:31:00.206859 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:37745
--webserver_interface=127.11.146.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:42239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:37745
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:31:00.325371 15661 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:00.325647 15661 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:00.325690 15661 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:00.329843 15661 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:31:00.329912 15661 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:00.329932 15661 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:00.329949 15661 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:31:00.329964 15661 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:31:00.335408 15661 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:42239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:37745
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:37745
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15661
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:00.336522 15661 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:00.337551 15661 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:00.346401 15669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:00.346401 15667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:00.346563 15661 server_base.cc:1034] running on GCE node
W20260809 15:31:00.346390 15666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:00.347333 15661 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:00.348711 15661 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:00.349910 15661 hybrid_clock.cc:648] HybridClock initialized: now 1786289460349875 us; error 46 us; skew 500 ppm
Aug 09 15:31:00 dist-test-slave-1jjb krb5kdc[15648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289460, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:00.353075 15661 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:31:00.353967 15661 webserver.cc:460] Webserver started at http://127.11.146.62:35817/ using document root <none> and password file <none>
I20260809 15:31:00.354502 15661 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:00.354559 15661 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:00.354725 15661 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:00.356832 15661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "1d54c17829794718b4d345f7e02d968d"
format_stamp: "Formatted at 2026-08-09 15:31:00 on dist-test-slave-1jjb"
server_key: "4cde7ad82f5c9c7752293f8e0538bd59"
server_key_iv: "1b073330a59dea3d895c35cf046118c1"
server_key_version: "encryptionkey@0"
I20260809 15:31:00.357342 15661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "1d54c17829794718b4d345f7e02d968d"
format_stamp: "Formatted at 2026-08-09 15:31:00 on dist-test-slave-1jjb"
server_key: "4cde7ad82f5c9c7752293f8e0538bd59"
server_key_iv: "1b073330a59dea3d895c35cf046118c1"
server_key_version: "encryptionkey@0"
I20260809 15:31:00.361052 15661 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 15:31:00.363483 15676 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:00.365017 15661 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:31:00.365163 15661 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "1d54c17829794718b4d345f7e02d968d"
format_stamp: "Formatted at 2026-08-09 15:31:00 on dist-test-slave-1jjb"
server_key: "4cde7ad82f5c9c7752293f8e0538bd59"
server_key_iv: "1b073330a59dea3d895c35cf046118c1"
server_key_version: "encryptionkey@0"
I20260809 15:31:00.365280 15661 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:00.395413 15661 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:00.399125 15661 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:00.399348 15661 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:00.407186 15661 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:37745
I20260809 15:31:00.407210 15732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:37745 every 8 connection(s)
I20260809 15:31:00.408398 15661 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:31:00.411239 15733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:00.415202 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 15661
I20260809 15:31:00.415337 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:31:00.415647 11848 external_mini_cluster.cc:1428] Setting key 66f450f20576b65d780315a42f129773
I20260809 15:31:00.417950 15733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d54c17829794718b4d345f7e02d968d: Bootstrap starting.
I20260809 15:31:00.420305 15733 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1d54c17829794718b4d345f7e02d968d: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:00.421062 15733 log.cc:824] T 00000000000000000000000000000000 P 1d54c17829794718b4d345f7e02d968d: Log is configured to *not* fsync() on all Append() calls
I20260809 15:31:00.423162 15733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d54c17829794718b4d345f7e02d968d: No bootstrap required, opened a new log
Aug 09 15:31:00 dist-test-slave-1jjb krb5kdc[15648](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:31:00.427264 15733 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1d54c17829794718b4d345f7e02d968d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d54c17829794718b4d345f7e02d968d" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37745 } }
I20260809 15:31:00.427526 15733 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1d54c17829794718b4d345f7e02d968d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:00.427614 15733 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1d54c17829794718b4d345f7e02d968d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d54c17829794718b4d345f7e02d968d, State: Initialized, Role: FOLLOWER
I20260809 15:31:00.428148 15733 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d54c17829794718b4d345f7e02d968d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d54c17829794718b4d345f7e02d968d" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37745 } }
I20260809 15:31:00.428314 15733 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1d54c17829794718b4d345f7e02d968d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:31:00.428386 15733 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1d54c17829794718b4d345f7e02d968d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:31:00.428486 15733 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1d54c17829794718b4d345f7e02d968d [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:00.429425 15733 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1d54c17829794718b4d345f7e02d968d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d54c17829794718b4d345f7e02d968d" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37745 } }
I20260809 15:31:00.429804 15733 leader_election.cc:302] T 00000000000000000000000000000000 P 1d54c17829794718b4d345f7e02d968d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1d54c17829794718b4d345f7e02d968d; no voters:
I20260809 15:31:00.430164 15733 leader_election.cc:288] T 00000000000000000000000000000000 P 1d54c17829794718b4d345f7e02d968d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:31:00.430285 15738 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1d54c17829794718b4d345f7e02d968d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:31:00.430531 15738 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1d54c17829794718b4d345f7e02d968d [term 1 LEADER]: Becoming Leader. State: Replica: 1d54c17829794718b4d345f7e02d968d, State: Running, Role: LEADER
I20260809 15:31:00.430856 15738 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d54c17829794718b4d345f7e02d968d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d54c17829794718b4d345f7e02d968d" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37745 } }
I20260809 15:31:00.431155 15736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:00.417245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33476 (local address 127.11.146.62:37745)
0809 15:31:00.417728 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:00.417744 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:00.417781 (+ 37us) server_negotiation.cc:407] Connection header received
0809 15:31:00.418478 (+ 697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:00.418499 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:00.418824 (+ 325us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:00.419167 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:00.420055 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:00.421212 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:00.422399 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:00.422881 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:00.423060 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:00.425790 (+ 2730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:00.425795 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:00.425808 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:00.425837 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:00.427810 (+ 1973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:00.428378 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:00.428387 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:00.428393 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:00.428562 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:00.428841 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:00.428846 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:00.428848 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:00.429271 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:00.429486 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:00.429767 (+ 281us) server_negotiation.cc:299] Negotiation successful
0809 15:31:00.430138 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":146,"threads_started":1}
I20260809 15:31:00.431490 15733 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1d54c17829794718b4d345f7e02d968d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:31:00.432711 15740 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d54c17829794718b4d345f7e02d968d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d54c17829794718b4d345f7e02d968d. Latest consensus state: current_term: 1 leader_uuid: "1d54c17829794718b4d345f7e02d968d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d54c17829794718b4d345f7e02d968d" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37745 } } }
I20260809 15:31:00.432850 15740 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d54c17829794718b4d345f7e02d968d [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:00.433218 15739 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d54c17829794718b4d345f7e02d968d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1d54c17829794718b4d345f7e02d968d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d54c17829794718b4d345f7e02d968d" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37745 } } }
I20260809 15:31:00.433316 15739 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d54c17829794718b4d345f7e02d968d [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:00.433619 15747 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:31:00.437140 15747 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:31:00.442292 15747 catalog_manager.cc:1347] Generated new cluster ID: a660dff405a147158d8b54460ff84b50
I20260809 15:31:00.442363 15747 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:31:00.452257 15747 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:31:00.453299 15747 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:31:00.461879 15747 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1d54c17829794718b4d345f7e02d968d: Generated new TSK 0
I20260809 15:31:00.462693 15747 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.146.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
I20260809 15:31:00.501375 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.1:0
--local_ip_for_outbound_sockets=127.11.146.1
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:37745
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:42239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:31:00.624882 15759 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:00.625226 15759 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:00.625304 15759 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:00.629611 15759 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:00.629707 15759 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:00.629798 15759 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.1
I20260809 15:31:00.635847 15759 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:42239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:37745
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15759
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.1
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:00.637090 15759 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:00.638237 15759 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:00.648355 15767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:00.648360 15764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:00.648355 15765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:00.648939 15759 server_base.cc:1034] running on GCE node
I20260809 15:31:00.649397 15759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:00.650056 15759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:00.651252 15759 hybrid_clock.cc:648] HybridClock initialized: now 1786289460651224 us; error 39 us; skew 500 ppm
Aug 09 15:31:00 dist-test-slave-1jjb krb5kdc[15648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289460, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:00.654364 15759 init.cc:377] Logged in from keytab as kudu/127.11.146.1@KRBTEST.COM (short username kudu)
I20260809 15:31:00.655222 15759 webserver.cc:460] Webserver started at http://127.11.146.1:33685/ using document root <none> and password file <none>
I20260809 15:31:00.655763 15759 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:00.655823 15759 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:00.655988 15759 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:00.658171 15759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-0/data/instance:
uuid: "7542d2deb05747569dc5971191f5b6dd"
format_stamp: "Formatted at 2026-08-09 15:31:00 on dist-test-slave-1jjb"
server_key: "86586ad07aeb1cbab887b48e0863f426"
server_key_iv: "fe89325f4a8e7f272a0b05c365c63ccd"
server_key_version: "encryptionkey@0"
I20260809 15:31:00.658730 15759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance:
uuid: "7542d2deb05747569dc5971191f5b6dd"
format_stamp: "Formatted at 2026-08-09 15:31:00 on dist-test-slave-1jjb"
server_key: "86586ad07aeb1cbab887b48e0863f426"
server_key_iv: "fe89325f4a8e7f272a0b05c365c63ccd"
server_key_version: "encryptionkey@0"
I20260809 15:31:00.662585 15759 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 15:31:00.665385 15774 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:00.666599 15759 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:31:00.666700 15759 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-0/wal
uuid: "7542d2deb05747569dc5971191f5b6dd"
format_stamp: "Formatted at 2026-08-09 15:31:00 on dist-test-slave-1jjb"
server_key: "86586ad07aeb1cbab887b48e0863f426"
server_key_iv: "fe89325f4a8e7f272a0b05c365c63ccd"
server_key_version: "encryptionkey@0"
I20260809 15:31:00.666841 15759 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:00.682394 15759 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:00.685698 15759 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:00.685918 15759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:00.686609 15759 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:31:00.687455 15759 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:00.687503 15759 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:00.687544 15759 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:00.687559 15759 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:00.697345 15759 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.1:36937
I20260809 15:31:00.697371 15895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.1:36937 every 8 connection(s)
I20260809 15:31:00.698273 15759 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
I20260809 15:31:00.699601 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 15759
I20260809 15:31:00.699756 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance
I20260809 15:31:00.700064 11848 external_mini_cluster.cc:1428] Setting key ac7240fa50c1369092ad9ea42249de0c
Aug 09 15:31:00 dist-test-slave-1jjb krb5kdc[15648](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289460, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.146.2@KRBTEST.COM; defaulting to no policy
I20260809 15:31:00.714258 15736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:00.700663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:36341 (local address 127.11.146.62:37745)
0809 15:31:00.700821 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:00.700831 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:00.701827 (+ 996us) server_negotiation.cc:407] Connection header received
0809 15:31:00.703285 (+ 1458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:00.703288 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:00.703344 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:00.703423 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:00.704674 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:00.705223 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:00.706366 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:00.706614 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:00.706724 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:00.710229 (+ 3505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:00.710235 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:00.710242 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:00.710278 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:00.711909 (+ 1631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:00.712598 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:00.712601 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:00.712603 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:00.712691 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:00.713060 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:00.713063 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:00.713065 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:00.713316 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:00.713434 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:00.713996 (+ 562us) server_negotiation.cc:299] Negotiation successful
0809 15:31:00.714122 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.2@KRBTEST.COM" created.
I20260809 15:31:00.715109 15898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:00.701133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:37745 (local address 127.11.146.1:36341)
0809 15:31:00.701686 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:00.701730 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:00.703077 (+ 1347us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:00.703595 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:00.703602 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:00.703948 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:00.704529 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:00.704543 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:00.705360 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:00.705364 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:00.706228 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:00.706237 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:00.706783 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:00.706787 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:00.706955 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:00.707707 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:00.707764 (+ 57us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:00.709984 (+ 2220us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:00.712048 (+ 2064us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:00.712055 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:00.712094 (+ 39us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:00.712460 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:00.712789 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:00.712792 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:00.712794 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:00.712953 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:00.713434 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:00.713441 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:00.713709 (+ 268us) client_negotiation.cc:769] Sending connection context
0809 15:31:00.713911 (+ 202us) client_negotiation.cc:240] Negotiation successful
0809 15:31:00.714201 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":147,"threads_started":1}
I20260809 15:31:00.716652 15896 heartbeater.cc:347] Connected to a master server at 127.11.146.62:37745
I20260809 15:31:00.716959 15896 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:00.717630 15896 heartbeater.cc:511] Master 127.11.146.62:37745 requested a full tablet report, sending...
I20260809 15:31:00.719250 15694 ts_manager.cc:194] Registered new tserver with Master: 7542d2deb05747569dc5971191f5b6dd (127.11.146.1:36937)
I20260809 15:31:00.720525 15694 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.1@KRBTEST.COM'} at 127.11.146.1:36341
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
I20260809 15:31:00.733418 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.2:0
--local_ip_for_outbound_sockets=127.11.146.2
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:37745
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:42239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:31:00.851858 15901 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:00.852150 15901 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:00.852195 15901 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:00.856207 15901 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:00.856257 15901 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:00.856314 15901 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.2
I20260809 15:31:00.861543 15901 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:42239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:37745
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15901
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.2
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:00.862534 15901 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:00.863621 15901 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:00.873555 15909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:00.873569 15906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:00.873656 15901 server_base.cc:1034] running on GCE node
W20260809 15:31:00.873579 15907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:00.874253 15901 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:00.874949 15901 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:00.876178 15901 hybrid_clock.cc:648] HybridClock initialized: now 1786289460876134 us; error 52 us; skew 500 ppm
Aug 09 15:31:00 dist-test-slave-1jjb krb5kdc[15648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289460, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:00.878979 15901 init.cc:377] Logged in from keytab as kudu/127.11.146.2@KRBTEST.COM (short username kudu)
I20260809 15:31:00.879829 15901 webserver.cc:460] Webserver started at http://127.11.146.2:46503/ using document root <none> and password file <none>
I20260809 15:31:00.880502 15901 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:00.880604 15901 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:00.880829 15901 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:00.882876 15901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-1/data/instance:
uuid: "3cca0d5634f8493d8dfb59b1451052a3"
format_stamp: "Formatted at 2026-08-09 15:31:00 on dist-test-slave-1jjb"
server_key: "c7211c29e69cf70778ca7a7c2f3ffb78"
server_key_iv: "93aeb8c0cc570382eb52100d8aec2cc8"
server_key_version: "encryptionkey@0"
I20260809 15:31:00.883404 15901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance:
uuid: "3cca0d5634f8493d8dfb59b1451052a3"
format_stamp: "Formatted at 2026-08-09 15:31:00 on dist-test-slave-1jjb"
server_key: "c7211c29e69cf70778ca7a7c2f3ffb78"
server_key_iv: "93aeb8c0cc570382eb52100d8aec2cc8"
server_key_version: "encryptionkey@0"
I20260809 15:31:00.887516 15901 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 15:31:00.890028 15916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:00.891413 15901 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:31:00.891522 15901 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-1/wal
uuid: "3cca0d5634f8493d8dfb59b1451052a3"
format_stamp: "Formatted at 2026-08-09 15:31:00 on dist-test-slave-1jjb"
server_key: "c7211c29e69cf70778ca7a7c2f3ffb78"
server_key_iv: "93aeb8c0cc570382eb52100d8aec2cc8"
server_key_version: "encryptionkey@0"
I20260809 15:31:00.891710 15901 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:00.906585 15901 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:00.910109 15901 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:00.910269 15901 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:00.910809 15901 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:31:00.911691 15901 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:00.911738 15901 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:00.911778 15901 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:00.911794 15901 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:00.921267 15901 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.2:33867
I20260809 15:31:00.921314 16035 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.2:33867 every 8 connection(s)
I20260809 15:31:00.922322 15901 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
I20260809 15:31:00.931608 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 15901
Aug 09 15:31:00 dist-test-slave-1jjb krb5kdc[15648](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289460, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:31:00.931738 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance
I20260809 15:31:00.932034 11848 external_mini_cluster.cc:1428] Setting key ed0b3603ccb6dd2d52e050560515d152
I20260809 15:31:00.936517 15736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:00.924211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:51859 (local address 127.11.146.62:37745)
0809 15:31:00.924350 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:00.924355 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:00.925275 (+ 920us) server_negotiation.cc:407] Connection header received
0809 15:31:00.926565 (+ 1290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:00.926568 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:00.926615 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:00.926689 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:00.927809 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:00.928410 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:00.929539 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:00.929751 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:00.929833 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:00.932396 (+ 2563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:00.932401 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:00.932405 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:00.932439 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:00.934107 (+ 1668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:00.934739 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:00.934742 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:00.934743 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:00.934819 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:00.935198 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:00.935200 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:00.935201 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:00.935366 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:00.935440 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:00.936148 (+ 708us) server_negotiation.cc:299] Negotiation successful
0809 15:31:00.936294 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 15:31:00.937132 16038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:00.924698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:37745 (local address 127.11.146.2:51859)
0809 15:31:00.925124 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:00.925165 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:00.926378 (+ 1213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:00.926845 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:00.926852 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:00.927185 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:00.927671 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:00.927685 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:00.928522 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:00.928525 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:00.929421 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:00.929431 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:00.929885 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:00.929889 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:00.930032 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:00.930613 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:00.930629 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:00.932234 (+ 1605us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:00.934222 (+ 1988us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:00.934230 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:00.934247 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:00.934632 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:00.934908 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:00.934914 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:00.934919 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:00.935102 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:00.935469 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:00.935478 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:00.935801 (+ 323us) client_negotiation.cc:769] Sending connection context
0809 15:31:00.935990 (+ 189us) client_negotiation.cc:240] Negotiation successful
0809 15:31:00.936305 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":98,"threads_started":1}
I20260809 15:31:00.938215 16036 heartbeater.cc:347] Connected to a master server at 127.11.146.62:37745
I20260809 15:31:00.938468 16036 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:00.938938 16036 heartbeater.cc:511] Master 127.11.146.62:37745 requested a full tablet report, sending...
I20260809 15:31:00.939978 15694 ts_manager.cc:194] Registered new tserver with Master: 3cca0d5634f8493d8dfb59b1451052a3 (127.11.146.2:33867)
I20260809 15:31:00.940598 15694 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.2@KRBTEST.COM'} at 127.11.146.2:51859
WARNING: no policy specified for kudu/127.11.146.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
I20260809 15:31:00.960389 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.3:0
--local_ip_for_outbound_sockets=127.11.146.3
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:37745
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:42239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:31:01.071934 16042 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:01.072201 16042 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:01.072243 16042 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:01.076295 16042 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:01.076345 16042 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:01.076401 16042 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.3
I20260809 15:31:01.081624 16042 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:42239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:37745
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16042
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.3
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:01.082610 16042 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:01.083606 16042 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:01.093746 16048 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:01.093761 16047 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:01.093758 16050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:01.093843 16042 server_base.cc:1034] running on GCE node
I20260809 15:31:01.094401 16042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:01.095175 16042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:01.096359 16042 hybrid_clock.cc:648] HybridClock initialized: now 1786289461096312 us; error 56 us; skew 500 ppm
Aug 09 15:31:01 dist-test-slave-1jjb krb5kdc[15648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289461, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:01.099153 16042 init.cc:377] Logged in from keytab as kudu/127.11.146.3@KRBTEST.COM (short username kudu)
I20260809 15:31:01.100129 16042 webserver.cc:460] Webserver started at http://127.11.146.3:38635/ using document root <none> and password file <none>
I20260809 15:31:01.100701 16042 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:01.100795 16042 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:01.101008 16042 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:01.102991 16042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-2/data/instance:
uuid: "ab50c567f2684d9b9a8e84eab8e00b25"
format_stamp: "Formatted at 2026-08-09 15:31:01 on dist-test-slave-1jjb"
server_key: "1b5878f9eea6a739ea5d6c1d6b924846"
server_key_iv: "432dd4984be44154962c696db0ca749b"
server_key_version: "encryptionkey@0"
I20260809 15:31:01.103546 16042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance:
uuid: "ab50c567f2684d9b9a8e84eab8e00b25"
format_stamp: "Formatted at 2026-08-09 15:31:01 on dist-test-slave-1jjb"
server_key: "1b5878f9eea6a739ea5d6c1d6b924846"
server_key_iv: "432dd4984be44154962c696db0ca749b"
server_key_version: "encryptionkey@0"
I20260809 15:31:01.107249 16042 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 15:31:01.110065 16057 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:01.111269 16042 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 15:31:01.111434 16042 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-2/wal
uuid: "ab50c567f2684d9b9a8e84eab8e00b25"
format_stamp: "Formatted at 2026-08-09 15:31:01 on dist-test-slave-1jjb"
server_key: "1b5878f9eea6a739ea5d6c1d6b924846"
server_key_iv: "432dd4984be44154962c696db0ca749b"
server_key_version: "encryptionkey@0"
I20260809 15:31:01.111563 16042 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:01.157207 16042 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:01.160709 16042 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:01.160933 16042 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:01.161585 16042 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:31:01.162446 16042 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:01.162520 16042 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:01.162621 16042 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:01.162678 16042 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:01.172837 16042 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.3:34967
I20260809 15:31:01.172865 16175 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.3:34967 every 8 connection(s)
I20260809 15:31:01.173744 16042 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
I20260809 15:31:01.177282 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 16042
I20260809 15:31:01.177461 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance
I20260809 15:31:01.177768 11848 external_mini_cluster.cc:1428] Setting key 317252d3c48c8d13c077463741b8626c
Aug 09 15:31:01 dist-test-slave-1jjb krb5kdc[15648](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289461, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:31:01.188778 15736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:01.175644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:41627 (local address 127.11.146.62:37745)
0809 15:31:01.175822 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:01.175827 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:01.176777 (+ 950us) server_negotiation.cc:407] Connection header received
0809 15:31:01.178478 (+ 1701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:01.178481 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:01.178542 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:01.178615 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:01.179788 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:01.180418 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:01.181758 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:01.181999 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:01.182115 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:01.184827 (+ 2712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:01.184831 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:01.184833 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:01.184860 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:01.186433 (+ 1573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:01.186977 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:01.186980 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:01.186982 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:01.187075 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:01.187462 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:01.187466 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:01.187467 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:01.187800 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:01.187907 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:01.188528 (+ 621us) server_negotiation.cc:299] Negotiation successful
0809 15:31:01.188644 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 15:31:01.189666 16178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:01.176098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:37745 (local address 127.11.146.3:41627)
0809 15:31:01.176615 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:01.176658 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:01.178220 (+ 1562us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:01.178792 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:01.178798 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:01.179150 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:01.179640 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:01.179654 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:01.180547 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:01.180550 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:01.181632 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:01.181642 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:01.182157 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:01.182161 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:01.182340 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:01.182953 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:01.182970 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:01.184643 (+ 1673us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:01.186551 (+ 1908us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:01.186556 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:01.186571 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:01.186859 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:01.187175 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:01.187177 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:01.187179 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:01.187330 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:01.187928 (+ 598us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:01.187934 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:01.188274 (+ 340us) client_negotiation.cc:769] Sending connection context
0809 15:31:01.188452 (+ 178us) client_negotiation.cc:240] Negotiation successful
0809 15:31:01.188740 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":115,"threads_started":1}
I20260809 15:31:01.191057 16176 heartbeater.cc:347] Connected to a master server at 127.11.146.62:37745
I20260809 15:31:01.191332 16176 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:01.191938 16176 heartbeater.cc:511] Master 127.11.146.62:37745 requested a full tablet report, sending...
I20260809 15:31:01.193068 15694 ts_manager.cc:194] Registered new tserver with Master: ab50c567f2684d9b9a8e84eab8e00b25 (127.11.146.3:34967)
I20260809 15:31:01.193610 15694 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.3@KRBTEST.COM'} at 127.11.146.3:41627
I20260809 15:31:01.204219 11848 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 15:31:01 dist-test-slave-1jjb krb5kdc[15648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289461, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 15:31:01 dist-test-slave-1jjb krb5kdc[15648](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289461, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.1@KRBTEST.COM
I20260809 15:31:01.234021 16183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:01.223834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42288 (local address 127.11.146.1:36937)
0809 15:31:01.224237 (+ 403us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:01.224252 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:01.224278 (+ 26us) server_negotiation.cc:407] Connection header received
0809 15:31:01.224334 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:01.224340 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:01.224557 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:01.224690 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:01.225349 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:01.226181 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:01.227029 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:01.227460 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:01.227667 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:01.230068 (+ 2401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:01.230077 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:01.230092 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:01.230117 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:01.232053 (+ 1936us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:01.232581 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:01.232587 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:01.232588 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:01.232677 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:01.232945 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:01.232947 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:01.232949 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:01.233193 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:01.233358 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:01.233638 (+ 280us) server_negotiation.cc:299] Negotiation successful
0809 15:31:01.233806 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":114,"threads_started":1}
Aug 09 15:31:01 dist-test-slave-1jjb krb5kdc[15648](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289461, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:31:01.245440 15736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:01.237018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33492 (local address 127.11.146.62:37745)
0809 15:31:01.237171 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:01.237177 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:01.237263 (+ 86us) server_negotiation.cc:407] Connection header received
0809 15:31:01.237411 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:01.237414 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:01.237471 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:01.237580 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:01.238210 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:01.238729 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:01.239505 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:01.239752 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:01.239864 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:01.242276 (+ 2412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:01.242280 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:01.242282 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:01.242307 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:01.243572 (+ 1265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:01.244000 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:01.244004 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:01.244006 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:01.244158 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:01.244474 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:01.244478 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:01.244480 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:01.244726 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:01.244878 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:01.245139 (+ 261us) server_negotiation.cc:299] Negotiation successful
0809 15:31:01.245267 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
W20260809 15:31:01.245949 15694 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33492
I20260809 15:31:01.246590 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 15759
I20260809 15:31:01.256623 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 15901
I20260809 15:31:01.266112 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 16042
I20260809 15:31:01.273128 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 15661
2026-08-09T15:31:01Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2319 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:31:01 dist-test-slave-1jjb krb5kdc[16188](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:31:01 dist-test-slave-1jjb krb5kdc[16188](info): set up 2 sockets
Aug 09 15:31:01 dist-test-slave-1jjb krb5kdc[16188](info): commencing operation
krb5kdc: starting...
W20260809 15:31:02.396414 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.098s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:31:02 dist-test-slave-1jjb krb5kdc[16188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289462, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:31:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:31:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.146.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
I20260809 15:31:02.539223 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:37665
--webserver_interface=127.11.146.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:37445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:37665
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:31:02.658219 16201 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:02.658550 16201 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:02.658640 16201 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:02.662675 16201 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:31:02.662756 16201 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:02.662796 16201 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:02.662854 16201 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:31:02.662886 16201 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:31:02.668419 16201 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:37445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:37665
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:37665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16201
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:02.669466 16201 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:02.670464 16201 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:02.679168 16207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:02.679275 16210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:02.679168 16208 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:02.679486 16201 server_base.cc:1034] running on GCE node
I20260809 15:31:02.680190 16201 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:02.681319 16201 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:02.682482 16201 hybrid_clock.cc:648] HybridClock initialized: now 1786289462682453 us; error 40 us; skew 500 ppm
Aug 09 15:31:02 dist-test-slave-1jjb krb5kdc[16188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289462, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:02.692068 16201 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:31:02.692847 16201 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:02.692916 16201 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:02.693086 16201 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:02.695139 16201 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "be6589ea322645d4beae797faad12731"
format_stamp: "Formatted at 2026-08-09 15:31:02 on dist-test-slave-1jjb"
server_key: "26fb84369fa6c278c0ad47948cfd050f"
server_key_iv: "154185f3357210d34f1ca93e02de38f9"
server_key_version: "encryptionkey@0"
I20260809 15:31:02.695660 16201 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "be6589ea322645d4beae797faad12731"
format_stamp: "Formatted at 2026-08-09 15:31:02 on dist-test-slave-1jjb"
server_key: "26fb84369fa6c278c0ad47948cfd050f"
server_key_iv: "154185f3357210d34f1ca93e02de38f9"
server_key_version: "encryptionkey@0"
I20260809 15:31:02.699527 16201 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 15:31:02.702059 16216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:02.703446 16201 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:31:02.703599 16201 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "be6589ea322645d4beae797faad12731"
format_stamp: "Formatted at 2026-08-09 15:31:02 on dist-test-slave-1jjb"
server_key: "26fb84369fa6c278c0ad47948cfd050f"
server_key_iv: "154185f3357210d34f1ca93e02de38f9"
server_key_version: "encryptionkey@0"
I20260809 15:31:02.703716 16201 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:02.728782 16201 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:02.732551 16201 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:02.732770 16201 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:02.740334 16201 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:37665
I20260809 15:31:02.740628 16273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:37665 every 8 connection(s)
I20260809 15:31:02.741081 16201 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:31:02.743888 16274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:02.746953 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 16201
I20260809 15:31:02.747112 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:31:02.747448 11848 external_mini_cluster.cc:1428] Setting key 0cd1ae1cb58ce852ea876dbea6d72f25
I20260809 15:31:02.750386 16274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be6589ea322645d4beae797faad12731: Bootstrap starting.
I20260809 15:31:02.752769 16274 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be6589ea322645d4beae797faad12731: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:02.753510 16274 log.cc:824] T 00000000000000000000000000000000 P be6589ea322645d4beae797faad12731: Log is configured to *not* fsync() on all Append() calls
I20260809 15:31:02.755376 16274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be6589ea322645d4beae797faad12731: No bootstrap required, opened a new log
Aug 09 15:31:02 dist-test-slave-1jjb krb5kdc[16188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289462, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:31:02.758860 16274 raft_consensus.cc:348] T 00000000000000000000000000000000 P be6589ea322645d4beae797faad12731 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be6589ea322645d4beae797faad12731" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37665 } }
I20260809 15:31:02.759107 16274 raft_consensus.cc:374] T 00000000000000000000000000000000 P be6589ea322645d4beae797faad12731 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:02.759199 16274 raft_consensus.cc:729] T 00000000000000000000000000000000 P be6589ea322645d4beae797faad12731 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be6589ea322645d4beae797faad12731, State: Initialized, Role: FOLLOWER
I20260809 15:31:02.759783 16274 consensus_queue.cc:260] T 00000000000000000000000000000000 P be6589ea322645d4beae797faad12731 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be6589ea322645d4beae797faad12731" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37665 } }
I20260809 15:31:02.759964 16274 raft_consensus.cc:388] T 00000000000000000000000000000000 P be6589ea322645d4beae797faad12731 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:31:02.760074 16274 raft_consensus.cc:482] T 00000000000000000000000000000000 P be6589ea322645d4beae797faad12731 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:31:02.760198 16274 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be6589ea322645d4beae797faad12731 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:02.761061 16274 raft_consensus.cc:504] T 00000000000000000000000000000000 P be6589ea322645d4beae797faad12731 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be6589ea322645d4beae797faad12731" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37665 } }
I20260809 15:31:02.761441 16274 leader_election.cc:302] T 00000000000000000000000000000000 P be6589ea322645d4beae797faad12731 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be6589ea322645d4beae797faad12731; no voters:
I20260809 15:31:02.761781 16274 leader_election.cc:288] T 00000000000000000000000000000000 P be6589ea322645d4beae797faad12731 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:31:02.761898 16279 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be6589ea322645d4beae797faad12731 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:31:02.762110 16279 raft_consensus.cc:686] T 00000000000000000000000000000000 P be6589ea322645d4beae797faad12731 [term 1 LEADER]: Becoming Leader. State: Replica: be6589ea322645d4beae797faad12731, State: Running, Role: LEADER
I20260809 15:31:02.762337 16277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:02.749160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51678 (local address 127.11.146.62:37665)
0809 15:31:02.749622 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:02.749637 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:02.749672 (+ 35us) server_negotiation.cc:407] Connection header received
0809 15:31:02.750273 (+ 601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:02.750289 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:02.750678 (+ 389us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:02.751003 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:02.751837 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:02.752979 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:02.753911 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:02.754387 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:02.754553 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:02.757111 (+ 2558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:02.757116 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:02.757129 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:02.757156 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:02.758931 (+ 1775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:02.759476 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:02.759481 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:02.759486 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:02.759596 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:02.759892 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:02.759896 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:02.759897 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:02.760481 (+ 584us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:02.760700 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:02.761016 (+ 316us) server_negotiation.cc:299] Negotiation successful
0809 15:31:02.761340 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":143,"threads_started":1}
I20260809 15:31:02.762434 16279 consensus_queue.cc:237] T 00000000000000000000000000000000 P be6589ea322645d4beae797faad12731 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be6589ea322645d4beae797faad12731" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37665 } }
I20260809 15:31:02.763080 16274 sys_catalog.cc:564] T 00000000000000000000000000000000 P be6589ea322645d4beae797faad12731 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:31:02.763630 16279 sys_catalog.cc:455] T 00000000000000000000000000000000 P be6589ea322645d4beae797faad12731 [sys.catalog]: SysCatalogTable state changed. Reason: New leader be6589ea322645d4beae797faad12731. Latest consensus state: current_term: 1 leader_uuid: "be6589ea322645d4beae797faad12731" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be6589ea322645d4beae797faad12731" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37665 } } }
I20260809 15:31:02.763741 16279 sys_catalog.cc:458] T 00000000000000000000000000000000 P be6589ea322645d4beae797faad12731 [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:02.764144 16280 sys_catalog.cc:455] T 00000000000000000000000000000000 P be6589ea322645d4beae797faad12731 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "be6589ea322645d4beae797faad12731" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be6589ea322645d4beae797faad12731" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37665 } } }
I20260809 15:31:02.764247 16280 sys_catalog.cc:458] T 00000000000000000000000000000000 P be6589ea322645d4beae797faad12731 [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:02.765040 16286 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:31:02.768400 16286 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:31:02.774478 16286 catalog_manager.cc:1347] Generated new cluster ID: ef4c87a3235d4d5496cff52a2094146e
I20260809 15:31:02.774567 16286 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:31:02.788228 16286 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:31:02.789247 16286 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:31:02.801513 16286 catalog_manager.cc:5868] T 00000000000000000000000000000000 P be6589ea322645d4beae797faad12731: Generated new TSK 0
I20260809 15:31:02.802268 16286 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.146.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
I20260809 15:31:02.838879 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.1:0
--local_ip_for_outbound_sockets=127.11.146.1
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:37665
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:37445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:31:02.954905 16302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:02.955168 16302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:02.955215 16302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:02.959236 16302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:02.959296 16302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:02.959357 16302 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.1
I20260809 15:31:02.965210 16302 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:37445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:37665
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16302
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.1
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:02.966333 16302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:02.967406 16302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:02.977866 16307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:02.977959 16310 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:02.977880 16308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:02.978147 16302 server_base.cc:1034] running on GCE node
I20260809 15:31:02.978799 16302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:02.979455 16302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:02.980635 16302 hybrid_clock.cc:648] HybridClock initialized: now 1786289462980616 us; error 31 us; skew 500 ppm
Aug 09 15:31:02 dist-test-slave-1jjb krb5kdc[16188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289462, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:02.983727 16302 init.cc:377] Logged in from keytab as kudu/127.11.146.1@KRBTEST.COM (short username kudu)
I20260809 15:31:02.984692 16302 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:02.984797 16302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:02.985098 16302 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:02.987370 16302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-0/data/instance:
uuid: "c6beff2ce4a64478b064fcbb9b05b833"
format_stamp: "Formatted at 2026-08-09 15:31:02 on dist-test-slave-1jjb"
server_key: "15651d7a3adba5f0148d3ced9425548d"
server_key_iv: "e152929899407a9867eb6b15b444ad34"
server_key_version: "encryptionkey@0"
I20260809 15:31:02.987926 16302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance:
uuid: "c6beff2ce4a64478b064fcbb9b05b833"
format_stamp: "Formatted at 2026-08-09 15:31:02 on dist-test-slave-1jjb"
server_key: "15651d7a3adba5f0148d3ced9425548d"
server_key_iv: "e152929899407a9867eb6b15b444ad34"
server_key_version: "encryptionkey@0"
I20260809 15:31:02.992547 16302 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 15:31:02.994993 16317 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:02.996495 16302 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:31:02.996630 16302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-0/wal
uuid: "c6beff2ce4a64478b064fcbb9b05b833"
format_stamp: "Formatted at 2026-08-09 15:31:02 on dist-test-slave-1jjb"
server_key: "15651d7a3adba5f0148d3ced9425548d"
server_key_iv: "e152929899407a9867eb6b15b444ad34"
server_key_version: "encryptionkey@0"
I20260809 15:31:02.996742 16302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:03.013767 16302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:03.017138 16302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:03.017364 16302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:03.017994 16302 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:31:03.018898 16302 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:03.018947 16302 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:03.019016 16302 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:03.019047 16302 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:03.028358 16302 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.1:38283
I20260809 15:31:03.028365 16436 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.1:38283 every 8 connection(s)
I20260809 15:31:03.029067 16302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
I20260809 15:31:03.036711 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 16302
I20260809 15:31:03.036851 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance
I20260809 15:31:03.037216 11848 external_mini_cluster.cc:1428] Setting key 3f4f375010f18fda3ea716c7be0f7ea7
Aug 09 15:31:03 dist-test-slave-1jjb krb5kdc[16188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289462, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:31:03.045475 16277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:03.031047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:47811 (local address 127.11.146.62:37665)
0809 15:31:03.031191 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:03.031194 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:03.032033 (+ 839us) server_negotiation.cc:407] Connection header received
0809 15:31:03.033507 (+ 1474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:03.033511 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:03.033563 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:03.033640 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:03.034891 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.035469 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.037157 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.037481 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.037571 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:03.041467 (+ 3896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:03.041471 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:03.041473 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:03.041500 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:03.043142 (+ 1642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:03.043726 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:03.043730 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:03.043731 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:03.043812 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:03.044209 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:03.044213 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:03.044214 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:03.044412 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:03.044522 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:03.045155 (+ 633us) server_negotiation.cc:299] Negotiation successful
0809 15:31:03.045294 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 15:31:03.046312 16439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:03.031351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:37665 (local address 127.11.146.1:47811)
0809 15:31:03.031858 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:03.031902 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:03.033275 (+ 1373us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:03.033826 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:03.033833 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:03.034226 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:03.034723 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:03.034737 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.035623 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.035626 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:03.037011 (+ 1385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:03.037024 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.037736 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.037744 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:03.038084 (+ 340us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:03.038851 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:03.038878 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:03.041241 (+ 2363us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:03.043278 (+ 2037us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:03.043285 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:03.043303 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:03.043602 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:03.043909 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:03.043913 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:03.043915 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:03.044118 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:03.044544 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:03.044551 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:03.044885 (+ 334us) client_negotiation.cc:769] Sending connection context
0809 15:31:03.045097 (+ 212us) client_negotiation.cc:240] Negotiation successful
0809 15:31:03.045452 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":115,"threads_started":1}
I20260809 15:31:03.047850 16437 heartbeater.cc:347] Connected to a master server at 127.11.146.62:37665
I20260809 15:31:03.048177 16437 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:03.048683 16437 heartbeater.cc:511] Master 127.11.146.62:37665 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.146.2@KRBTEST.COM; defaulting to no policy
I20260809 15:31:03.050390 16232 ts_manager.cc:194] Registered new tserver with Master: c6beff2ce4a64478b064fcbb9b05b833 (127.11.146.1:38283)
I20260809 15:31:03.051822 16232 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.1@KRBTEST.COM'} at 127.11.146.1:47811
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
I20260809 15:31:03.072407 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.2:0
--local_ip_for_outbound_sockets=127.11.146.2
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:37665
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:37445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:31:03.194064 16442 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:03.194348 16442 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:03.194397 16442 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:03.198477 16442 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:03.198546 16442 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:03.198611 16442 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.2
I20260809 15:31:03.204409 16442 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:37445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:37665
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16442
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.2
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:03.205529 16442 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:03.206540 16442 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:03.216711 16450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:03.216715 16448 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:03.216715 16447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:03.216899 16442 server_base.cc:1034] running on GCE node
I20260809 15:31:03.217530 16442 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:03.218220 16442 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:03.219415 16442 hybrid_clock.cc:648] HybridClock initialized: now 1786289463219396 us; error 29 us; skew 500 ppm
Aug 09 15:31:03 dist-test-slave-1jjb krb5kdc[16188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289463, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:03.222261 16442 init.cc:377] Logged in from keytab as kudu/127.11.146.2@KRBTEST.COM (short username kudu)
I20260809 15:31:03.222934 16442 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:03.223004 16442 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:03.223169 16442 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:03.225210 16442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-1/data/instance:
uuid: "5d3694488c464763a56fb7ecf559a1cb"
format_stamp: "Formatted at 2026-08-09 15:31:03 on dist-test-slave-1jjb"
server_key: "7dee3f7102a6bdcce9f055f863281c06"
server_key_iv: "313fe9e73b14b6140ef7515b43b667b4"
server_key_version: "encryptionkey@0"
I20260809 15:31:03.225718 16442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance:
uuid: "5d3694488c464763a56fb7ecf559a1cb"
format_stamp: "Formatted at 2026-08-09 15:31:03 on dist-test-slave-1jjb"
server_key: "7dee3f7102a6bdcce9f055f863281c06"
server_key_iv: "313fe9e73b14b6140ef7515b43b667b4"
server_key_version: "encryptionkey@0"
I20260809 15:31:03.229444 16442 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 15:31:03.231787 16457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:03.233106 16442 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:31:03.233232 16442 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-1/wal
uuid: "5d3694488c464763a56fb7ecf559a1cb"
format_stamp: "Formatted at 2026-08-09 15:31:03 on dist-test-slave-1jjb"
server_key: "7dee3f7102a6bdcce9f055f863281c06"
server_key_iv: "313fe9e73b14b6140ef7515b43b667b4"
server_key_version: "encryptionkey@0"
I20260809 15:31:03.233340 16442 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:03.252677 16442 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:03.255896 16442 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:03.256160 16442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:03.256788 16442 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:31:03.257648 16442 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:03.257695 16442 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:03.257766 16442 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:03.257803 16442 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:03.268177 16442 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.2:38963
I20260809 15:31:03.268213 16575 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.2:38963 every 8 connection(s)
I20260809 15:31:03.268812 16442 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
I20260809 15:31:03.270809 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 16442
I20260809 15:31:03.270927 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance
I20260809 15:31:03.271216 11848 external_mini_cluster.cc:1428] Setting key 57c4155b288c97e6c3da7fd24902362c
Aug 09 15:31:03 dist-test-slave-1jjb krb5kdc[16188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289463, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.146.3@KRBTEST.COM; defaulting to no policy
I20260809 15:31:03.284582 16277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:03.270755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:59011 (local address 127.11.146.62:37665)
0809 15:31:03.270939 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:03.270944 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:03.271963 (+ 1019us) server_negotiation.cc:407] Connection header received
0809 15:31:03.273362 (+ 1399us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:03.273366 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:03.273422 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:03.273501 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:03.274683 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.275548 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.277056 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.277483 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.277609 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:03.280650 (+ 3041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:03.280653 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:03.280655 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:03.280681 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:03.282258 (+ 1577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:03.282901 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:03.282904 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:03.282906 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:03.282984 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:03.283339 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:03.283341 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:03.283342 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:03.283554 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:03.283643 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:03.284337 (+ 694us) server_negotiation.cc:299] Negotiation successful
0809 15:31:03.284453 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 15:31:03.285439 16578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:03.271152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:37665 (local address 127.11.146.2:59011)
0809 15:31:03.271794 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:03.271851 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:03.273148 (+ 1297us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:03.273670 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:03.273678 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:03.274031 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:03.274538 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:03.274551 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.275878 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.275885 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:03.276924 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:03.276936 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.277662 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.277665 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:03.277819 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:03.278490 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:03.278507 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:03.280444 (+ 1937us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:03.282395 (+ 1951us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:03.282401 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:03.282418 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:03.282791 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:03.283091 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:03.283094 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:03.283096 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:03.283239 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:03.283697 (+ 458us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:03.283703 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:03.284021 (+ 318us) client_negotiation.cc:769] Sending connection context
0809 15:31:03.284256 (+ 235us) client_negotiation.cc:240] Negotiation successful
0809 15:31:03.284534 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":148,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.3@KRBTEST.COM" created.
I20260809 15:31:03.286793 16576 heartbeater.cc:347] Connected to a master server at 127.11.146.62:37665
I20260809 15:31:03.287048 16576 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:03.287530 16576 heartbeater.cc:511] Master 127.11.146.62:37665 requested a full tablet report, sending...
I20260809 15:31:03.288774 16232 ts_manager.cc:194] Registered new tserver with Master: 5d3694488c464763a56fb7ecf559a1cb (127.11.146.2:38963)
I20260809 15:31:03.289404 16232 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.2@KRBTEST.COM'} at 127.11.146.2:59011
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
I20260809 15:31:03.304527 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.3:0
--local_ip_for_outbound_sockets=127.11.146.3
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:37665
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:37445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:31:03.425086 16582 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:03.425360 16582 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:03.425406 16582 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:03.429520 16582 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:03.429584 16582 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:03.429679 16582 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.3
I20260809 15:31:03.435182 16582 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:37445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:37665
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16582
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.3
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:03.436313 16582 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:03.437402 16582 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:03.447276 16587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:03.447307 16590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:03.447280 16588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:03.447571 16582 server_base.cc:1034] running on GCE node
I20260809 15:31:03.448005 16582 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:03.448719 16582 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:03.449931 16582 hybrid_clock.cc:648] HybridClock initialized: now 1786289463449908 us; error 40 us; skew 500 ppm
Aug 09 15:31:03 dist-test-slave-1jjb krb5kdc[16188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289463, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:03.453298 16582 init.cc:377] Logged in from keytab as kudu/127.11.146.3@KRBTEST.COM (short username kudu)
I20260809 15:31:03.454104 16582 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:03.454173 16582 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:03.454342 16582 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:03.456463 16582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-2/data/instance:
uuid: "dd6c30752b5c446daaf3668edf7c579f"
format_stamp: "Formatted at 2026-08-09 15:31:03 on dist-test-slave-1jjb"
server_key: "3c1db977594de6dedd90ecf2ba8c046c"
server_key_iv: "c0476254167eb261f436c8c55691ab3c"
server_key_version: "encryptionkey@0"
I20260809 15:31:03.456990 16582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance:
uuid: "dd6c30752b5c446daaf3668edf7c579f"
format_stamp: "Formatted at 2026-08-09 15:31:03 on dist-test-slave-1jjb"
server_key: "3c1db977594de6dedd90ecf2ba8c046c"
server_key_iv: "c0476254167eb261f436c8c55691ab3c"
server_key_version: "encryptionkey@0"
I20260809 15:31:03.460852 16582 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 15:31:03.463488 16596 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:03.465029 16582 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:31:03.465147 16582 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-2/wal
uuid: "dd6c30752b5c446daaf3668edf7c579f"
format_stamp: "Formatted at 2026-08-09 15:31:03 on dist-test-slave-1jjb"
server_key: "3c1db977594de6dedd90ecf2ba8c046c"
server_key_iv: "c0476254167eb261f436c8c55691ab3c"
server_key_version: "encryptionkey@0"
I20260809 15:31:03.465240 16582 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:03.477777 16582 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:03.480966 16582 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:03.481125 16582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:03.481654 16582 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:31:03.482455 16582 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:03.482501 16582 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:03.482542 16582 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:03.482558 16582 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:03.491904 16582 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.3:46145
I20260809 15:31:03.491930 16712 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.3:46145 every 8 connection(s)
I20260809 15:31:03.492560 16582 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
I20260809 15:31:03.493022 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 16582
I20260809 15:31:03.493182 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance
I20260809 15:31:03.493534 11848 external_mini_cluster.cc:1428] Setting key 1637935d7367ccf4f7bac6d890a62e46
Aug 09 15:31:03 dist-test-slave-1jjb krb5kdc[16188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289463, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:31:03.507937 16277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:03.494807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:44633 (local address 127.11.146.62:37665)
0809 15:31:03.494983 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:03.494988 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:03.496014 (+ 1026us) server_negotiation.cc:407] Connection header received
0809 15:31:03.497385 (+ 1371us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:03.497388 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:03.497445 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:03.497521 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:03.498766 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.499354 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.501078 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.501300 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.501413 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:03.504134 (+ 2721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:03.504138 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:03.504140 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:03.504167 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:03.505728 (+ 1561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:03.506265 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:03.506269 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:03.506271 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:03.506366 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:03.506727 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:03.506731 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:03.506732 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:03.506926 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:03.507040 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:03.507648 (+ 608us) server_negotiation.cc:299] Negotiation successful
0809 15:31:03.507771 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 15:31:03.508913 16715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:03.495354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:37665 (local address 127.11.146.3:44633)
0809 15:31:03.495873 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:03.495931 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:03.497180 (+ 1249us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:03.497694 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:03.497701 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:03.498053 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:03.498621 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:03.498636 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.499488 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.499496 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:03.500947 (+ 1451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:03.500958 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.501455 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.501459 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:03.501639 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:03.502189 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:03.502204 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:03.503815 (+ 1611us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:03.505863 (+ 2048us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:03.505869 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:03.505884 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:03.506158 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:03.506466 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:03.506470 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:03.506472 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:03.506619 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:03.507040 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:03.507048 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:03.507389 (+ 341us) client_negotiation.cc:769] Sending connection context
0809 15:31:03.507607 (+ 218us) client_negotiation.cc:240] Negotiation successful
0809 15:31:03.507958 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":114,"threads_started":1}
I20260809 15:31:03.510023 16713 heartbeater.cc:347] Connected to a master server at 127.11.146.62:37665
I20260809 15:31:03.510285 16713 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:03.510775 16713 heartbeater.cc:511] Master 127.11.146.62:37665 requested a full tablet report, sending...
I20260809 15:31:03.511843 16232 ts_manager.cc:194] Registered new tserver with Master: dd6c30752b5c446daaf3668edf7c579f (127.11.146.3:46145)
I20260809 15:31:03.512458 16232 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.3@KRBTEST.COM'} at 127.11.146.3:44633
I20260809 15:31:03.519649 11848 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:31:03.529181 16277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:03.521636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51694 (local address 127.11.146.62:37665)
0809 15:31:03.521779 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:03.521785 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:03.521905 (+ 120us) server_negotiation.cc:407] Connection header received
0809 15:31:03.522001 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:03.522003 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:03.522043 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:03.522107 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:03.522810 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.523323 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.524222 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.524454 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.524536 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:03.525837 (+ 1301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:03.525840 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:03.525842 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:03.525864 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:03.527357 (+ 1493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:03.527841 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:03.527843 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:03.527845 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:03.527924 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:03.528270 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:03.528272 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:03.528273 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:03.528508 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:03.528612 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:03.528857 (+ 245us) server_negotiation.cc:299] Negotiation successful
0809 15:31:03.528952 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 15:31:03.532441 16232 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51694:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:31:03.535490 16232 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:31:03.551589 16725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:03.545507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:38283 (local address 127.0.0.1:55352)
0809 15:31:03.546134 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:03.546147 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:03.546237 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:03.547077 (+ 840us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:03.547080 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:03.547094 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:31:03.547204 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:03.547210 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.548780 (+ 1570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.548784 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:03.549911 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:03.549928 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.551000 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.551003 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:03.551100 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:03.551135 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 15:31:03.551280 (+ 145us) client_negotiation.cc:240] Negotiation successful
0809 15:31:03.551413 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"mutex_wait_us":32,"thread_start_us":122,"threads_started":1}
I20260809 15:31:03.551738 16726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:03.544866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39634 (local address 127.11.146.3:46145)
0809 15:31:03.545310 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:03.545324 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:03.545791 (+ 467us) server_negotiation.cc:407] Connection header received
0809 15:31:03.546129 (+ 338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:03.546138 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:03.546364 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:03.546492 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:31:03.547040 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.548299 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.550305 (+ 2006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.551098 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.551213 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:03.551346 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:03.551467 (+ 121us) server_negotiation.cc:299] Negotiation successful
0809 15:31:03.551574 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":199,"threads_started":1}
I20260809 15:31:03.551589 16727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:03.544696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:46145 (local address 127.0.0.1:39634)
0809 15:31:03.545643 (+ 947us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:03.545698 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:03.545908 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:03.546721 (+ 813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:03.546729 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:03.546757 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:31:03.546898 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:03.546906 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.548478 (+ 1572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.548482 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:03.550161 (+ 1679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:03.550175 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.551238 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.551244 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:03.551343 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:03.551365 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 15:31:03.551435 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 15:31:03.551492 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":754,"mutex_wait_us":199,"thread_start_us":87,"threads_started":1}
I20260809 15:31:03.552330 16730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:03.546088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55352 (local address 127.11.146.1:38283)
0809 15:31:03.546632 (+ 544us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:03.546637 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:03.546655 (+ 18us) server_negotiation.cc:407] Connection header received
0809 15:31:03.546742 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:03.546747 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:03.546919 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:03.547080 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:31:03.547314 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.548426 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.550051 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.550863 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.550985 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:03.551142 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:03.552029 (+ 887us) server_negotiation.cc:299] Negotiation successful
0809 15:31:03.552167 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":448,"thread_start_us":100,"threads_started":1}
I20260809 15:31:03.553234 16729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:03.544970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:38963 (local address 127.0.0.1:60038)
0809 15:31:03.546172 (+ 1202us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:03.546185 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:03.546268 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:03.546958 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:03.546961 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:03.546984 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:31:03.547092 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:03.547098 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.548164 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.548167 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:03.550161 (+ 1994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:03.550175 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.552842 (+ 2667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.552845 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:03.552914 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:03.552935 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 15:31:03.553023 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 15:31:03.553101 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":830,"mutex_wait_us":210,"thread_start_us":115,"threads_started":1}
I20260809 15:31:03.553501 16728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:03.545457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60038 (local address 127.11.146.2:38963)
0809 15:31:03.545821 (+ 364us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:03.545834 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:03.546359 (+ 525us) server_negotiation.cc:407] Connection header received
0809 15:31:03.546444 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:03.546448 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:03.546637 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:03.546787 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:31:03.547219 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.547988 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.551221 (+ 3233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.552040 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.552177 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:03.552772 (+ 595us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:03.553072 (+ 300us) server_negotiation.cc:299] Negotiation successful
0809 15:31:03.553166 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":140,"threads_started":1}
I20260809 15:31:03.555433 16367 tablet_service.cc:1467] Processing CreateTablet for tablet b2b9ba119a7a44f79a537b2bd7ec4c20 (DEFAULT_TABLE table=test-table [id=88d97960eba3454faa10d423249655d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:31:03.555437 16647 tablet_service.cc:1467] Processing CreateTablet for tablet b2b9ba119a7a44f79a537b2bd7ec4c20 (DEFAULT_TABLE table=test-table [id=88d97960eba3454faa10d423249655d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:31:03.555966 16508 tablet_service.cc:1467] Processing CreateTablet for tablet b2b9ba119a7a44f79a537b2bd7ec4c20 (DEFAULT_TABLE table=test-table [id=88d97960eba3454faa10d423249655d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:31:03.556645 16367 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2b9ba119a7a44f79a537b2bd7ec4c20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:03.556649 16647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2b9ba119a7a44f79a537b2bd7ec4c20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:03.557044 16508 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2b9ba119a7a44f79a537b2bd7ec4c20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:03.563192 16731 tablet_bootstrap.cc:492] T b2b9ba119a7a44f79a537b2bd7ec4c20 P 5d3694488c464763a56fb7ecf559a1cb: Bootstrap starting.
I20260809 15:31:03.564728 16733 tablet_bootstrap.cc:492] T b2b9ba119a7a44f79a537b2bd7ec4c20 P dd6c30752b5c446daaf3668edf7c579f: Bootstrap starting.
I20260809 15:31:03.565622 16731 tablet_bootstrap.cc:654] T b2b9ba119a7a44f79a537b2bd7ec4c20 P 5d3694488c464763a56fb7ecf559a1cb: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:03.566538 16733 tablet_bootstrap.cc:654] T b2b9ba119a7a44f79a537b2bd7ec4c20 P dd6c30752b5c446daaf3668edf7c579f: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:03.566852 16731 log.cc:824] T b2b9ba119a7a44f79a537b2bd7ec4c20 P 5d3694488c464763a56fb7ecf559a1cb: Log is configured to *not* fsync() on all Append() calls
I20260809 15:31:03.567612 16732 tablet_bootstrap.cc:492] T b2b9ba119a7a44f79a537b2bd7ec4c20 P c6beff2ce4a64478b064fcbb9b05b833: Bootstrap starting.
I20260809 15:31:03.567785 16733 log.cc:824] T b2b9ba119a7a44f79a537b2bd7ec4c20 P dd6c30752b5c446daaf3668edf7c579f: Log is configured to *not* fsync() on all Append() calls
I20260809 15:31:03.569427 16731 tablet_bootstrap.cc:492] T b2b9ba119a7a44f79a537b2bd7ec4c20 P 5d3694488c464763a56fb7ecf559a1cb: No bootstrap required, opened a new log
I20260809 15:31:03.569662 16733 tablet_bootstrap.cc:492] T b2b9ba119a7a44f79a537b2bd7ec4c20 P dd6c30752b5c446daaf3668edf7c579f: No bootstrap required, opened a new log
I20260809 15:31:03.569676 16731 ts_tablet_manager.cc:1397] T b2b9ba119a7a44f79a537b2bd7ec4c20 P 5d3694488c464763a56fb7ecf559a1cb: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260809 15:31:03.569811 16733 ts_tablet_manager.cc:1397] T b2b9ba119a7a44f79a537b2bd7ec4c20 P dd6c30752b5c446daaf3668edf7c579f: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s
I20260809 15:31:03.569850 16732 tablet_bootstrap.cc:654] T b2b9ba119a7a44f79a537b2bd7ec4c20 P c6beff2ce4a64478b064fcbb9b05b833: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:03.570663 16732 log.cc:824] T b2b9ba119a7a44f79a537b2bd7ec4c20 P c6beff2ce4a64478b064fcbb9b05b833: Log is configured to *not* fsync() on all Append() calls
I20260809 15:31:03.572688 16732 tablet_bootstrap.cc:492] T b2b9ba119a7a44f79a537b2bd7ec4c20 P c6beff2ce4a64478b064fcbb9b05b833: No bootstrap required, opened a new log
I20260809 15:31:03.572887 16732 ts_tablet_manager.cc:1397] T b2b9ba119a7a44f79a537b2bd7ec4c20 P c6beff2ce4a64478b064fcbb9b05b833: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 15:31:03.573232 16733 raft_consensus.cc:348] T b2b9ba119a7a44f79a537b2bd7ec4c20 P dd6c30752b5c446daaf3668edf7c579f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd6c30752b5c446daaf3668edf7c579f" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 46145 } } peers { permanent_uuid: "5d3694488c464763a56fb7ecf559a1cb" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38963 } } peers { permanent_uuid: "c6beff2ce4a64478b064fcbb9b05b833" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 38283 } }
I20260809 15:31:03.573505 16733 raft_consensus.cc:374] T b2b9ba119a7a44f79a537b2bd7ec4c20 P dd6c30752b5c446daaf3668edf7c579f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:03.573568 16733 raft_consensus.cc:729] T b2b9ba119a7a44f79a537b2bd7ec4c20 P dd6c30752b5c446daaf3668edf7c579f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd6c30752b5c446daaf3668edf7c579f, State: Initialized, Role: FOLLOWER
I20260809 15:31:03.573669 16731 raft_consensus.cc:348] T b2b9ba119a7a44f79a537b2bd7ec4c20 P 5d3694488c464763a56fb7ecf559a1cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd6c30752b5c446daaf3668edf7c579f" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 46145 } } peers { permanent_uuid: "5d3694488c464763a56fb7ecf559a1cb" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38963 } } peers { permanent_uuid: "c6beff2ce4a64478b064fcbb9b05b833" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 38283 } }
I20260809 15:31:03.574158 16731 raft_consensus.cc:374] T b2b9ba119a7a44f79a537b2bd7ec4c20 P 5d3694488c464763a56fb7ecf559a1cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:03.574211 16731 raft_consensus.cc:729] T b2b9ba119a7a44f79a537b2bd7ec4c20 P 5d3694488c464763a56fb7ecf559a1cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d3694488c464763a56fb7ecf559a1cb, State: Initialized, Role: FOLLOWER
I20260809 15:31:03.574111 16733 consensus_queue.cc:260] T b2b9ba119a7a44f79a537b2bd7ec4c20 P dd6c30752b5c446daaf3668edf7c579f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd6c30752b5c446daaf3668edf7c579f" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 46145 } } peers { permanent_uuid: "5d3694488c464763a56fb7ecf559a1cb" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38963 } } peers { permanent_uuid: "c6beff2ce4a64478b064fcbb9b05b833" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 38283 } }
I20260809 15:31:03.574724 16731 consensus_queue.cc:260] T b2b9ba119a7a44f79a537b2bd7ec4c20 P 5d3694488c464763a56fb7ecf559a1cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd6c30752b5c446daaf3668edf7c579f" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 46145 } } peers { permanent_uuid: "5d3694488c464763a56fb7ecf559a1cb" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38963 } } peers { permanent_uuid: "c6beff2ce4a64478b064fcbb9b05b833" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 38283 } }
I20260809 15:31:03.575459 16733 ts_tablet_manager.cc:1428] T b2b9ba119a7a44f79a537b2bd7ec4c20 P dd6c30752b5c446daaf3668edf7c579f: Time spent starting tablet: real 0.006s user 0.002s sys 0.004s
I20260809 15:31:03.575464 16576 heartbeater.cc:503] Master 127.11.146.62:37665 was elected leader, sending a full tablet report...
I20260809 15:31:03.575706 16731 ts_tablet_manager.cc:1428] T b2b9ba119a7a44f79a537b2bd7ec4c20 P 5d3694488c464763a56fb7ecf559a1cb: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 15:31:03.575800 16713 heartbeater.cc:503] Master 127.11.146.62:37665 was elected leader, sending a full tablet report...
I20260809 15:31:03.577981 16732 raft_consensus.cc:348] T b2b9ba119a7a44f79a537b2bd7ec4c20 P c6beff2ce4a64478b064fcbb9b05b833 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd6c30752b5c446daaf3668edf7c579f" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 46145 } } peers { permanent_uuid: "5d3694488c464763a56fb7ecf559a1cb" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38963 } } peers { permanent_uuid: "c6beff2ce4a64478b064fcbb9b05b833" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 38283 } }
I20260809 15:31:03.578207 16732 raft_consensus.cc:374] T b2b9ba119a7a44f79a537b2bd7ec4c20 P c6beff2ce4a64478b064fcbb9b05b833 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:03.578264 16732 raft_consensus.cc:729] T b2b9ba119a7a44f79a537b2bd7ec4c20 P c6beff2ce4a64478b064fcbb9b05b833 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6beff2ce4a64478b064fcbb9b05b833, State: Initialized, Role: FOLLOWER
I20260809 15:31:03.578619 16732 consensus_queue.cc:260] T b2b9ba119a7a44f79a537b2bd7ec4c20 P c6beff2ce4a64478b064fcbb9b05b833 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd6c30752b5c446daaf3668edf7c579f" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 46145 } } peers { permanent_uuid: "5d3694488c464763a56fb7ecf559a1cb" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38963 } } peers { permanent_uuid: "c6beff2ce4a64478b064fcbb9b05b833" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 38283 } }
I20260809 15:31:03.579592 16732 ts_tablet_manager.cc:1428] T b2b9ba119a7a44f79a537b2bd7ec4c20 P c6beff2ce4a64478b064fcbb9b05b833: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260809 15:31:03.580029 16437 heartbeater.cc:503] Master 127.11.146.62:37665 was elected leader, sending a full tablet report...
I20260809 15:31:03.673332 16739 raft_consensus.cc:482] T b2b9ba119a7a44f79a537b2bd7ec4c20 P c6beff2ce4a64478b064fcbb9b05b833 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:31:03.673622 16739 raft_consensus.cc:504] T b2b9ba119a7a44f79a537b2bd7ec4c20 P c6beff2ce4a64478b064fcbb9b05b833 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd6c30752b5c446daaf3668edf7c579f" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 46145 } } peers { permanent_uuid: "5d3694488c464763a56fb7ecf559a1cb" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38963 } } peers { permanent_uuid: "c6beff2ce4a64478b064fcbb9b05b833" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 38283 } }
I20260809 15:31:03.674831 16739 leader_election.cc:288] T b2b9ba119a7a44f79a537b2bd7ec4c20 P c6beff2ce4a64478b064fcbb9b05b833 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd6c30752b5c446daaf3668edf7c579f (127.11.146.3:46145), 5d3694488c464763a56fb7ecf559a1cb (127.11.146.2:38963)
I20260809 15:31:03.679442 16726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:03.675278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:36061 (local address 127.11.146.3:46145)
0809 15:31:03.675422 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:03.675427 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:03.675867 (+ 440us) server_negotiation.cc:407] Connection header received
0809 15:31:03.675923 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:03.675926 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:03.675980 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:03.676092 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:31:03.676494 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.677065 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.678451 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.678865 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.679009 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:03.679066 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:03.679251 (+ 185us) server_negotiation.cc:299] Negotiation successful
0809 15:31:03.679320 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 15:31:03.679478 16741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:03.675145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:46145 (local address 127.11.146.1:36061)
0809 15:31:03.675669 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:03.675683 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:03.675767 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:03.676128 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:03.676131 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:03.676211 (+ 80us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:31:03.676376 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:03.676381 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.677185 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.677189 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:03.678311 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:03.678322 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.679009 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.679013 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:03.679124 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:03.679144 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 15:31:03.679235 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 15:31:03.679308 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"mutex_wait_us":50,"spinlock_wait_cycles":18688,"thread_start_us":105,"threads_started":1}
I20260809 15:31:03.679927 16728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:03.675278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:42289 (local address 127.11.146.2:38963)
0809 15:31:03.675422 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:03.675427 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:03.675702 (+ 275us) server_negotiation.cc:407] Connection header received
0809 15:31:03.675924 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:03.675927 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:03.675980 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:03.676093 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:31:03.677191 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.677657 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.678863 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.679279 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.679416 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:03.679467 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:03.679696 (+ 229us) server_negotiation.cc:299] Negotiation successful
0809 15:31:03.679786 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 15:31:03.680347 16740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:03.675145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:38963 (local address 127.11.146.1:42289)
0809 15:31:03.675570 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:03.675588 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:03.675722 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:03.676128 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:03.676131 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:03.676155 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:31:03.676356 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:03.676366 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.677779 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.677782 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:03.678735 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:03.678744 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.679411 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.679415 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:03.679523 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:03.679574 (+ 51us) client_negotiation.cc:769] Sending connection context
0809 15:31:03.680105 (+ 531us) client_negotiation.cc:240] Negotiation successful
0809 15:31:03.680200 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"mutex_wait_us":5,"spinlock_wait_cycles":26368,"thread_start_us":131,"threads_started":1}
I20260809 15:31:03.680428 16667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2b9ba119a7a44f79a537b2bd7ec4c20" candidate_uuid: "c6beff2ce4a64478b064fcbb9b05b833" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd6c30752b5c446daaf3668edf7c579f" is_pre_election: true
I20260809 15:31:03.680758 16667 raft_consensus.cc:2454] T b2b9ba119a7a44f79a537b2bd7ec4c20 P dd6c30752b5c446daaf3668edf7c579f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6beff2ce4a64478b064fcbb9b05b833 in term 0.
I20260809 15:31:03.681033 16527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2b9ba119a7a44f79a537b2bd7ec4c20" candidate_uuid: "c6beff2ce4a64478b064fcbb9b05b833" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d3694488c464763a56fb7ecf559a1cb" is_pre_election: true
I20260809 15:31:03.681327 16527 raft_consensus.cc:2454] T b2b9ba119a7a44f79a537b2bd7ec4c20 P 5d3694488c464763a56fb7ecf559a1cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6beff2ce4a64478b064fcbb9b05b833 in term 0.
I20260809 15:31:03.681311 16321 leader_election.cc:302] T b2b9ba119a7a44f79a537b2bd7ec4c20 P c6beff2ce4a64478b064fcbb9b05b833 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6beff2ce4a64478b064fcbb9b05b833, dd6c30752b5c446daaf3668edf7c579f; no voters:
I20260809 15:31:03.681655 16739 raft_consensus.cc:2781] T b2b9ba119a7a44f79a537b2bd7ec4c20 P c6beff2ce4a64478b064fcbb9b05b833 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:31:03.681761 16739 raft_consensus.cc:482] T b2b9ba119a7a44f79a537b2bd7ec4c20 P c6beff2ce4a64478b064fcbb9b05b833 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:31:03.681823 16739 raft_consensus.cc:3037] T b2b9ba119a7a44f79a537b2bd7ec4c20 P c6beff2ce4a64478b064fcbb9b05b833 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:03.682899 16739 raft_consensus.cc:504] T b2b9ba119a7a44f79a537b2bd7ec4c20 P c6beff2ce4a64478b064fcbb9b05b833 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd6c30752b5c446daaf3668edf7c579f" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 46145 } } peers { permanent_uuid: "5d3694488c464763a56fb7ecf559a1cb" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38963 } } peers { permanent_uuid: "c6beff2ce4a64478b064fcbb9b05b833" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 38283 } }
I20260809 15:31:03.683269 16739 leader_election.cc:288] T b2b9ba119a7a44f79a537b2bd7ec4c20 P c6beff2ce4a64478b064fcbb9b05b833 [CANDIDATE]: Term 1 election: Requested vote from peers dd6c30752b5c446daaf3668edf7c579f (127.11.146.3:46145), 5d3694488c464763a56fb7ecf559a1cb (127.11.146.2:38963)
I20260809 15:31:03.683792 16667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2b9ba119a7a44f79a537b2bd7ec4c20" candidate_uuid: "c6beff2ce4a64478b064fcbb9b05b833" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd6c30752b5c446daaf3668edf7c579f"
I20260809 15:31:03.683792 16527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2b9ba119a7a44f79a537b2bd7ec4c20" candidate_uuid: "c6beff2ce4a64478b064fcbb9b05b833" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d3694488c464763a56fb7ecf559a1cb"
I20260809 15:31:03.683938 16667 raft_consensus.cc:3037] T b2b9ba119a7a44f79a537b2bd7ec4c20 P dd6c30752b5c446daaf3668edf7c579f [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:03.683928 16527 raft_consensus.cc:3037] T b2b9ba119a7a44f79a537b2bd7ec4c20 P 5d3694488c464763a56fb7ecf559a1cb [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:03.685323 16667 raft_consensus.cc:2454] T b2b9ba119a7a44f79a537b2bd7ec4c20 P dd6c30752b5c446daaf3668edf7c579f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6beff2ce4a64478b064fcbb9b05b833 in term 1.
I20260809 15:31:03.685318 16527 raft_consensus.cc:2454] T b2b9ba119a7a44f79a537b2bd7ec4c20 P 5d3694488c464763a56fb7ecf559a1cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6beff2ce4a64478b064fcbb9b05b833 in term 1.
I20260809 15:31:03.685668 16321 leader_election.cc:302] T b2b9ba119a7a44f79a537b2bd7ec4c20 P c6beff2ce4a64478b064fcbb9b05b833 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 5d3694488c464763a56fb7ecf559a1cb, c6beff2ce4a64478b064fcbb9b05b833, dd6c30752b5c446daaf3668edf7c579f; no voters:
I20260809 15:31:03.685873 16739 raft_consensus.cc:2781] T b2b9ba119a7a44f79a537b2bd7ec4c20 P c6beff2ce4a64478b064fcbb9b05b833 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:31:03.686070 16739 raft_consensus.cc:686] T b2b9ba119a7a44f79a537b2bd7ec4c20 P c6beff2ce4a64478b064fcbb9b05b833 [term 1 LEADER]: Becoming Leader. State: Replica: c6beff2ce4a64478b064fcbb9b05b833, State: Running, Role: LEADER
I20260809 15:31:03.686460 16739 consensus_queue.cc:237] T b2b9ba119a7a44f79a537b2bd7ec4c20 P c6beff2ce4a64478b064fcbb9b05b833 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd6c30752b5c446daaf3668edf7c579f" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 46145 } } peers { permanent_uuid: "5d3694488c464763a56fb7ecf559a1cb" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38963 } } peers { permanent_uuid: "c6beff2ce4a64478b064fcbb9b05b833" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 38283 } }
I20260809 15:31:03.690032 16232 catalog_manager.cc:5495] T b2b9ba119a7a44f79a537b2bd7ec4c20 P c6beff2ce4a64478b064fcbb9b05b833 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6beff2ce4a64478b064fcbb9b05b833 (127.11.146.1). New cstate: current_term: 1 leader_uuid: "c6beff2ce4a64478b064fcbb9b05b833" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd6c30752b5c446daaf3668edf7c579f" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d3694488c464763a56fb7ecf559a1cb" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6beff2ce4a64478b064fcbb9b05b833" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 38283 } health_report { overall_health: HEALTHY } } }
I20260809 15:31:03.705276 16730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:03.701690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55364 (local address 127.11.146.1:38283)
0809 15:31:03.701821 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:03.701824 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:03.701838 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:31:03.701990 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:03.701992 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:03.702053 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:03.702144 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:31:03.702387 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.702899 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.703754 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:03.703980 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:03.704137 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:03.704423 (+ 286us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:31:03.704869 (+ 446us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:31:03.704969 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:03.705108 (+ 139us) server_negotiation.cc:299] Negotiation successful
0809 15:31:03.705162 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 15:31:03.711566 16667 raft_consensus.cc:1261] T b2b9ba119a7a44f79a537b2bd7ec4c20 P dd6c30752b5c446daaf3668edf7c579f [term 1 FOLLOWER]: Refusing update from remote peer c6beff2ce4a64478b064fcbb9b05b833: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:31:03.711647 16527 raft_consensus.cc:1261] T b2b9ba119a7a44f79a537b2bd7ec4c20 P 5d3694488c464763a56fb7ecf559a1cb [term 1 FOLLOWER]: Refusing update from remote peer c6beff2ce4a64478b064fcbb9b05b833: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:31:03.712416 16742 consensus_queue.cc:1035] T b2b9ba119a7a44f79a537b2bd7ec4c20 P c6beff2ce4a64478b064fcbb9b05b833 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d3694488c464763a56fb7ecf559a1cb" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:31:03.712633 16739 consensus_queue.cc:1035] T b2b9ba119a7a44f79a537b2bd7ec4c20 P c6beff2ce4a64478b064fcbb9b05b833 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd6c30752b5c446daaf3668edf7c579f" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:31:03.719863 16745 mvcc.cc:205] Tried to move back new op lower bound from 7316641643355054080 to 7316641643262697472. Current Snapshot: MvccSnapshot[applied={T|T < 7316641643355054080}]
I20260809 15:31:03.721623 16747 mvcc.cc:205] Tried to move back new op lower bound from 7316641643355054080 to 7316641643262697472. Current Snapshot: MvccSnapshot[applied={T|T < 7316641643355054080}]
I20260809 15:31:03.723675 16746 mvcc.cc:205] Tried to move back new op lower bound from 7316641643355054080 to 7316641643262697472. Current Snapshot: MvccSnapshot[applied={T|T < 7316641643355054080 or (T in {7316641643355054080})}]
I20260809 15:31:03.730060 16232 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51694:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:31:03.730253 16232 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51694:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:31:03.733062 16232 catalog_manager.cc:5782] T 00000000000000000000000000000000 P be6589ea322645d4beae797faad12731: Sending DeleteTablet for 3 replicas of tablet b2b9ba119a7a44f79a537b2bd7ec4c20
I20260809 15:31:03.733897 16508 tablet_service.cc:1514] Processing DeleteTablet for tablet b2b9ba119a7a44f79a537b2bd7ec4c20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:31:03 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:60038
I20260809 15:31:03.734126 16367 tablet_service.cc:1514] Processing DeleteTablet for tablet b2b9ba119a7a44f79a537b2bd7ec4c20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:31:03 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:55352
I20260809 15:31:03.734594 16647 tablet_service.cc:1514] Processing DeleteTablet for tablet b2b9ba119a7a44f79a537b2bd7ec4c20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:31:03 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:39634
I20260809 15:31:03.734685 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 16302
I20260809 15:31:03.737134 16757 tablet_replica.cc:330] T b2b9ba119a7a44f79a537b2bd7ec4c20 P 5d3694488c464763a56fb7ecf559a1cb: stopping tablet replica
I20260809 15:31:03.737283 16759 tablet_replica.cc:330] T b2b9ba119a7a44f79a537b2bd7ec4c20 P dd6c30752b5c446daaf3668edf7c579f: stopping tablet replica
I20260809 15:31:03.737488 16757 raft_consensus.cc:2229] T b2b9ba119a7a44f79a537b2bd7ec4c20 P 5d3694488c464763a56fb7ecf559a1cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:31:03.737610 16759 raft_consensus.cc:2229] T b2b9ba119a7a44f79a537b2bd7ec4c20 P dd6c30752b5c446daaf3668edf7c579f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:31:03.737783 16757 raft_consensus.cc:2258] T b2b9ba119a7a44f79a537b2bd7ec4c20 P 5d3694488c464763a56fb7ecf559a1cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:31:03.737931 16759 raft_consensus.cc:2258] T b2b9ba119a7a44f79a537b2bd7ec4c20 P dd6c30752b5c446daaf3668edf7c579f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:31:03.739419 16757 ts_tablet_manager.cc:1905] T b2b9ba119a7a44f79a537b2bd7ec4c20 P 5d3694488c464763a56fb7ecf559a1cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:31:03.739476 16759 ts_tablet_manager.cc:1905] T b2b9ba119a7a44f79a537b2bd7ec4c20 P dd6c30752b5c446daaf3668edf7c579f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:31:03.742322 16757 ts_tablet_manager.cc:1918] T b2b9ba119a7a44f79a537b2bd7ec4c20 P 5d3694488c464763a56fb7ecf559a1cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:31:03.742434 16757 log.cc:1196] T b2b9ba119a7a44f79a537b2bd7ec4c20 P 5d3694488c464763a56fb7ecf559a1cb: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-1/wal/wals/b2b9ba119a7a44f79a537b2bd7ec4c20
I20260809 15:31:03.742739 16757 ts_tablet_manager.cc:1939] T b2b9ba119a7a44f79a537b2bd7ec4c20 P 5d3694488c464763a56fb7ecf559a1cb: Deleting consensus metadata
I20260809 15:31:03.743417 16759 ts_tablet_manager.cc:1918] T b2b9ba119a7a44f79a537b2bd7ec4c20 P dd6c30752b5c446daaf3668edf7c579f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:31:03.743537 16759 log.cc:1196] T b2b9ba119a7a44f79a537b2bd7ec4c20 P dd6c30752b5c446daaf3668edf7c579f: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786289437399694-11848-0/minicluster-data/ts-2/wal/wals/b2b9ba119a7a44f79a537b2bd7ec4c20
I20260809 15:31:03.743904 16759 ts_tablet_manager.cc:1939] T b2b9ba119a7a44f79a537b2bd7ec4c20 P dd6c30752b5c446daaf3668edf7c579f: Deleting consensus metadata
I20260809 15:31:03.744089 16219 catalog_manager.cc:4841] TS 5d3694488c464763a56fb7ecf559a1cb (127.11.146.2:38963): tablet b2b9ba119a7a44f79a537b2bd7ec4c20 (table test-table [id=88d97960eba3454faa10d423249655d1]) successfully deleted
I20260809 15:31:03.745227 16220 catalog_manager.cc:4841] TS dd6c30752b5c446daaf3668edf7c579f (127.11.146.3:46145): tablet b2b9ba119a7a44f79a537b2bd7ec4c20 (table test-table [id=88d97960eba3454faa10d423249655d1]) successfully deleted
W20260809 15:31:03.746397 16218 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.146.1:38283 (error 108)
I20260809 15:31:03.747421 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 16442
I20260809 15:31:03.747560 16727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:03.747219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:38283 (local address 127.0.0.1:55372)
0809 15:31:03.747380 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:03.747461 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.1:38283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260809 15:31:03.749702 16218 catalog_manager.cc:4584] TS c6beff2ce4a64478b064fcbb9b05b833 (127.11.146.1:38283): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b2b9ba119a7a44f79a537b2bd7ec4c20: Network error: Client connection negotiation failed: client connection to 127.11.146.1:38283: connect: Connection refused (error 111)
I20260809 15:31:03.755508 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 16582
I20260809 15:31:03.762531 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 16201
2026-08-09T15:31:03Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2488 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-09T15:31:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:31:03Z Disabled control of system clock
I20260809 15:31:03.796622 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:36901
--webserver_interface=127.11.146.62
--webserver_port=0
--builtin_ntp_servers=127.11.146.20:33471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:36901
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 15:31:03.914121 16764 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:03.914381 16764 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:03.914417 16764 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:03.918422 16764 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:31:03.918481 16764 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:03.918497 16764 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:03.918515 16764 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:31:03.918530 16764 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:31:03.923193 16764 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:33471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:36901
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:36901
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16764
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:03.924292 16764 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:03.925647 16764 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:03.934057 16772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:03.934046 16769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:03.934159 16764 server_base.cc:1034] running on GCE node
W20260809 15:31:03.934057 16770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:03.934881 16764 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:03.935976 16764 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:03.937172 16764 hybrid_clock.cc:648] HybridClock initialized: now 1786289463937148 us; error 46 us; skew 500 ppm
I20260809 15:31:03.939004 16764 webserver.cc:460] Webserver started at http://127.11.146.62:36293/ using document root <none> and password file <none>
I20260809 15:31:03.939586 16764 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:03.939679 16764 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:03.939920 16764 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:03.942083 16764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "f26e9ffa88724a2ba7356933db5f2b04"
format_stamp: "Formatted at 2026-08-09 15:31:03 on dist-test-slave-1jjb"
server_key: "6155b29657dc82f3216e1acfd5bef539"
server_key_iv: "a0c62e25edce9905fc502dcf787c149c"
server_key_version: "encryptionkey@0"
I20260809 15:31:03.942668 16764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "f26e9ffa88724a2ba7356933db5f2b04"
format_stamp: "Formatted at 2026-08-09 15:31:03 on dist-test-slave-1jjb"
server_key: "6155b29657dc82f3216e1acfd5bef539"
server_key_iv: "a0c62e25edce9905fc502dcf787c149c"
server_key_version: "encryptionkey@0"
I20260809 15:31:03.946350 16764 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 15:31:03.948722 16779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:03.949940 16764 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 15:31:03.950093 16764 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "f26e9ffa88724a2ba7356933db5f2b04"
format_stamp: "Formatted at 2026-08-09 15:31:03 on dist-test-slave-1jjb"
server_key: "6155b29657dc82f3216e1acfd5bef539"
server_key_iv: "a0c62e25edce9905fc502dcf787c149c"
server_key_version: "encryptionkey@0"
I20260809 15:31:03.950210 16764 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:03.954883 16764 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:03.955482 16764 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:03.955672 16764 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:03.962903 16764 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:36901
I20260809 15:31:03.962965 16833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:36901 every 8 connection(s)
I20260809 15:31:03.963876 16764 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:31:03.967224 16834 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:03.972813 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 16764
I20260809 15:31:03.972934 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:31:03.973215 11848 external_mini_cluster.cc:1428] Setting key 4b7f98bc7df6a8d90b4430e5ff94df13
I20260809 15:31:03.973628 16834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f26e9ffa88724a2ba7356933db5f2b04: Bootstrap starting.
I20260809 15:31:03.976516 16834 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f26e9ffa88724a2ba7356933db5f2b04: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:03.977324 16834 log.cc:824] T 00000000000000000000000000000000 P f26e9ffa88724a2ba7356933db5f2b04: Log is configured to *not* fsync() on all Append() calls
I20260809 15:31:03.979229 16837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:03.974732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42930 (local address 127.11.146.62:36901)
0809 15:31:03.975482 (+ 750us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:03.975498 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:03.975533 (+ 35us) server_negotiation.cc:407] Connection header received
0809 15:31:03.976251 (+ 718us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:03.976271 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:03.976700 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:03.977075 (+ 375us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:03.977881 (+ 806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:03.977887 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:03.977909 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:31:03.977919 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:03.977978 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:31:03.977994 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:03.978128 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:03.978252 (+ 124us) server_negotiation.cc:299] Negotiation successful
0809 15:31:03.978521 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":152,"threads_started":1}
I20260809 15:31:03.979465 16834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f26e9ffa88724a2ba7356933db5f2b04: No bootstrap required, opened a new log
I20260809 15:31:03.983181 16834 raft_consensus.cc:348] T 00000000000000000000000000000000 P f26e9ffa88724a2ba7356933db5f2b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f26e9ffa88724a2ba7356933db5f2b04" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 36901 } }
I20260809 15:31:03.983435 16834 raft_consensus.cc:374] T 00000000000000000000000000000000 P f26e9ffa88724a2ba7356933db5f2b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:03.983525 16834 raft_consensus.cc:729] T 00000000000000000000000000000000 P f26e9ffa88724a2ba7356933db5f2b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f26e9ffa88724a2ba7356933db5f2b04, State: Initialized, Role: FOLLOWER
I20260809 15:31:03.983971 16834 consensus_queue.cc:260] T 00000000000000000000000000000000 P f26e9ffa88724a2ba7356933db5f2b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f26e9ffa88724a2ba7356933db5f2b04" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 36901 } }
I20260809 15:31:03.984174 16834 raft_consensus.cc:388] T 00000000000000000000000000000000 P f26e9ffa88724a2ba7356933db5f2b04 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:31:03.984259 16834 raft_consensus.cc:482] T 00000000000000000000000000000000 P f26e9ffa88724a2ba7356933db5f2b04 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:31:03.984383 16834 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f26e9ffa88724a2ba7356933db5f2b04 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:03.985390 16834 raft_consensus.cc:504] T 00000000000000000000000000000000 P f26e9ffa88724a2ba7356933db5f2b04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f26e9ffa88724a2ba7356933db5f2b04" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 36901 } }
I20260809 15:31:03.985769 16834 leader_election.cc:302] T 00000000000000000000000000000000 P f26e9ffa88724a2ba7356933db5f2b04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f26e9ffa88724a2ba7356933db5f2b04; no voters:
I20260809 15:31:03.986142 16834 leader_election.cc:288] T 00000000000000000000000000000000 P f26e9ffa88724a2ba7356933db5f2b04 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:31:03.986220 16839 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f26e9ffa88724a2ba7356933db5f2b04 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:31:03.986441 16839 raft_consensus.cc:686] T 00000000000000000000000000000000 P f26e9ffa88724a2ba7356933db5f2b04 [term 1 LEADER]: Becoming Leader. State: Replica: f26e9ffa88724a2ba7356933db5f2b04, State: Running, Role: LEADER
I20260809 15:31:03.986745 16839 consensus_queue.cc:237] T 00000000000000000000000000000000 P f26e9ffa88724a2ba7356933db5f2b04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f26e9ffa88724a2ba7356933db5f2b04" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 36901 } }
I20260809 15:31:03.987548 16834 sys_catalog.cc:564] T 00000000000000000000000000000000 P f26e9ffa88724a2ba7356933db5f2b04 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:31:03.988586 16841 sys_catalog.cc:455] T 00000000000000000000000000000000 P f26e9ffa88724a2ba7356933db5f2b04 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f26e9ffa88724a2ba7356933db5f2b04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f26e9ffa88724a2ba7356933db5f2b04" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 36901 } } }
I20260809 15:31:03.988724 16841 sys_catalog.cc:458] T 00000000000000000000000000000000 P f26e9ffa88724a2ba7356933db5f2b04 [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:03.989030 16840 sys_catalog.cc:455] T 00000000000000000000000000000000 P f26e9ffa88724a2ba7356933db5f2b04 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f26e9ffa88724a2ba7356933db5f2b04. Latest consensus state: current_term: 1 leader_uuid: "f26e9ffa88724a2ba7356933db5f2b04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f26e9ffa88724a2ba7356933db5f2b04" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 36901 } } }
I20260809 15:31:03.989144 16840 sys_catalog.cc:458] T 00000000000000000000000000000000 P f26e9ffa88724a2ba7356933db5f2b04 [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:03.989141 16848 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:31:03.992579 16848 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:31:03.998557 16848 catalog_manager.cc:1347] Generated new cluster ID: 74c8691ef4754c479b4d75588ff0ef4b
I20260809 15:31:03.998634 16848 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:31:04.030761 16848 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:31:04.031138 16848 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:31:04.036033 16848 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f26e9ffa88724a2ba7356933db5f2b04: Generated new TSK 0
I20260809 15:31:04.036763 16848 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:31:04.039737 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.1:0
--local_ip_for_outbound_sockets=127.11.146.1
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:36901
--builtin_ntp_servers=127.11.146.20:33471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 15:31:04.157850 16859 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:04.158154 16859 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:04.158227 16859 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:04.162346 16859 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:04.162437 16859 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:04.162534 16859 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.1
I20260809 15:31:04.167430 16859 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:33471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:36901
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16859
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.1
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:04.168772 16859 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:04.170228 16859 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:04.180371 16864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:04.180351 16865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:04.180356 16867 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:04.180449 16859 server_base.cc:1034] running on GCE node
I20260809 15:31:04.181073 16859 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:04.181671 16859 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:04.182832 16859 hybrid_clock.cc:648] HybridClock initialized: now 1786289464182812 us; error 30 us; skew 500 ppm
I20260809 15:31:04.184731 16859 webserver.cc:460] Webserver started at http://127.11.146.1:41093/ using document root <none> and password file <none>
I20260809 15:31:04.185313 16859 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:04.185375 16859 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:04.185633 16859 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:04.187953 16859 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-0/data/instance:
uuid: "050d2997cded41e3a53997b6aaf366d4"
format_stamp: "Formatted at 2026-08-09 15:31:04 on dist-test-slave-1jjb"
server_key: "ed6e04a69fc8d0d654b62fd5eb7afc63"
server_key_iv: "2fa3495d730ccd55c4237da68b945404"
server_key_version: "encryptionkey@0"
I20260809 15:31:04.188619 16859 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance:
uuid: "050d2997cded41e3a53997b6aaf366d4"
format_stamp: "Formatted at 2026-08-09 15:31:04 on dist-test-slave-1jjb"
server_key: "ed6e04a69fc8d0d654b62fd5eb7afc63"
server_key_iv: "2fa3495d730ccd55c4237da68b945404"
server_key_version: "encryptionkey@0"
I20260809 15:31:04.192515 16859 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 15:31:04.195106 16873 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:04.196640 16859 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:31:04.196748 16859 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-0/wal
uuid: "050d2997cded41e3a53997b6aaf366d4"
format_stamp: "Formatted at 2026-08-09 15:31:04 on dist-test-slave-1jjb"
server_key: "ed6e04a69fc8d0d654b62fd5eb7afc63"
server_key_iv: "2fa3495d730ccd55c4237da68b945404"
server_key_version: "encryptionkey@0"
I20260809 15:31:04.196878 16859 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:04.201496 16859 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:04.202085 16859 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:04.202261 16859 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:04.202800 16859 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:31:04.203742 16859 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:04.203789 16859 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:04.203826 16859 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:04.203878 16859 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:04.212973 16859 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.1:44621
I20260809 15:31:04.213078 16991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.1:44621 every 8 connection(s)
I20260809 15:31:04.213928 16859 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
I20260809 15:31:04.217303 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 16859
I20260809 15:31:04.217427 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance
I20260809 15:31:04.217697 11848 external_mini_cluster.cc:1428] Setting key c7442e8cb5e2fafc7e9c05ffc150d649
I20260809 15:31:04.219892 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.2:0
--local_ip_for_outbound_sockets=127.11.146.2
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:36901
--builtin_ntp_servers=127.11.146.20:33471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260809 15:31:04.220999 16837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:04.216158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:60841 (local address 127.11.146.62:36901)
0809 15:31:04.216338 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:04.216342 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:04.217274 (+ 932us) server_negotiation.cc:407] Connection header received
0809 15:31:04.219039 (+ 1765us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:04.219042 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:04.219076 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:04.219182 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:04.220455 (+ 1273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:04.220462 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:04.220468 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:31:04.220487 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:04.220515 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:31:04.220528 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:04.220631 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:04.220760 (+ 129us) server_negotiation.cc:299] Negotiation successful
0809 15:31:04.220808 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 15:31:04.221856 16994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:04.216428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:36901 (local address 127.11.146.1:60841)
0809 15:31:04.217113 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:04.217153 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:04.218821 (+ 1668us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:04.219373 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:04.219382 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:04.219489 (+ 107us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:04.220190 (+ 701us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:31:04.220192 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:04.220233 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:31:04.220305 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:04.220622 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:04.220630 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:04.220634 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 15:31:04.220769 (+ 135us) client_negotiation.cc:240] Negotiation successful
0809 15:31:04.220957 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":122,"threads_started":1}
I20260809 15:31:04.223161 16992 heartbeater.cc:347] Connected to a master server at 127.11.146.62:36901
I20260809 15:31:04.223399 16992 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:04.223829 16992 heartbeater.cc:511] Master 127.11.146.62:36901 requested a full tablet report, sending...
I20260809 15:31:04.225466 16797 ts_manager.cc:194] Registered new tserver with Master: 050d2997cded41e3a53997b6aaf366d4 (127.11.146.1:44621)
W20260809 15:31:04.335762 16995 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:04.336030 16995 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:04.336125 16995 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:04.340310 16995 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:04.340361 16995 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:04.340446 16995 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.2
I20260809 15:31:04.345299 16995 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:33471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:36901
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16995
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.2
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:04.346381 16995 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:04.347788 16995 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:04.358279 17000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:04.358367 16995 server_base.cc:1034] running on GCE node
W20260809 15:31:04.358309 17003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:04.358299 17001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:04.359050 16995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:04.359740 16995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:04.360957 16995 hybrid_clock.cc:648] HybridClock initialized: now 1786289464360936 us; error 30 us; skew 500 ppm
I20260809 15:31:04.362846 16995 webserver.cc:460] Webserver started at http://127.11.146.2:38201/ using document root <none> and password file <none>
I20260809 15:31:04.363462 16995 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:04.363574 16995 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:04.363814 16995 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:04.366053 16995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-1/data/instance:
uuid: "d1fcf3ebe1ba4889a6dba41e948ecdc8"
format_stamp: "Formatted at 2026-08-09 15:31:04 on dist-test-slave-1jjb"
server_key: "c25527735d2d6d17002fddc30f5a013c"
server_key_iv: "8760cdd7f004e2bb1a37c2c2955cae56"
server_key_version: "encryptionkey@0"
I20260809 15:31:04.366672 16995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance:
uuid: "d1fcf3ebe1ba4889a6dba41e948ecdc8"
format_stamp: "Formatted at 2026-08-09 15:31:04 on dist-test-slave-1jjb"
server_key: "c25527735d2d6d17002fddc30f5a013c"
server_key_iv: "8760cdd7f004e2bb1a37c2c2955cae56"
server_key_version: "encryptionkey@0"
I20260809 15:31:04.370766 16995 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 15:31:04.373832 17009 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:04.375135 16995 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:31:04.375279 16995 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-1/wal
uuid: "d1fcf3ebe1ba4889a6dba41e948ecdc8"
format_stamp: "Formatted at 2026-08-09 15:31:04 on dist-test-slave-1jjb"
server_key: "c25527735d2d6d17002fddc30f5a013c"
server_key_iv: "8760cdd7f004e2bb1a37c2c2955cae56"
server_key_version: "encryptionkey@0"
I20260809 15:31:04.375404 16995 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:04.380949 16995 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:04.381629 16995 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:04.381839 16995 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:04.382432 16995 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:31:04.383431 16995 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:04.383509 16995 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:04.383589 16995 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:04.383648 16995 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:04.393719 16995 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.2:39495
I20260809 15:31:04.393741 17128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.2:39495 every 8 connection(s)
I20260809 15:31:04.394690 16995 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
I20260809 15:31:04.398135 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 16995
I20260809 15:31:04.398267 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance
I20260809 15:31:04.398582 11848 external_mini_cluster.cc:1428] Setting key e87f0d597707473d2a05f7e925702b16
I20260809 15:31:04.401006 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.3:0
--local_ip_for_outbound_sockets=127.11.146.3
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:36901
--builtin_ntp_servers=127.11.146.20:33471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260809 15:31:04.402144 16837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:04.396746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:42505 (local address 127.11.146.62:36901)
0809 15:31:04.396905 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:04.396909 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:04.398156 (+ 1247us) server_negotiation.cc:407] Connection header received
0809 15:31:04.399876 (+ 1720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:04.399879 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:04.399934 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:04.400026 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:04.401657 (+ 1631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:04.401661 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:04.401663 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:31:04.401675 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:04.401697 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:31:04.401705 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:04.401786 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:04.402003 (+ 217us) server_negotiation.cc:299] Negotiation successful
0809 15:31:04.402040 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 15:31:04.403411 17131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:04.397202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:36901 (local address 127.11.146.2:42505)
0809 15:31:04.397933 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:04.397990 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:04.399588 (+ 1598us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:04.400494 (+ 906us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:04.400503 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:04.400615 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:04.401327 (+ 712us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:31:04.401331 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:04.401388 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:31:04.401479 (+ 91us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:04.401819 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:04.401832 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:04.401842 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 15:31:04.402052 (+ 210us) client_negotiation.cc:240] Negotiation successful
0809 15:31:04.402329 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":137,"threads_started":1}
I20260809 15:31:04.404554 17129 heartbeater.cc:347] Connected to a master server at 127.11.146.62:36901
I20260809 15:31:04.404793 17129 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:04.405252 17129 heartbeater.cc:511] Master 127.11.146.62:36901 requested a full tablet report, sending...
I20260809 15:31:04.406419 16797 ts_manager.cc:194] Registered new tserver with Master: d1fcf3ebe1ba4889a6dba41e948ecdc8 (127.11.146.2:39495)
W20260809 15:31:04.526482 17133 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:04.526726 17133 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:04.526764 17133 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:04.530750 17133 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:04.530838 17133 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:04.530936 17133 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.3
I20260809 15:31:04.535846 17133 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:33471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:36901
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17133
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.3
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:04.536939 17133 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:04.538350 17133 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:04.548112 17141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:04.548107 17138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:04.548132 17139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:04.548305 17133 server_base.cc:1034] running on GCE node
I20260809 15:31:04.548763 17133 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:04.549420 17133 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:04.550582 17133 hybrid_clock.cc:648] HybridClock initialized: now 1786289464550568 us; error 24 us; skew 500 ppm
I20260809 15:31:04.552502 17133 webserver.cc:460] Webserver started at http://127.11.146.3:39955/ using document root <none> and password file <none>
I20260809 15:31:04.553053 17133 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:04.553133 17133 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:04.553396 17133 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:04.555815 17133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-2/data/instance:
uuid: "72024ce1559c4cdcbdd5579d60a41bb1"
format_stamp: "Formatted at 2026-08-09 15:31:04 on dist-test-slave-1jjb"
server_key: "83c1197f29e0214bdf62ad14d6549fdd"
server_key_iv: "375f6f9d6cd29ea9cc7996fb8e153357"
server_key_version: "encryptionkey@0"
I20260809 15:31:04.556475 17133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance:
uuid: "72024ce1559c4cdcbdd5579d60a41bb1"
format_stamp: "Formatted at 2026-08-09 15:31:04 on dist-test-slave-1jjb"
server_key: "83c1197f29e0214bdf62ad14d6549fdd"
server_key_iv: "375f6f9d6cd29ea9cc7996fb8e153357"
server_key_version: "encryptionkey@0"
I20260809 15:31:04.560329 17133 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 15:31:04.562942 17147 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:04.564378 17133 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:31:04.564543 17133 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-2/wal
uuid: "72024ce1559c4cdcbdd5579d60a41bb1"
format_stamp: "Formatted at 2026-08-09 15:31:04 on dist-test-slave-1jjb"
server_key: "83c1197f29e0214bdf62ad14d6549fdd"
server_key_iv: "375f6f9d6cd29ea9cc7996fb8e153357"
server_key_version: "encryptionkey@0"
I20260809 15:31:04.564666 17133 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:04.569329 17133 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:04.569948 17133 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:04.570129 17133 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:04.570690 17133 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:31:04.571723 17133 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:04.571818 17133 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:04.571897 17133 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:04.571956 17133 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:04.581266 17133 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.3:36859
I20260809 15:31:04.581296 17264 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.3:36859 every 8 connection(s)
I20260809 15:31:04.582178 17133 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
I20260809 15:31:04.588620 16837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:04.583988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:53077 (local address 127.11.146.62:36901)
0809 15:31:04.584204 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:04.584208 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:04.585235 (+ 1027us) server_negotiation.cc:407] Connection header received
0809 15:31:04.586633 (+ 1398us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:04.586637 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:04.586685 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:04.586797 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:04.587869 (+ 1072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:04.587873 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:04.587876 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:31:04.587889 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:04.587918 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:31:04.587926 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:04.588046 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:04.588380 (+ 334us) server_negotiation.cc:299] Negotiation successful
0809 15:31:04.588452 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 15:31:04.589419 17267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:04.584380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:36901 (local address 127.11.146.3:53077)
0809 15:31:04.585060 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:04.585101 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:04.586413 (+ 1312us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:04.586969 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:04.586975 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:04.587067 (+ 92us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:04.587601 (+ 534us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:31:04.587603 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:04.587645 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:31:04.587714 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:04.588170 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:04.588179 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:04.588185 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 15:31:04.588397 (+ 212us) client_negotiation.cc:240] Negotiation successful
0809 15:31:04.588632 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":106,"threads_started":1}
I20260809 15:31:04.589811 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 17133
I20260809 15:31:04.589991 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance
I20260809 15:31:04.590271 11848 external_mini_cluster.cc:1428] Setting key a9eb335503ca0b61f548873efc7eb5f7
I20260809 15:31:04.590644 17265 heartbeater.cc:347] Connected to a master server at 127.11.146.62:36901
I20260809 15:31:04.590890 17265 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:04.591359 17265 heartbeater.cc:511] Master 127.11.146.62:36901 requested a full tablet report, sending...
I20260809 15:31:04.592509 16797 ts_manager.cc:194] Registered new tserver with Master: 72024ce1559c4cdcbdd5579d60a41bb1 (127.11.146.3:36859)
I20260809 15:31:04.604256 11848 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:31:04.607772 16837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:04.606170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42942 (local address 127.11.146.62:36901)
0809 15:31:04.606325 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:04.606330 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:04.606520 (+ 190us) server_negotiation.cc:407] Connection header received
0809 15:31:04.606604 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:04.606606 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:04.606639 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:04.606703 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:04.607412 (+ 709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:04.607415 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:04.607417 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:31:04.607427 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:04.607444 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:31:04.607451 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:04.607519 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:04.607571 (+ 52us) server_negotiation.cc:299] Negotiation successful
0809 15:31:04.607603 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 15:31:04.610558 16797 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42942:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:31:04.613622 16797 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:31:04.625954 17280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:04.622669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:36859 (local address 127.0.0.1:53056)
0809 15:31:04.623495 (+ 826us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:04.623548 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:04.623656 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:04.624384 (+ 728us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:04.624390 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:04.624462 (+ 72us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:04.625057 (+ 595us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:31:04.625060 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:04.625081 (+ 21us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:31:04.625150 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:04.625565 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:04.625574 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:04.625581 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 15:31:04.625706 (+ 125us) client_negotiation.cc:240] Negotiation successful
0809 15:31:04.625778 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":764,"thread_start_us":112,"threads_started":1}
I20260809 15:31:04.626259 17278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:04.622808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58774 (local address 127.11.146.2:39495)
0809 15:31:04.623235 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:04.623248 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:04.623761 (+ 513us) server_negotiation.cc:407] Connection header received
0809 15:31:04.623977 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:04.623984 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:04.624227 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:04.624348 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:04.625422 (+ 1074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:04.625427 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:04.625436 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:31:04.625447 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:04.625506 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:31:04.625540 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:04.625633 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:04.625934 (+ 301us) server_negotiation.cc:299] Negotiation successful
0809 15:31:04.626087 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":107,"threads_started":1}
I20260809 15:31:04.626575 17277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:04.622390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:39495 (local address 127.0.0.1:58774)
0809 15:31:04.623493 (+ 1103us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:04.623651 (+ 158us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:04.623830 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:04.624788 (+ 958us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:04.624791 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:04.624805 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:04.625236 (+ 431us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:31:04.625243 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:04.625258 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:31:04.625292 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:04.625800 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:04.625802 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:04.625805 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 15:31:04.626418 (+ 613us) client_negotiation.cc:240] Negotiation successful
0809 15:31:04.626459 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":927,"thread_start_us":119,"threads_started":1}
I20260809 15:31:04.626755 17281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:04.623457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39426 (local address 127.11.146.1:44621)
0809 15:31:04.623891 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:04.623905 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:04.624094 (+ 189us) server_negotiation.cc:407] Connection header received
0809 15:31:04.624156 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:04.624160 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:04.624298 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:04.624411 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:04.625924 (+ 1513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:04.625930 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:04.625941 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:31:04.625953 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:04.625998 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:31:04.626031 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:04.626135 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:04.626523 (+ 388us) server_negotiation.cc:299] Negotiation successful
0809 15:31:04.626599 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":130,"threads_started":1}
I20260809 15:31:04.626410 17276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:04.623205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:44621 (local address 127.0.0.1:39426)
0809 15:31:04.623953 (+ 748us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:04.623967 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:04.624055 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:04.625087 (+ 1032us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:04.625089 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:04.625102 (+ 13us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:04.625737 (+ 635us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:31:04.625739 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:04.625750 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:31:04.625776 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:04.626175 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:04.626178 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:04.626181 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 15:31:04.626253 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 15:31:04.626287 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":680,"thread_start_us":89,"threads_started":1}
I20260809 15:31:04.626989 17279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:04.622930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53056 (local address 127.11.146.3:36859)
0809 15:31:04.623896 (+ 966us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:04.623914 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:04.623936 (+ 22us) server_negotiation.cc:407] Connection header received
0809 15:31:04.624000 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:04.624004 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:04.624222 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:04.624365 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:04.625318 (+ 953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:04.625324 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:04.625334 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:31:04.625369 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:04.625422 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:31:04.625455 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:04.625574 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:04.625744 (+ 170us) server_negotiation.cc:299] Negotiation successful
0809 15:31:04.625825 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":880,"thread_start_us":147,"threads_started":1}
I20260809 15:31:04.629629 17197 tablet_service.cc:1467] Processing CreateTablet for tablet 70c3e590ee8840ae98c24a2d0e982660 (DEFAULT_TABLE table=test-table [id=49f80e66a02642db9dbb5281de806298]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:31:04.629628 16925 tablet_service.cc:1467] Processing CreateTablet for tablet 70c3e590ee8840ae98c24a2d0e982660 (DEFAULT_TABLE table=test-table [id=49f80e66a02642db9dbb5281de806298]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:31:04.629628 17058 tablet_service.cc:1467] Processing CreateTablet for tablet 70c3e590ee8840ae98c24a2d0e982660 (DEFAULT_TABLE table=test-table [id=49f80e66a02642db9dbb5281de806298]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:31:04.630702 17197 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70c3e590ee8840ae98c24a2d0e982660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:04.630728 17058 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70c3e590ee8840ae98c24a2d0e982660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:04.630728 16925 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70c3e590ee8840ae98c24a2d0e982660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:04.637415 17282 tablet_bootstrap.cc:492] T 70c3e590ee8840ae98c24a2d0e982660 P 72024ce1559c4cdcbdd5579d60a41bb1: Bootstrap starting.
I20260809 15:31:04.638459 17284 tablet_bootstrap.cc:492] T 70c3e590ee8840ae98c24a2d0e982660 P d1fcf3ebe1ba4889a6dba41e948ecdc8: Bootstrap starting.
I20260809 15:31:04.638897 17285 tablet_bootstrap.cc:492] T 70c3e590ee8840ae98c24a2d0e982660 P 050d2997cded41e3a53997b6aaf366d4: Bootstrap starting.
I20260809 15:31:04.640352 17282 tablet_bootstrap.cc:654] T 70c3e590ee8840ae98c24a2d0e982660 P 72024ce1559c4cdcbdd5579d60a41bb1: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:04.640816 17285 tablet_bootstrap.cc:654] T 70c3e590ee8840ae98c24a2d0e982660 P 050d2997cded41e3a53997b6aaf366d4: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:04.641163 17282 log.cc:824] T 70c3e590ee8840ae98c24a2d0e982660 P 72024ce1559c4cdcbdd5579d60a41bb1: Log is configured to *not* fsync() on all Append() calls
I20260809 15:31:04.641670 17285 log.cc:824] T 70c3e590ee8840ae98c24a2d0e982660 P 050d2997cded41e3a53997b6aaf366d4: Log is configured to *not* fsync() on all Append() calls
I20260809 15:31:04.642206 17284 tablet_bootstrap.cc:654] T 70c3e590ee8840ae98c24a2d0e982660 P d1fcf3ebe1ba4889a6dba41e948ecdc8: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:04.643009 17284 log.cc:824] T 70c3e590ee8840ae98c24a2d0e982660 P d1fcf3ebe1ba4889a6dba41e948ecdc8: Log is configured to *not* fsync() on all Append() calls
I20260809 15:31:04.643123 17282 tablet_bootstrap.cc:492] T 70c3e590ee8840ae98c24a2d0e982660 P 72024ce1559c4cdcbdd5579d60a41bb1: No bootstrap required, opened a new log
I20260809 15:31:04.643334 17282 ts_tablet_manager.cc:1397] T 70c3e590ee8840ae98c24a2d0e982660 P 72024ce1559c4cdcbdd5579d60a41bb1: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 15:31:04.643676 17285 tablet_bootstrap.cc:492] T 70c3e590ee8840ae98c24a2d0e982660 P 050d2997cded41e3a53997b6aaf366d4: No bootstrap required, opened a new log
I20260809 15:31:04.643939 17285 ts_tablet_manager.cc:1397] T 70c3e590ee8840ae98c24a2d0e982660 P 050d2997cded41e3a53997b6aaf366d4: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260809 15:31:04.644984 17284 tablet_bootstrap.cc:492] T 70c3e590ee8840ae98c24a2d0e982660 P d1fcf3ebe1ba4889a6dba41e948ecdc8: No bootstrap required, opened a new log
I20260809 15:31:04.645205 17284 ts_tablet_manager.cc:1397] T 70c3e590ee8840ae98c24a2d0e982660 P d1fcf3ebe1ba4889a6dba41e948ecdc8: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260809 15:31:04.647398 17282 raft_consensus.cc:348] T 70c3e590ee8840ae98c24a2d0e982660 P 72024ce1559c4cdcbdd5579d60a41bb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1fcf3ebe1ba4889a6dba41e948ecdc8" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39495 } } peers { permanent_uuid: "72024ce1559c4cdcbdd5579d60a41bb1" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 36859 } } peers { permanent_uuid: "050d2997cded41e3a53997b6aaf366d4" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44621 } }
I20260809 15:31:04.647644 17282 raft_consensus.cc:374] T 70c3e590ee8840ae98c24a2d0e982660 P 72024ce1559c4cdcbdd5579d60a41bb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:04.647716 17282 raft_consensus.cc:729] T 70c3e590ee8840ae98c24a2d0e982660 P 72024ce1559c4cdcbdd5579d60a41bb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72024ce1559c4cdcbdd5579d60a41bb1, State: Initialized, Role: FOLLOWER
I20260809 15:31:04.648244 17282 consensus_queue.cc:260] T 70c3e590ee8840ae98c24a2d0e982660 P 72024ce1559c4cdcbdd5579d60a41bb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1fcf3ebe1ba4889a6dba41e948ecdc8" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39495 } } peers { permanent_uuid: "72024ce1559c4cdcbdd5579d60a41bb1" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 36859 } } peers { permanent_uuid: "050d2997cded41e3a53997b6aaf366d4" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44621 } }
I20260809 15:31:04.648648 17285 raft_consensus.cc:348] T 70c3e590ee8840ae98c24a2d0e982660 P 050d2997cded41e3a53997b6aaf366d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1fcf3ebe1ba4889a6dba41e948ecdc8" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39495 } } peers { permanent_uuid: "72024ce1559c4cdcbdd5579d60a41bb1" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 36859 } } peers { permanent_uuid: "050d2997cded41e3a53997b6aaf366d4" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44621 } }
I20260809 15:31:04.648883 17265 heartbeater.cc:503] Master 127.11.146.62:36901 was elected leader, sending a full tablet report...
I20260809 15:31:04.648988 17285 raft_consensus.cc:374] T 70c3e590ee8840ae98c24a2d0e982660 P 050d2997cded41e3a53997b6aaf366d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:04.649113 17285 raft_consensus.cc:729] T 70c3e590ee8840ae98c24a2d0e982660 P 050d2997cded41e3a53997b6aaf366d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 050d2997cded41e3a53997b6aaf366d4, State: Initialized, Role: FOLLOWER
I20260809 15:31:04.649247 17282 ts_tablet_manager.cc:1428] T 70c3e590ee8840ae98c24a2d0e982660 P 72024ce1559c4cdcbdd5579d60a41bb1: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 15:31:04.649624 17285 consensus_queue.cc:260] T 70c3e590ee8840ae98c24a2d0e982660 P 050d2997cded41e3a53997b6aaf366d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1fcf3ebe1ba4889a6dba41e948ecdc8" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39495 } } peers { permanent_uuid: "72024ce1559c4cdcbdd5579d60a41bb1" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 36859 } } peers { permanent_uuid: "050d2997cded41e3a53997b6aaf366d4" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44621 } }
I20260809 15:31:04.649745 17284 raft_consensus.cc:348] T 70c3e590ee8840ae98c24a2d0e982660 P d1fcf3ebe1ba4889a6dba41e948ecdc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1fcf3ebe1ba4889a6dba41e948ecdc8" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39495 } } peers { permanent_uuid: "72024ce1559c4cdcbdd5579d60a41bb1" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 36859 } } peers { permanent_uuid: "050d2997cded41e3a53997b6aaf366d4" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44621 } }
I20260809 15:31:04.650013 17284 raft_consensus.cc:374] T 70c3e590ee8840ae98c24a2d0e982660 P d1fcf3ebe1ba4889a6dba41e948ecdc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:04.650107 17284 raft_consensus.cc:729] T 70c3e590ee8840ae98c24a2d0e982660 P d1fcf3ebe1ba4889a6dba41e948ecdc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1fcf3ebe1ba4889a6dba41e948ecdc8, State: Initialized, Role: FOLLOWER
I20260809 15:31:04.650578 17284 consensus_queue.cc:260] T 70c3e590ee8840ae98c24a2d0e982660 P d1fcf3ebe1ba4889a6dba41e948ecdc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1fcf3ebe1ba4889a6dba41e948ecdc8" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39495 } } peers { permanent_uuid: "72024ce1559c4cdcbdd5579d60a41bb1" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 36859 } } peers { permanent_uuid: "050d2997cded41e3a53997b6aaf366d4" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44621 } }
I20260809 15:31:04.650787 17285 ts_tablet_manager.cc:1428] T 70c3e590ee8840ae98c24a2d0e982660 P 050d2997cded41e3a53997b6aaf366d4: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260809 15:31:04.651161 16992 heartbeater.cc:503] Master 127.11.146.62:36901 was elected leader, sending a full tablet report...
I20260809 15:31:04.652060 17292 raft_consensus.cc:482] T 70c3e590ee8840ae98c24a2d0e982660 P d1fcf3ebe1ba4889a6dba41e948ecdc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:31:04.652299 17292 raft_consensus.cc:504] T 70c3e590ee8840ae98c24a2d0e982660 P d1fcf3ebe1ba4889a6dba41e948ecdc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1fcf3ebe1ba4889a6dba41e948ecdc8" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39495 } } peers { permanent_uuid: "72024ce1559c4cdcbdd5579d60a41bb1" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 36859 } } peers { permanent_uuid: "050d2997cded41e3a53997b6aaf366d4" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44621 } }
I20260809 15:31:04.652753 17284 ts_tablet_manager.cc:1428] T 70c3e590ee8840ae98c24a2d0e982660 P d1fcf3ebe1ba4889a6dba41e948ecdc8: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260809 15:31:04.652140 17129 heartbeater.cc:503] Master 127.11.146.62:36901 was elected leader, sending a full tablet report...
I20260809 15:31:04.654666 17292 leader_election.cc:288] T 70c3e590ee8840ae98c24a2d0e982660 P d1fcf3ebe1ba4889a6dba41e948ecdc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72024ce1559c4cdcbdd5579d60a41bb1 (127.11.146.3:36859), 050d2997cded41e3a53997b6aaf366d4 (127.11.146.1:44621)
I20260809 15:31:04.655684 17131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:04.653666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:36859 (local address 127.11.146.2:47945)
0809 15:31:04.653862 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:04.653881 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:04.653986 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:04.654588 (+ 602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:04.654591 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:04.654608 (+ 17us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:04.655127 (+ 519us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:31:04.655131 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:04.655146 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:31:04.655179 (+ 33us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:04.655429 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:04.655432 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:04.655436 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 15:31:04.655527 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 15:31:04.655563 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114}
I20260809 15:31:04.655695 17279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:04.653862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:47945 (local address 127.11.146.3:36859)
0809 15:31:04.654160 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:04.654166 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:04.654181 (+ 15us) server_negotiation.cc:407] Connection header received
0809 15:31:04.654221 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:04.654225 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:04.654260 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:04.654337 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:04.655299 (+ 962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:04.655304 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:04.655307 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:31:04.655319 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:04.655338 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:31:04.655349 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:04.655436 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:04.655523 (+ 87us) server_negotiation.cc:299] Negotiation successful
0809 15:31:04.655575 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217}
I20260809 15:31:04.656292 17217 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70c3e590ee8840ae98c24a2d0e982660" candidate_uuid: "d1fcf3ebe1ba4889a6dba41e948ecdc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72024ce1559c4cdcbdd5579d60a41bb1" is_pre_election: true
I20260809 15:31:04.656599 17217 raft_consensus.cc:2454] T 70c3e590ee8840ae98c24a2d0e982660 P 72024ce1559c4cdcbdd5579d60a41bb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1fcf3ebe1ba4889a6dba41e948ecdc8 in term 0.
I20260809 15:31:04.656798 17293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:04.654121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:44621 (local address 127.11.146.2:55773)
0809 15:31:04.654936 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:04.654947 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:04.655104 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:04.655624 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:04.655627 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:04.655642 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:04.656142 (+ 500us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:31:04.656144 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:04.656155 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:31:04.656181 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:04.656520 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:04.656523 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:04.656527 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 15:31:04.656623 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 15:31:04.656663 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":750,"thread_start_us":92,"threads_started":1}
I20260809 15:31:04.656814 17281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:04.654508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:55773 (local address 127.11.146.1:44621)
0809 15:31:04.654631 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:04.654637 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:04.655045 (+ 408us) server_negotiation.cc:407] Connection header received
0809 15:31:04.655214 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:04.655220 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:04.655260 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:04.655310 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:04.656286 (+ 976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:04.656290 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:04.656292 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:31:04.656306 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:04.656328 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:31:04.656338 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:04.656444 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:04.656642 (+ 198us) server_negotiation.cc:299] Negotiation successful
0809 15:31:04.656682 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 15:31:04.657243 17013 leader_election.cc:302] T 70c3e590ee8840ae98c24a2d0e982660 P d1fcf3ebe1ba4889a6dba41e948ecdc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72024ce1559c4cdcbdd5579d60a41bb1, d1fcf3ebe1ba4889a6dba41e948ecdc8; no voters:
I20260809 15:31:04.657502 16945 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70c3e590ee8840ae98c24a2d0e982660" candidate_uuid: "d1fcf3ebe1ba4889a6dba41e948ecdc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050d2997cded41e3a53997b6aaf366d4" is_pre_election: true
I20260809 15:31:04.657541 17291 raft_consensus.cc:2781] T 70c3e590ee8840ae98c24a2d0e982660 P d1fcf3ebe1ba4889a6dba41e948ecdc8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:31:04.657624 17291 raft_consensus.cc:482] T 70c3e590ee8840ae98c24a2d0e982660 P d1fcf3ebe1ba4889a6dba41e948ecdc8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:31:04.657670 17291 raft_consensus.cc:3037] T 70c3e590ee8840ae98c24a2d0e982660 P d1fcf3ebe1ba4889a6dba41e948ecdc8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:04.657757 16945 raft_consensus.cc:2454] T 70c3e590ee8840ae98c24a2d0e982660 P 050d2997cded41e3a53997b6aaf366d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1fcf3ebe1ba4889a6dba41e948ecdc8 in term 0.
I20260809 15:31:04.658684 17291 raft_consensus.cc:504] T 70c3e590ee8840ae98c24a2d0e982660 P d1fcf3ebe1ba4889a6dba41e948ecdc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1fcf3ebe1ba4889a6dba41e948ecdc8" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39495 } } peers { permanent_uuid: "72024ce1559c4cdcbdd5579d60a41bb1" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 36859 } } peers { permanent_uuid: "050d2997cded41e3a53997b6aaf366d4" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44621 } }
I20260809 15:31:04.658952 17291 leader_election.cc:288] T 70c3e590ee8840ae98c24a2d0e982660 P d1fcf3ebe1ba4889a6dba41e948ecdc8 [CANDIDATE]: Term 1 election: Requested vote from peers 72024ce1559c4cdcbdd5579d60a41bb1 (127.11.146.3:36859), 050d2997cded41e3a53997b6aaf366d4 (127.11.146.1:44621)
I20260809 15:31:04.659289 17217 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70c3e590ee8840ae98c24a2d0e982660" candidate_uuid: "d1fcf3ebe1ba4889a6dba41e948ecdc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72024ce1559c4cdcbdd5579d60a41bb1"
I20260809 15:31:04.659405 17217 raft_consensus.cc:3037] T 70c3e590ee8840ae98c24a2d0e982660 P 72024ce1559c4cdcbdd5579d60a41bb1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:04.659410 16945 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70c3e590ee8840ae98c24a2d0e982660" candidate_uuid: "d1fcf3ebe1ba4889a6dba41e948ecdc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "050d2997cded41e3a53997b6aaf366d4"
I20260809 15:31:04.659538 16945 raft_consensus.cc:3037] T 70c3e590ee8840ae98c24a2d0e982660 P 050d2997cded41e3a53997b6aaf366d4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:04.660694 16945 raft_consensus.cc:2454] T 70c3e590ee8840ae98c24a2d0e982660 P 050d2997cded41e3a53997b6aaf366d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1fcf3ebe1ba4889a6dba41e948ecdc8 in term 1.
I20260809 15:31:04.660737 17217 raft_consensus.cc:2454] T 70c3e590ee8840ae98c24a2d0e982660 P 72024ce1559c4cdcbdd5579d60a41bb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1fcf3ebe1ba4889a6dba41e948ecdc8 in term 1.
I20260809 15:31:04.660964 17013 leader_election.cc:302] T 70c3e590ee8840ae98c24a2d0e982660 P d1fcf3ebe1ba4889a6dba41e948ecdc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 050d2997cded41e3a53997b6aaf366d4, d1fcf3ebe1ba4889a6dba41e948ecdc8; no voters:
I20260809 15:31:04.661128 17291 raft_consensus.cc:2781] T 70c3e590ee8840ae98c24a2d0e982660 P d1fcf3ebe1ba4889a6dba41e948ecdc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:31:04.661212 17291 raft_consensus.cc:686] T 70c3e590ee8840ae98c24a2d0e982660 P d1fcf3ebe1ba4889a6dba41e948ecdc8 [term 1 LEADER]: Becoming Leader. State: Replica: d1fcf3ebe1ba4889a6dba41e948ecdc8, State: Running, Role: LEADER
I20260809 15:31:04.661536 17291 consensus_queue.cc:237] T 70c3e590ee8840ae98c24a2d0e982660 P d1fcf3ebe1ba4889a6dba41e948ecdc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1fcf3ebe1ba4889a6dba41e948ecdc8" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39495 } } peers { permanent_uuid: "72024ce1559c4cdcbdd5579d60a41bb1" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 36859 } } peers { permanent_uuid: "050d2997cded41e3a53997b6aaf366d4" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44621 } }
I20260809 15:31:04.664539 16797 catalog_manager.cc:5495] T 70c3e590ee8840ae98c24a2d0e982660 P d1fcf3ebe1ba4889a6dba41e948ecdc8 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1fcf3ebe1ba4889a6dba41e948ecdc8 (127.11.146.2). New cstate: current_term: 1 leader_uuid: "d1fcf3ebe1ba4889a6dba41e948ecdc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1fcf3ebe1ba4889a6dba41e948ecdc8" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72024ce1559c4cdcbdd5579d60a41bb1" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 36859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "050d2997cded41e3a53997b6aaf366d4" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44621 } health_report { overall_health: UNKNOWN } } }
I20260809 15:31:04.676550 17278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:04.674752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58784 (local address 127.11.146.2:39495)
0809 15:31:04.674874 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:04.674880 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:04.674894 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:31:04.675073 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:04.675078 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:04.675135 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:04.675226 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:04.676146 (+ 920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:04.676152 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:04.676159 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:31:04.676170 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:04.676188 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:31:04.676195 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:04.676289 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:04.676369 (+ 80us) server_negotiation.cc:299] Negotiation successful
0809 15:31:04.676409 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 15:31:04.682363 16945 raft_consensus.cc:1261] T 70c3e590ee8840ae98c24a2d0e982660 P 050d2997cded41e3a53997b6aaf366d4 [term 1 FOLLOWER]: Refusing update from remote peer d1fcf3ebe1ba4889a6dba41e948ecdc8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:31:04.682370 17217 raft_consensus.cc:1261] T 70c3e590ee8840ae98c24a2d0e982660 P 72024ce1559c4cdcbdd5579d60a41bb1 [term 1 FOLLOWER]: Refusing update from remote peer d1fcf3ebe1ba4889a6dba41e948ecdc8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:31:04.683072 17292 consensus_queue.cc:1035] T 70c3e590ee8840ae98c24a2d0e982660 P d1fcf3ebe1ba4889a6dba41e948ecdc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "050d2997cded41e3a53997b6aaf366d4" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:31:04.683275 17291 consensus_queue.cc:1035] T 70c3e590ee8840ae98c24a2d0e982660 P d1fcf3ebe1ba4889a6dba41e948ecdc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72024ce1559c4cdcbdd5579d60a41bb1" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 36859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:31:04.692237 17297 mvcc.cc:205] Tried to move back new op lower bound from 7316641647331565568 to 7316641647256174592. Current Snapshot: MvccSnapshot[applied={T|T < 7316641647331565568}]
I20260809 15:31:04.700809 16796 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42942:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:31:04.701025 16796 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42942:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:31:04.703536 16796 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f26e9ffa88724a2ba7356933db5f2b04: Sending DeleteTablet for 3 replicas of tablet 70c3e590ee8840ae98c24a2d0e982660
I20260809 15:31:04.704365 17058 tablet_service.cc:1514] Processing DeleteTablet for tablet 70c3e590ee8840ae98c24a2d0e982660 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:31:04 UTC) from {username='slave'} at 127.0.0.1:58774
I20260809 15:31:04.704485 17197 tablet_service.cc:1514] Processing DeleteTablet for tablet 70c3e590ee8840ae98c24a2d0e982660 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:31:04 UTC) from {username='slave'} at 127.0.0.1:53056
I20260809 15:31:04.704896 17306 tablet_replica.cc:330] T 70c3e590ee8840ae98c24a2d0e982660 P d1fcf3ebe1ba4889a6dba41e948ecdc8: stopping tablet replica
I20260809 15:31:04.705269 17306 raft_consensus.cc:2229] T 70c3e590ee8840ae98c24a2d0e982660 P d1fcf3ebe1ba4889a6dba41e948ecdc8 [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:31:04.705430 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 16859
I20260809 15:31:04.705363 16925 tablet_service.cc:1514] Processing DeleteTablet for tablet 70c3e590ee8840ae98c24a2d0e982660 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:31:04 UTC) from {username='slave'} at 127.0.0.1:39426
I20260809 15:31:04.706311 17307 tablet_replica.cc:330] T 70c3e590ee8840ae98c24a2d0e982660 P 72024ce1559c4cdcbdd5579d60a41bb1: stopping tablet replica
I20260809 15:31:04.706689 17307 raft_consensus.cc:2229] T 70c3e590ee8840ae98c24a2d0e982660 P 72024ce1559c4cdcbdd5579d60a41bb1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:31:04.707062 17307 raft_consensus.cc:2258] T 70c3e590ee8840ae98c24a2d0e982660 P 72024ce1559c4cdcbdd5579d60a41bb1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:31:04.709424 17307 ts_tablet_manager.cc:1905] T 70c3e590ee8840ae98c24a2d0e982660 P 72024ce1559c4cdcbdd5579d60a41bb1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:31:04.711730 17307 ts_tablet_manager.cc:1918] T 70c3e590ee8840ae98c24a2d0e982660 P 72024ce1559c4cdcbdd5579d60a41bb1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:31:04.711884 17307 log.cc:1196] T 70c3e590ee8840ae98c24a2d0e982660 P 72024ce1559c4cdcbdd5579d60a41bb1: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-2/wal/wals/70c3e590ee8840ae98c24a2d0e982660
I20260809 15:31:04.712034 17306 raft_consensus.cc:2258] T 70c3e590ee8840ae98c24a2d0e982660 P d1fcf3ebe1ba4889a6dba41e948ecdc8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:31:04.712340 17307 ts_tablet_manager.cc:1939] T 70c3e590ee8840ae98c24a2d0e982660 P 72024ce1559c4cdcbdd5579d60a41bb1: Deleting consensus metadata
I20260809 15:31:04.713667 16783 catalog_manager.cc:4841] TS 72024ce1559c4cdcbdd5579d60a41bb1 (127.11.146.3:36859): tablet 70c3e590ee8840ae98c24a2d0e982660 (table test-table [id=49f80e66a02642db9dbb5281de806298]) successfully deleted
I20260809 15:31:04.714578 17306 ts_tablet_manager.cc:1905] T 70c3e590ee8840ae98c24a2d0e982660 P d1fcf3ebe1ba4889a6dba41e948ecdc8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:31:04.717116 17306 ts_tablet_manager.cc:1918] T 70c3e590ee8840ae98c24a2d0e982660 P d1fcf3ebe1ba4889a6dba41e948ecdc8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:31:04.717254 17306 log.cc:1196] T 70c3e590ee8840ae98c24a2d0e982660 P d1fcf3ebe1ba4889a6dba41e948ecdc8: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786289437399694-11848-0/minicluster-data/ts-1/wal/wals/70c3e590ee8840ae98c24a2d0e982660
W20260809 15:31:04.717414 16783 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.146.1:44621 (error 108)
I20260809 15:31:04.717620 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 16995
I20260809 15:31:04.717640 17306 ts_tablet_manager.cc:1939] T 70c3e590ee8840ae98c24a2d0e982660 P d1fcf3ebe1ba4889a6dba41e948ecdc8: Deleting consensus metadata
I20260809 15:31:04.719481 17280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:04.719195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:44621 (local address 127.0.0.1:39440)
0809 15:31:04.719336 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:04.719407 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.1:44621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260809 15:31:04.719687 16783 catalog_manager.cc:4584] TS 050d2997cded41e3a53997b6aaf366d4 (127.11.146.1:44621): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 70c3e590ee8840ae98c24a2d0e982660: Network error: Client connection negotiation failed: client connection to 127.11.146.1:44621: connect: Connection refused (error 111)
I20260809 15:31:04.728524 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 17133
I20260809 15:31:04.731482 17280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:04.728712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:39495 (local address 127.0.0.1:58792)
0809 15:31:04.731318 (+ 2606us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:04.731386 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.2:39495: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2494}
I20260809 15:31:04.736783 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 16764
2026-08-09T15:31:04Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (973 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260809 15:31:04.760479 11848 mini_oidc.cc:152] Starting JWKS server
I20260809 15:31:04.762174 11848 webserver.cc:460] Webserver started at https://127.0.0.1:34763/ using document root <none> and password file <none>
I20260809 15:31:04.762349 11848 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 15:31:04.762643 11848 webserver.cc:460] Webserver started at http://127.0.0.1:35247/ using document root <none> and password file <none>
2026-08-09T15:31:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:31:04Z Disabled control of system clock
I20260809 15:31:04.773108 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:44799
--webserver_interface=127.11.146.62
--webserver_port=0
--builtin_ntp_servers=127.11.146.20:32945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:44799
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34763/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786289437399694-11848-0/testchainca.cert with env {}
W20260809 15:31:04.885432 17315 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:04.885756 17315 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:04.885840 17315 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:04.889969 17315 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:31:04.890054 17315 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:04.890084 17315 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:04.890139 17315 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:31:04.890179 17315 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 15:31:04.890218 17315 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 15:31:04.890251 17315 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34763/jwks.json
I20260809 15:31:04.895545 17315 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:32945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:44799
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:44799
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34763/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786289437399694-11848-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17315
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:04.896821 17315 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:04.897873 17315 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:04.907251 17322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:04.907291 17321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:04.907291 17324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:04.907707 17315 server_base.cc:1034] running on GCE node
I20260809 15:31:04.908335 17315 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:04.909438 17315 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:04.910758 17315 hybrid_clock.cc:648] HybridClock initialized: now 1786289464910724 us; error 43 us; skew 500 ppm
I20260809 15:31:04.912812 17315 webserver.cc:460] Webserver started at http://127.11.146.62:33473/ using document root <none> and password file <none>
I20260809 15:31:04.913398 17315 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:04.913465 17315 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:04.913674 17315 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:04.915901 17315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "a013229dec374e6191b12bb1e7a082e9"
format_stamp: "Formatted at 2026-08-09 15:31:04 on dist-test-slave-1jjb"
server_key: "9cccddd6e47acf1d972f182919888a41"
server_key_iv: "160dc5df8ec0daaf35fda9c78193d9c7"
server_key_version: "encryptionkey@0"
I20260809 15:31:04.916653 17315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "a013229dec374e6191b12bb1e7a082e9"
format_stamp: "Formatted at 2026-08-09 15:31:04 on dist-test-slave-1jjb"
server_key: "9cccddd6e47acf1d972f182919888a41"
server_key_iv: "160dc5df8ec0daaf35fda9c78193d9c7"
server_key_version: "encryptionkey@0"
I20260809 15:31:04.920653 17315 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 15:31:04.923173 17330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:04.924631 17315 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:31:04.924783 17315 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "a013229dec374e6191b12bb1e7a082e9"
format_stamp: "Formatted at 2026-08-09 15:31:04 on dist-test-slave-1jjb"
server_key: "9cccddd6e47acf1d972f182919888a41"
server_key_iv: "160dc5df8ec0daaf35fda9c78193d9c7"
server_key_version: "encryptionkey@0"
I20260809 15:31:04.924904 17315 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:04.955773 17315 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:04.956640 17315 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:04.956849 17315 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:04.964238 17315 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:44799
I20260809 15:31:04.964290 17383 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:44799 every 8 connection(s)
I20260809 15:31:04.965230 17315 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:31:04.968618 17384 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:04.969190 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 17315
I20260809 15:31:04.969338 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:31:04.969619 11848 external_mini_cluster.cc:1428] Setting key b6e6f7fcce50e537bd05320333a2a06b
I20260809 15:31:04.975728 17384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a013229dec374e6191b12bb1e7a082e9: Bootstrap starting.
I20260809 15:31:04.978410 17384 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a013229dec374e6191b12bb1e7a082e9: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:04.979317 17384 log.cc:824] T 00000000000000000000000000000000 P a013229dec374e6191b12bb1e7a082e9: Log is configured to *not* fsync() on all Append() calls
I20260809 15:31:04.980568 17387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:04.971053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33500 (local address 127.11.146.62:44799)
0809 15:31:04.971924 (+ 871us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:04.971947 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:04.971994 (+ 47us) server_negotiation.cc:407] Connection header received
0809 15:31:04.972905 (+ 911us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:04.972930 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:04.973412 (+ 482us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:04.973790 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:04.974215 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:04.975676 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:04.976666 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:04.977356 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:04.977523 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:04.978469 (+ 946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:04.978476 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:04.978492 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:31:04.978991 (+ 499us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:04.979059 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:31:04.979090 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:04.979193 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:04.979363 (+ 170us) server_negotiation.cc:299] Negotiation successful
0809 15:31:04.979643 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":101,"threads_started":1}
I20260809 15:31:04.981562 17384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a013229dec374e6191b12bb1e7a082e9: No bootstrap required, opened a new log
I20260809 15:31:04.983449 11848 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:31:04.985805 17384 raft_consensus.cc:348] T 00000000000000000000000000000000 P a013229dec374e6191b12bb1e7a082e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a013229dec374e6191b12bb1e7a082e9" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44799 } }
I20260809 15:31:04.986025 17384 raft_consensus.cc:374] T 00000000000000000000000000000000 P a013229dec374e6191b12bb1e7a082e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:04.986102 17384 raft_consensus.cc:729] T 00000000000000000000000000000000 P a013229dec374e6191b12bb1e7a082e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a013229dec374e6191b12bb1e7a082e9, State: Initialized, Role: FOLLOWER
I20260809 15:31:04.986502 17384 consensus_queue.cc:260] T 00000000000000000000000000000000 P a013229dec374e6191b12bb1e7a082e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a013229dec374e6191b12bb1e7a082e9" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44799 } }
I20260809 15:31:04.986647 17384 raft_consensus.cc:388] T 00000000000000000000000000000000 P a013229dec374e6191b12bb1e7a082e9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:31:04.986714 17384 raft_consensus.cc:482] T 00000000000000000000000000000000 P a013229dec374e6191b12bb1e7a082e9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:31:04.986837 17384 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a013229dec374e6191b12bb1e7a082e9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:04.987736 17384 raft_consensus.cc:504] T 00000000000000000000000000000000 P a013229dec374e6191b12bb1e7a082e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a013229dec374e6191b12bb1e7a082e9" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44799 } }
I20260809 15:31:04.988130 17384 leader_election.cc:302] T 00000000000000000000000000000000 P a013229dec374e6191b12bb1e7a082e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a013229dec374e6191b12bb1e7a082e9; no voters:
I20260809 15:31:04.988454 17384 leader_election.cc:288] T 00000000000000000000000000000000 P a013229dec374e6191b12bb1e7a082e9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:31:04.988621 17389 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a013229dec374e6191b12bb1e7a082e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:31:04.988912 17389 raft_consensus.cc:686] T 00000000000000000000000000000000 P a013229dec374e6191b12bb1e7a082e9 [term 1 LEADER]: Becoming Leader. State: Replica: a013229dec374e6191b12bb1e7a082e9, State: Running, Role: LEADER
I20260809 15:31:04.989270 17389 consensus_queue.cc:237] T 00000000000000000000000000000000 P a013229dec374e6191b12bb1e7a082e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a013229dec374e6191b12bb1e7a082e9" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44799 } }
I20260809 15:31:04.989894 17384 sys_catalog.cc:564] T 00000000000000000000000000000000 P a013229dec374e6191b12bb1e7a082e9 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:31:04.991098 17391 sys_catalog.cc:455] T 00000000000000000000000000000000 P a013229dec374e6191b12bb1e7a082e9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a013229dec374e6191b12bb1e7a082e9. Latest consensus state: current_term: 1 leader_uuid: "a013229dec374e6191b12bb1e7a082e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a013229dec374e6191b12bb1e7a082e9" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44799 } } }
I20260809 15:31:04.991104 17390 sys_catalog.cc:455] T 00000000000000000000000000000000 P a013229dec374e6191b12bb1e7a082e9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a013229dec374e6191b12bb1e7a082e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a013229dec374e6191b12bb1e7a082e9" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44799 } } }
I20260809 15:31:04.991240 17391 sys_catalog.cc:458] T 00000000000000000000000000000000 P a013229dec374e6191b12bb1e7a082e9 [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:04.991246 17390 sys_catalog.cc:458] T 00000000000000000000000000000000 P a013229dec374e6191b12bb1e7a082e9 [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:04.991707 17398 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:31:04.994889 17398 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:31:05.000562 17398 catalog_manager.cc:1347] Generated new cluster ID: 99996207b25447188365b6da8b9752c3
I20260809 15:31:05.000629 17398 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:31:05.008852 17398 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:31:05.009794 17398 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:31:05.017009 17398 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a013229dec374e6191b12bb1e7a082e9: Generated new TSK 0
I20260809 15:31:05.017745 17398 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 15:31:05.051147 17415 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260809 15:31:05.051276 17415 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 15:31:05.051972 17387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:05.034119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33512 (local address 127.11.146.62:44799)
0809 15:31:05.034264 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:05.034269 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:05.034438 (+ 169us) server_negotiation.cc:407] Connection header received
0809 15:31:05.034646 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:05.034649 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:05.034709 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:05.034821 (+ 112us) server_negotiation.cc:226] Negotiated authn=JWT
0809 15:31:05.035046 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:05.036043 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:05.036932 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:05.037298 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:05.037396 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:05.037726 (+ 330us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 15:31:05.051551 (+ 13825us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34763/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 15:31:05.051831 (+ 280us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:33512: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34763/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":55}
W20260809 15:31:05.052057 17387 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:33512: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34763/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260809 15:31:05.053350 17414 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:05.034002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:44799 (local address 127.0.0.1:33512)
0809 15:31:05.034357 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:05.034370 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:05.034483 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:05.034835 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:05.034837 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:05.034844 (+ 7us) client_negotiation.cc:189] Negotiated authn=JWT
0809 15:31:05.034938 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:05.034944 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:05.036192 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:05.036195 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:05.036811 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:05.036819 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:05.037418 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:05.037420 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:05.037493 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:05.037536 (+ 43us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 15:31:05.051793 (+ 14257us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34763/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 15:31:05.052015 (+ 222us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.146.62:44799: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34763/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":109,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.11.146.62:44799: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34763/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260809 15:31:05.054181 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 17315
2026-08-09T15:31:05Z chronyd exiting
I20260809 15:31:05.095649 11848 test_util.cc:175] -----------------------------------------------
I20260809 15:31:05.095762 11848 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786289437399694-11848-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (337 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260809 15:31:05.097036 11848 mini_oidc.cc:152] Starting JWKS server
I20260809 15:31:05.097952 11848 webserver.cc:460] Webserver started at https://127.0.0.1:41255/ using document root <none> and password file <none>
I20260809 15:31:05.098085 11848 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 15:31:05.098367 11848 webserver.cc:460] Webserver started at http://127.0.0.1:40291/ using document root <none> and password file <none>
2026-08-09T15:31:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:31:05Z Disabled control of system clock
I20260809 15:31:05.109376 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:33583
--webserver_interface=127.11.146.62
--webserver_port=0
--builtin_ntp_servers=127.11.146.20:44159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:33583
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41255/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786289437399694-11848-0/testchainca.cert with env {}
W20260809 15:31:05.225962 17421 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:05.226226 17421 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:05.226266 17421 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:05.230340 17421 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:31:05.230396 17421 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:05.230412 17421 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:05.230427 17421 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:31:05.230443 17421 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 15:31:05.230497 17421 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 15:31:05.230525 17421 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41255/jwks.json
I20260809 15:31:05.236066 17421 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:44159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:33583
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:33583
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41255/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786289437399694-11848-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17421
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:05.237183 17421 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:05.238226 17421 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:05.246752 17429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:05.246773 17426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:05.246744 17427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:05.247051 17421 server_base.cc:1034] running on GCE node
I20260809 15:31:05.247715 17421 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:05.248871 17421 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:05.250066 17421 hybrid_clock.cc:648] HybridClock initialized: now 1786289465250049 us; error 24 us; skew 500 ppm
I20260809 15:31:05.252059 17421 webserver.cc:460] Webserver started at http://127.11.146.62:46145/ using document root <none> and password file <none>
I20260809 15:31:05.252709 17421 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:05.252801 17421 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:05.253038 17421 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:05.255180 17421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "a4006b7fe7564363ad48bbcff6b09bef"
format_stamp: "Formatted at 2026-08-09 15:31:05 on dist-test-slave-1jjb"
server_key: "01d484ed7952d71d4d56a3bf30f63cad"
server_key_iv: "a3fd1b126b11c32ee385680e194ea556"
server_key_version: "encryptionkey@0"
I20260809 15:31:05.255810 17421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "a4006b7fe7564363ad48bbcff6b09bef"
format_stamp: "Formatted at 2026-08-09 15:31:05 on dist-test-slave-1jjb"
server_key: "01d484ed7952d71d4d56a3bf30f63cad"
server_key_iv: "a3fd1b126b11c32ee385680e194ea556"
server_key_version: "encryptionkey@0"
I20260809 15:31:05.259692 17421 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260809 15:31:05.262230 17435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:05.263427 17421 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:31:05.263572 17421 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "a4006b7fe7564363ad48bbcff6b09bef"
format_stamp: "Formatted at 2026-08-09 15:31:05 on dist-test-slave-1jjb"
server_key: "01d484ed7952d71d4d56a3bf30f63cad"
server_key_iv: "a3fd1b126b11c32ee385680e194ea556"
server_key_version: "encryptionkey@0"
I20260809 15:31:05.263689 17421 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:05.279621 17421 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:05.280293 17421 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:05.280493 17421 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:05.287665 17421 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:33583
I20260809 15:31:05.287722 17489 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:33583 every 8 connection(s)
I20260809 15:31:05.288651 17421 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:31:05.291859 17490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:05.295949 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 17421
I20260809 15:31:05.296134 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:31:05.296406 11848 external_mini_cluster.cc:1428] Setting key 2bfeaec75378fd37677c89951adc1687
I20260809 15:31:05.297901 17490 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a4006b7fe7564363ad48bbcff6b09bef: Bootstrap starting.
I20260809 15:31:05.300415 17490 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a4006b7fe7564363ad48bbcff6b09bef: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:05.301167 17490 log.cc:824] T 00000000000000000000000000000000 P a4006b7fe7564363ad48bbcff6b09bef: Log is configured to *not* fsync() on all Append() calls
I20260809 15:31:05.303053 17490 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a4006b7fe7564363ad48bbcff6b09bef: No bootstrap required, opened a new log
I20260809 15:31:05.305754 17494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:05.297774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38380 (local address 127.11.146.62:33583)
0809 15:31:05.298531 (+ 757us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:05.298548 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:05.298597 (+ 49us) server_negotiation.cc:407] Connection header received
0809 15:31:05.299244 (+ 647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:05.299261 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:05.299664 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:05.299993 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:05.300485 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:05.301565 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:05.302472 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:05.302942 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:05.303139 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:05.304032 (+ 893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:05.304038 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:05.304051 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:31:05.304490 (+ 439us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:05.304547 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:31:05.304569 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:05.304681 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:05.304797 (+ 116us) server_negotiation.cc:299] Negotiation successful
0809 15:31:05.305062 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":135,"threads_started":1}
I20260809 15:31:05.306921 17490 raft_consensus.cc:348] T 00000000000000000000000000000000 P a4006b7fe7564363ad48bbcff6b09bef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4006b7fe7564363ad48bbcff6b09bef" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 33583 } }
I20260809 15:31:05.307165 17490 raft_consensus.cc:374] T 00000000000000000000000000000000 P a4006b7fe7564363ad48bbcff6b09bef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:05.307243 17490 raft_consensus.cc:729] T 00000000000000000000000000000000 P a4006b7fe7564363ad48bbcff6b09bef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4006b7fe7564363ad48bbcff6b09bef, State: Initialized, Role: FOLLOWER
I20260809 15:31:05.307915 17490 consensus_queue.cc:260] T 00000000000000000000000000000000 P a4006b7fe7564363ad48bbcff6b09bef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4006b7fe7564363ad48bbcff6b09bef" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 33583 } }
I20260809 15:31:05.308138 17490 raft_consensus.cc:388] T 00000000000000000000000000000000 P a4006b7fe7564363ad48bbcff6b09bef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:31:05.308221 17490 raft_consensus.cc:482] T 00000000000000000000000000000000 P a4006b7fe7564363ad48bbcff6b09bef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:31:05.308331 17490 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a4006b7fe7564363ad48bbcff6b09bef [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:05.309077 11848 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:31:05.309484 17490 raft_consensus.cc:504] T 00000000000000000000000000000000 P a4006b7fe7564363ad48bbcff6b09bef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4006b7fe7564363ad48bbcff6b09bef" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 33583 } }
I20260809 15:31:05.309828 17490 leader_election.cc:302] T 00000000000000000000000000000000 P a4006b7fe7564363ad48bbcff6b09bef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a4006b7fe7564363ad48bbcff6b09bef; no voters:
I20260809 15:31:05.310189 17490 leader_election.cc:288] T 00000000000000000000000000000000 P a4006b7fe7564363ad48bbcff6b09bef [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:31:05.310381 17496 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a4006b7fe7564363ad48bbcff6b09bef [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:31:05.310638 17496 raft_consensus.cc:686] T 00000000000000000000000000000000 P a4006b7fe7564363ad48bbcff6b09bef [term 1 LEADER]: Becoming Leader. State: Replica: a4006b7fe7564363ad48bbcff6b09bef, State: Running, Role: LEADER
I20260809 15:31:05.310987 17496 consensus_queue.cc:237] T 00000000000000000000000000000000 P a4006b7fe7564363ad48bbcff6b09bef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4006b7fe7564363ad48bbcff6b09bef" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 33583 } }
I20260809 15:31:05.311548 17490 sys_catalog.cc:564] T 00000000000000000000000000000000 P a4006b7fe7564363ad48bbcff6b09bef [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:31:05.312214 17496 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4006b7fe7564363ad48bbcff6b09bef [sys.catalog]: SysCatalogTable state changed. Reason: New leader a4006b7fe7564363ad48bbcff6b09bef. Latest consensus state: current_term: 1 leader_uuid: "a4006b7fe7564363ad48bbcff6b09bef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4006b7fe7564363ad48bbcff6b09bef" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 33583 } } }
I20260809 15:31:05.312328 17496 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4006b7fe7564363ad48bbcff6b09bef [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:05.312716 17501 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:31:05.313007 17497 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4006b7fe7564363ad48bbcff6b09bef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a4006b7fe7564363ad48bbcff6b09bef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4006b7fe7564363ad48bbcff6b09bef" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 33583 } } }
I20260809 15:31:05.313113 17497 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4006b7fe7564363ad48bbcff6b09bef [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:05.316351 17501 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:31:05.322057 17501 catalog_manager.cc:1347] Generated new cluster ID: 731a707b4aeb4a57a4ea64ea6c4d1e27
I20260809 15:31:05.322130 17501 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:31:05.341338 17501 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:31:05.342288 17501 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:31:05.346079 17501 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a4006b7fe7564363ad48bbcff6b09bef: Generated new TSK 0
I20260809 15:31:05.346716 17501 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 15:31:05.374917 17521 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260809 15:31:05.375036 17521 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
W20260809 15:31:05.375891 17520 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:05.358686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:33583 (local address 127.0.0.1:38386)
0809 15:31:05.359043 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:05.359055 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:05.359154 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:05.359469 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:05.359471 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:05.359478 (+ 7us) client_negotiation.cc:189] Negotiated authn=JWT
0809 15:31:05.359597 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:05.359602 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:05.360735 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:05.360738 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:05.361387 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:05.361396 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:05.362008 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:05.362012 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:05.362083 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:05.362111 (+ 28us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 15:31:05.375564 (+ 13453us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41255/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 15:31:05.375741 (+ 177us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.146.62:33583: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41255/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":121,"threads_started":1}
I20260809 15:31:05.376034 17494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:05.358808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38386 (local address 127.11.146.62:33583)
0809 15:31:05.358953 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:05.358958 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:05.359129 (+ 171us) server_negotiation.cc:407] Connection header received
0809 15:31:05.359269 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:05.359272 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:05.359331 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:05.359454 (+ 123us) server_negotiation.cc:226] Negotiated authn=JWT
0809 15:31:05.359703 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:05.360590 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:05.361506 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:05.361860 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:05.361969 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:05.362304 (+ 335us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 15:31:05.375327 (+ 13023us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41255/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 15:31:05.375866 (+ 539us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38386: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41255/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":49}
W20260809 15:31:05.376145 17494 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38386: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41255/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
I20260809 15:31:05.376818 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 17421
2026-08-09T15:31:05Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (322 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260809 15:31:05.419252 11848 mini_oidc.cc:152] Starting JWKS server
I20260809 15:31:05.420233 11848 webserver.cc:460] Webserver started at https://127.0.0.1:36847/ using document root <none> and password file <none>
I20260809 15:31:05.420363 11848 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 15:31:05.420639 11848 webserver.cc:460] Webserver started at http://127.0.0.1:46865/ using document root <none> and password file <none>
2026-08-09T15:31:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:31:05Z Disabled control of system clock
I20260809 15:31:05.431527 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:40767
--webserver_interface=127.11.146.62
--webserver_port=0
--builtin_ntp_servers=127.11.146.20:34749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:40767
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36847/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 15:31:05.549108 17527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:05.549360 17527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:05.549399 17527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:05.553371 17527 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:31:05.553427 17527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:05.553449 17527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:05.553465 17527 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:31:05.553480 17527 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 15:31:05.553496 17527 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 15:31:05.553510 17527 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36847/jwks.json
I20260809 15:31:05.558215 17527 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:34749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:40767
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:40767
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36847/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17527
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:05.559253 17527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:05.560631 17527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:05.569007 17533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:05.569031 17535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:05.569021 17532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:05.569247 17527 server_base.cc:1034] running on GCE node
I20260809 15:31:05.569913 17527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:05.571008 17527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:05.572163 17527 hybrid_clock.cc:648] HybridClock initialized: now 1786289465572140 us; error 50 us; skew 500 ppm
I20260809 15:31:05.574039 17527 webserver.cc:460] Webserver started at http://127.11.146.62:45637/ using document root <none> and password file <none>
I20260809 15:31:05.574630 17527 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:05.574725 17527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:05.574973 17527 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:05.577531 17527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "02e5048b6de54ae7bb081654332e1f2d"
format_stamp: "Formatted at 2026-08-09 15:31:05 on dist-test-slave-1jjb"
server_key: "c8a02e66edceb4f1f6a493277f5ef3ae"
server_key_iv: "6adcdf2562e37663638870c38a1ecdb7"
server_key_version: "encryptionkey@0"
I20260809 15:31:05.578191 17527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "02e5048b6de54ae7bb081654332e1f2d"
format_stamp: "Formatted at 2026-08-09 15:31:05 on dist-test-slave-1jjb"
server_key: "c8a02e66edceb4f1f6a493277f5ef3ae"
server_key_iv: "6adcdf2562e37663638870c38a1ecdb7"
server_key_version: "encryptionkey@0"
I20260809 15:31:05.582154 17527 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 15:31:05.584707 17541 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:05.586050 17527 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:31:05.586213 17527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "02e5048b6de54ae7bb081654332e1f2d"
format_stamp: "Formatted at 2026-08-09 15:31:05 on dist-test-slave-1jjb"
server_key: "c8a02e66edceb4f1f6a493277f5ef3ae"
server_key_iv: "6adcdf2562e37663638870c38a1ecdb7"
server_key_version: "encryptionkey@0"
I20260809 15:31:05.586344 17527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:05.603403 17527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:05.604110 17527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:05.604306 17527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:05.611483 17527 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:40767
I20260809 15:31:05.611490 17596 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:40767 every 8 connection(s)
I20260809 15:31:05.612630 17527 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:31:05.615881 17597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:05.618224 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 17527
I20260809 15:31:05.618335 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:31:05.618688 11848 external_mini_cluster.cc:1428] Setting key e28a044cc7e49edbdc8eb90d5574d984
I20260809 15:31:05.622375 17597 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 02e5048b6de54ae7bb081654332e1f2d: Bootstrap starting.
I20260809 15:31:05.625130 17597 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 02e5048b6de54ae7bb081654332e1f2d: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:05.626071 17597 log.cc:824] T 00000000000000000000000000000000 P 02e5048b6de54ae7bb081654332e1f2d: Log is configured to *not* fsync() on all Append() calls
I20260809 15:31:05.628242 17597 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 02e5048b6de54ae7bb081654332e1f2d: No bootstrap required, opened a new log
I20260809 15:31:05.628405 17600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:05.620210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56250 (local address 127.11.146.62:40767)
0809 15:31:05.620916 (+ 706us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:05.620933 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:05.620970 (+ 37us) server_negotiation.cc:407] Connection header received
0809 15:31:05.621617 (+ 647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:05.621637 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:05.622039 (+ 402us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:05.622316 (+ 277us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:05.622716 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:05.623701 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:05.624957 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:05.625492 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:05.625616 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:05.626600 (+ 984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:05.626606 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:05.626619 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:31:05.627003 (+ 384us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:05.627059 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:31:05.627080 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:05.627194 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:05.627324 (+ 130us) server_negotiation.cc:299] Negotiation successful
0809 15:31:05.627587 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":287,"thread_start_us":150,"threads_started":1}
I20260809 15:31:05.631417 11848 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:31:05.632807 17597 raft_consensus.cc:348] T 00000000000000000000000000000000 P 02e5048b6de54ae7bb081654332e1f2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02e5048b6de54ae7bb081654332e1f2d" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40767 } }
I20260809 15:31:05.633101 17597 raft_consensus.cc:374] T 00000000000000000000000000000000 P 02e5048b6de54ae7bb081654332e1f2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:05.633185 17597 raft_consensus.cc:729] T 00000000000000000000000000000000 P 02e5048b6de54ae7bb081654332e1f2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02e5048b6de54ae7bb081654332e1f2d, State: Initialized, Role: FOLLOWER
I20260809 15:31:05.633637 17597 consensus_queue.cc:260] T 00000000000000000000000000000000 P 02e5048b6de54ae7bb081654332e1f2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02e5048b6de54ae7bb081654332e1f2d" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40767 } }
I20260809 15:31:05.633765 17597 raft_consensus.cc:388] T 00000000000000000000000000000000 P 02e5048b6de54ae7bb081654332e1f2d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:31:05.633816 17597 raft_consensus.cc:482] T 00000000000000000000000000000000 P 02e5048b6de54ae7bb081654332e1f2d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:31:05.633889 17597 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 02e5048b6de54ae7bb081654332e1f2d [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:05.634852 17597 raft_consensus.cc:504] T 00000000000000000000000000000000 P 02e5048b6de54ae7bb081654332e1f2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02e5048b6de54ae7bb081654332e1f2d" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40767 } }
I20260809 15:31:05.635180 17597 leader_election.cc:302] T 00000000000000000000000000000000 P 02e5048b6de54ae7bb081654332e1f2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 02e5048b6de54ae7bb081654332e1f2d; no voters:
I20260809 15:31:05.635459 17597 leader_election.cc:288] T 00000000000000000000000000000000 P 02e5048b6de54ae7bb081654332e1f2d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:31:05.635690 17602 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 02e5048b6de54ae7bb081654332e1f2d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:31:05.635987 17602 raft_consensus.cc:686] T 00000000000000000000000000000000 P 02e5048b6de54ae7bb081654332e1f2d [term 1 LEADER]: Becoming Leader. State: Replica: 02e5048b6de54ae7bb081654332e1f2d, State: Running, Role: LEADER
I20260809 15:31:05.636368 17602 consensus_queue.cc:237] T 00000000000000000000000000000000 P 02e5048b6de54ae7bb081654332e1f2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02e5048b6de54ae7bb081654332e1f2d" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40767 } }
I20260809 15:31:05.637203 17597 sys_catalog.cc:564] T 00000000000000000000000000000000 P 02e5048b6de54ae7bb081654332e1f2d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:31:05.638350 17604 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02e5048b6de54ae7bb081654332e1f2d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 02e5048b6de54ae7bb081654332e1f2d. Latest consensus state: current_term: 1 leader_uuid: "02e5048b6de54ae7bb081654332e1f2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02e5048b6de54ae7bb081654332e1f2d" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40767 } } }
I20260809 15:31:05.638509 17604 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02e5048b6de54ae7bb081654332e1f2d [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:05.638954 17612 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:31:05.638350 17603 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02e5048b6de54ae7bb081654332e1f2d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "02e5048b6de54ae7bb081654332e1f2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02e5048b6de54ae7bb081654332e1f2d" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40767 } } }
I20260809 15:31:05.639688 17603 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02e5048b6de54ae7bb081654332e1f2d [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:05.641894 17612 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:31:05.650065 17612 catalog_manager.cc:1347] Generated new cluster ID: 75403dc292b24185a36f5b2d7604c5f0
I20260809 15:31:05.650149 17612 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:31:05.667047 17612 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:31:05.668051 17612 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:31:05.679140 17612 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 02e5048b6de54ae7bb081654332e1f2d: Generated new TSK 0
I20260809 15:31:05.679960 17612 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:31:05.694283 17600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:05.688111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56260 (local address 127.11.146.62:40767)
0809 15:31:05.688255 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:05.688260 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:05.688369 (+ 109us) server_negotiation.cc:407] Connection header received
0809 15:31:05.688539 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:05.688543 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:05.688604 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:05.688729 (+ 125us) server_negotiation.cc:226] Negotiated authn=JWT
0809 15:31:05.689042 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:05.690042 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:05.691379 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:05.691767 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:05.691877 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:05.692301 (+ 424us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 15:31:05.693860 (+ 1559us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36847/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 15:31:05.694125 (+ 265us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:56260: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36847/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":56}
W20260809 15:31:05.694363 17600 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:56260: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36847/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260809 15:31:05.696319 17628 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:05.687963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40767 (local address 127.0.0.1:56260)
0809 15:31:05.688274 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:05.688288 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:05.688393 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:05.688760 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:05.688764 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:05.688772 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0809 15:31:05.688922 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:05.688928 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:05.690312 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:05.690316 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:05.691243 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:05.691254 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:05.691923 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:05.691927 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:05.691997 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:05.692027 (+ 30us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 15:31:05.694056 (+ 2029us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36847/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 15:31:05.696132 (+ 2076us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.146.62:40767: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36847/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":210,"mutex_wait_us":1751,"thread_start_us":116,"threads_started":1}
I20260809 15:31:05.696977 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 17527
E20260809 15:31:05.710798 17629 webserver.cc:533] Webserver: sslize failed:
E20260809 15:31:05.710888 17629 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-09T15:31:05Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (322 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-09T15:31:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:31:05Z Disabled control of system clock
I20260809 15:31:05.758458 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:36967
--webserver_interface=127.11.146.62
--webserver_port=0
--builtin_ntp_servers=127.11.146.20:46681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:36967
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786289437399694-11848-0/testchainca.cert with env {}
W20260809 15:31:05.891801 17634 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:05.892261 17634 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:05.892328 17634 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:05.896996 17634 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:31:05.897068 17634 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:05.897084 17634 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:05.897102 17634 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:31:05.897120 17634 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 15:31:05.897137 17634 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 15:31:05.897150 17634 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260809 15:31:05.902856 17634 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:46681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:36967
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:36967
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786289437399694-11848-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17634
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:05.903941 17634 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:05.904974 17634 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:05.913897 17640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:05.913887 17642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:05.913887 17639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:05.914310 17634 server_base.cc:1034] running on GCE node
I20260809 15:31:05.915056 17634 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:05.916352 17634 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:05.917578 17634 hybrid_clock.cc:648] HybridClock initialized: now 1786289465917565 us; error 31 us; skew 500 ppm
I20260809 15:31:05.919674 17634 webserver.cc:460] Webserver started at http://127.11.146.62:40061/ using document root <none> and password file <none>
I20260809 15:31:05.920365 17634 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:05.920471 17634 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:05.920710 17634 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:05.922935 17634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "ef671c80aac54c3990390294c16bd87b"
format_stamp: "Formatted at 2026-08-09 15:31:05 on dist-test-slave-1jjb"
server_key: "29c1d4d2a845130aa2aa1b0216f5a6dd"
server_key_iv: "3be08c20b16dca0c21148f6b743144a7"
server_key_version: "encryptionkey@0"
I20260809 15:31:05.923544 17634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "ef671c80aac54c3990390294c16bd87b"
format_stamp: "Formatted at 2026-08-09 15:31:05 on dist-test-slave-1jjb"
server_key: "29c1d4d2a845130aa2aa1b0216f5a6dd"
server_key_iv: "3be08c20b16dca0c21148f6b743144a7"
server_key_version: "encryptionkey@0"
I20260809 15:31:05.927760 17634 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 15:31:05.930539 17648 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:05.932011 17634 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 15:31:05.932214 17634 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "ef671c80aac54c3990390294c16bd87b"
format_stamp: "Formatted at 2026-08-09 15:31:05 on dist-test-slave-1jjb"
server_key: "29c1d4d2a845130aa2aa1b0216f5a6dd"
server_key_iv: "3be08c20b16dca0c21148f6b743144a7"
server_key_version: "encryptionkey@0"
I20260809 15:31:05.932358 17634 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:05.951412 17634 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:05.952391 17634 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:05.952617 17634 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:05.960816 17701 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:36967 every 8 connection(s)
I20260809 15:31:05.960822 17634 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:36967
I20260809 15:31:05.961977 17634 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:31:05.965277 17702 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:05.967006 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 17634
I20260809 15:31:05.967171 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:31:05.967501 11848 external_mini_cluster.cc:1428] Setting key 03ebfef8826f3920888031283cdf8cf7
I20260809 15:31:05.972201 17702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef671c80aac54c3990390294c16bd87b: Bootstrap starting.
I20260809 15:31:05.974952 17702 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ef671c80aac54c3990390294c16bd87b: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:05.975842 17702 log.cc:824] T 00000000000000000000000000000000 P ef671c80aac54c3990390294c16bd87b: Log is configured to *not* fsync() on all Append() calls
I20260809 15:31:05.977944 17702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef671c80aac54c3990390294c16bd87b: No bootstrap required, opened a new log
I20260809 15:31:05.978673 17706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:05.969108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35086 (local address 127.11.146.62:36967)
0809 15:31:05.969806 (+ 698us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:05.969830 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:05.969874 (+ 44us) server_negotiation.cc:407] Connection header received
0809 15:31:05.970860 (+ 986us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:05.970884 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:05.971394 (+ 510us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:05.971886 (+ 492us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:05.972399 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:05.973907 (+ 1508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:05.974923 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:05.975620 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:05.975801 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:05.976871 (+ 1070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:05.976885 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:05.976900 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:31:05.977306 (+ 406us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:05.977361 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:31:05.977382 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:05.977498 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:05.977629 (+ 131us) server_negotiation.cc:299] Negotiation successful
0809 15:31:05.977901 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":120,"threads_started":1}
I20260809 15:31:05.982038 11848 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:31:05.982348 17702 raft_consensus.cc:348] T 00000000000000000000000000000000 P ef671c80aac54c3990390294c16bd87b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef671c80aac54c3990390294c16bd87b" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 36967 } }
I20260809 15:31:05.982612 17702 raft_consensus.cc:374] T 00000000000000000000000000000000 P ef671c80aac54c3990390294c16bd87b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:05.982692 17702 raft_consensus.cc:729] T 00000000000000000000000000000000 P ef671c80aac54c3990390294c16bd87b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef671c80aac54c3990390294c16bd87b, State: Initialized, Role: FOLLOWER
I20260809 15:31:05.983147 17702 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef671c80aac54c3990390294c16bd87b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef671c80aac54c3990390294c16bd87b" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 36967 } }
I20260809 15:31:05.983335 17702 raft_consensus.cc:388] T 00000000000000000000000000000000 P ef671c80aac54c3990390294c16bd87b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:31:05.983428 17702 raft_consensus.cc:482] T 00000000000000000000000000000000 P ef671c80aac54c3990390294c16bd87b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:31:05.983544 17702 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ef671c80aac54c3990390294c16bd87b [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:05.984674 17702 raft_consensus.cc:504] T 00000000000000000000000000000000 P ef671c80aac54c3990390294c16bd87b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef671c80aac54c3990390294c16bd87b" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 36967 } }
I20260809 15:31:05.985030 17702 leader_election.cc:302] T 00000000000000000000000000000000 P ef671c80aac54c3990390294c16bd87b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ef671c80aac54c3990390294c16bd87b; no voters:
I20260809 15:31:05.985365 17702 leader_election.cc:288] T 00000000000000000000000000000000 P ef671c80aac54c3990390294c16bd87b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:31:05.985579 17708 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ef671c80aac54c3990390294c16bd87b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:31:05.985893 17708 raft_consensus.cc:686] T 00000000000000000000000000000000 P ef671c80aac54c3990390294c16bd87b [term 1 LEADER]: Becoming Leader. State: Replica: ef671c80aac54c3990390294c16bd87b, State: Running, Role: LEADER
I20260809 15:31:05.986214 17708 consensus_queue.cc:237] T 00000000000000000000000000000000 P ef671c80aac54c3990390294c16bd87b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef671c80aac54c3990390294c16bd87b" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 36967 } }
I20260809 15:31:05.986696 17702 sys_catalog.cc:564] T 00000000000000000000000000000000 P ef671c80aac54c3990390294c16bd87b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:31:05.987416 17708 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef671c80aac54c3990390294c16bd87b [sys.catalog]: SysCatalogTable state changed. Reason: New leader ef671c80aac54c3990390294c16bd87b. Latest consensus state: current_term: 1 leader_uuid: "ef671c80aac54c3990390294c16bd87b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef671c80aac54c3990390294c16bd87b" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 36967 } } }
I20260809 15:31:05.987553 17708 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef671c80aac54c3990390294c16bd87b [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:05.987903 17716 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:31:05.988276 17709 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef671c80aac54c3990390294c16bd87b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ef671c80aac54c3990390294c16bd87b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef671c80aac54c3990390294c16bd87b" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 36967 } } }
I20260809 15:31:05.988868 17709 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef671c80aac54c3990390294c16bd87b [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:05.991183 17716 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:31:05.997097 17716 catalog_manager.cc:1347] Generated new cluster ID: 36427a8a0c4f440ab4f321dc05db614c
I20260809 15:31:05.997176 17716 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:31:06.007773 17716 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:31:06.009109 17716 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:31:06.015038 17716 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ef671c80aac54c3990390294c16bd87b: Generated new TSK 0
I20260809 15:31:06.015877 17716 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:31:06.513456 17706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:06.024991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35094 (local address 127.11.146.62:36967)
0809 15:31:06.025144 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:06.025149 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:06.025277 (+ 128us) server_negotiation.cc:407] Connection header received
0809 15:31:06.025498 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:06.025502 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:06.025554 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:06.025674 (+ 120us) server_negotiation.cc:226] Negotiated authn=JWT
0809 15:31:06.025922 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:06.026511 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:06.027405 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:06.027666 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:06.027783 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:06.028164 (+ 381us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 15:31:06.513049 (+484885us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 15:31:06.513331 (+ 282us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:35094: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":57}
W20260809 15:31:06.513571 17706 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:35094: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260809 15:31:06.513697 17733 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:06.024827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:36967 (local address 127.0.0.1:35094)
0809 15:31:06.025175 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:06.025197 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:06.025338 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:06.025672 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:06.025676 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:06.025685 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0809 15:31:06.025807 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:06.025813 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:06.026637 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:06.026641 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:06.027274 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:06.027282 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:06.027800 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:06.027804 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:06.027902 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:06.027927 (+ 25us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 15:31:06.513293 (+485366us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 15:31:06.513485 (+ 192us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.146.62:36967: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":123,"threads_started":1}
I20260809 15:31:06.514469 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 17634
2026-08-09T15:31:06Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (795 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (134 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (134 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:31:06 dist-test-slave-1jjb krb5kdc[17746](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:31:06 dist-test-slave-1jjb krb5kdc[17746](info): set up 2 sockets
Aug 09 15:31:06 dist-test-slave-1jjb krb5kdc[17746](info): commencing operation
krb5kdc: starting...
W20260809 15:31:07.902048 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.096s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:31:08 dist-test-slave-1jjb krb5kdc[17746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289467, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:31:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:31:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.146.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
I20260809 15:31:08.047326 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:43249
--webserver_interface=127.11.146.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:46517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:43249
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:31:08.165504 17759 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:08.165762 17759 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:08.165830 17759 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:08.170014 17759 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:31:08.170070 17759 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:08.170090 17759 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:08.170107 17759 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:31:08.170161 17759 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:31:08.176218 17759 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:46517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:43249
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:43249
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17759
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:08.177314 17759 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:08.178373 17759 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:08.187055 17766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:08.187055 17768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:08.187117 17764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:08.187346 17759 server_base.cc:1034] running on GCE node
I20260809 15:31:08.188206 17759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:08.189378 17759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:08.190598 17759 hybrid_clock.cc:648] HybridClock initialized: now 1786289468190580 us; error 35 us; skew 500 ppm
Aug 09 15:31:08 dist-test-slave-1jjb krb5kdc[17746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289468, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:08.196803 17759 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:31:08.197767 17759 webserver.cc:460] Webserver started at http://127.11.146.62:38651/ using document root <none> and password file <none>
I20260809 15:31:08.198383 17759 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:08.198483 17759 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:08.198740 17759 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:08.200963 17759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "a2a3510f6c724b4aa1dda6c563249902"
format_stamp: "Formatted at 2026-08-09 15:31:08 on dist-test-slave-1jjb"
server_key: "405174528ac70a809a6564022cb5e900"
server_key_iv: "d71b543e909a8cbea8cc90cec7239f04"
server_key_version: "encryptionkey@0"
I20260809 15:31:08.201558 17759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "a2a3510f6c724b4aa1dda6c563249902"
format_stamp: "Formatted at 2026-08-09 15:31:08 on dist-test-slave-1jjb"
server_key: "405174528ac70a809a6564022cb5e900"
server_key_iv: "d71b543e909a8cbea8cc90cec7239f04"
server_key_version: "encryptionkey@0"
I20260809 15:31:08.205529 17759 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 15:31:08.208038 17777 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:08.209383 17759 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:31:08.209553 17759 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "a2a3510f6c724b4aa1dda6c563249902"
format_stamp: "Formatted at 2026-08-09 15:31:08 on dist-test-slave-1jjb"
server_key: "405174528ac70a809a6564022cb5e900"
server_key_iv: "d71b543e909a8cbea8cc90cec7239f04"
server_key_version: "encryptionkey@0"
I20260809 15:31:08.209674 17759 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:08.229473 17759 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:08.232751 17759 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:08.232961 17759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:08.240372 17759 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:43249
I20260809 15:31:08.240397 17831 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:43249 every 8 connection(s)
I20260809 15:31:08.241359 17759 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:31:08.244140 17832 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:08.245347 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 17759
I20260809 15:31:08.245455 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:31:08.245774 11848 external_mini_cluster.cc:1428] Setting key 6a7b5e78a0ed20aab04f4e28069fc32a
I20260809 15:31:08.250391 17832 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2a3510f6c724b4aa1dda6c563249902: Bootstrap starting.
I20260809 15:31:08.252890 17832 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a2a3510f6c724b4aa1dda6c563249902: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:08.253643 17832 log.cc:824] T 00000000000000000000000000000000 P a2a3510f6c724b4aa1dda6c563249902: Log is configured to *not* fsync() on all Append() calls
Aug 09 15:31:08 dist-test-slave-1jjb krb5kdc[17746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289467, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:31:08.255919 17832 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2a3510f6c724b4aa1dda6c563249902: No bootstrap required, opened a new log
I20260809 15:31:08.261029 17835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:08.247256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59404 (local address 127.11.146.62:43249)
0809 15:31:08.247721 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:08.247737 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:08.247773 (+ 36us) server_negotiation.cc:407] Connection header received
0809 15:31:08.248478 (+ 705us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:08.248500 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:08.248829 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:08.249183 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:08.250031 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:08.251048 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:08.251902 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:08.252457 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:08.252639 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:08.255349 (+ 2710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:08.255355 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:08.255371 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:08.255402 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:08.257527 (+ 2125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:08.257979 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:08.257993 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:08.258000 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:08.258163 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:08.258454 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:08.258460 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:08.258463 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:08.259057 (+ 594us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:08.259245 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:08.259513 (+ 268us) server_negotiation.cc:299] Negotiation successful
0809 15:31:08.259977 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":144,"threads_started":1}
I20260809 15:31:08.261068 17832 raft_consensus.cc:348] T 00000000000000000000000000000000 P a2a3510f6c724b4aa1dda6c563249902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2a3510f6c724b4aa1dda6c563249902" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43249 } }
I20260809 15:31:08.261338 17832 raft_consensus.cc:374] T 00000000000000000000000000000000 P a2a3510f6c724b4aa1dda6c563249902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:08.261422 17832 raft_consensus.cc:729] T 00000000000000000000000000000000 P a2a3510f6c724b4aa1dda6c563249902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a3510f6c724b4aa1dda6c563249902, State: Initialized, Role: FOLLOWER
I20260809 15:31:08.261905 17832 consensus_queue.cc:260] T 00000000000000000000000000000000 P a2a3510f6c724b4aa1dda6c563249902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2a3510f6c724b4aa1dda6c563249902" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43249 } }
I20260809 15:31:08.262069 17832 raft_consensus.cc:388] T 00000000000000000000000000000000 P a2a3510f6c724b4aa1dda6c563249902 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:31:08.262140 17832 raft_consensus.cc:482] T 00000000000000000000000000000000 P a2a3510f6c724b4aa1dda6c563249902 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:31:08.262248 17832 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a2a3510f6c724b4aa1dda6c563249902 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:08.263429 17832 raft_consensus.cc:504] T 00000000000000000000000000000000 P a2a3510f6c724b4aa1dda6c563249902 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2a3510f6c724b4aa1dda6c563249902" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43249 } }
I20260809 15:31:08.263796 17832 leader_election.cc:302] T 00000000000000000000000000000000 P a2a3510f6c724b4aa1dda6c563249902 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a2a3510f6c724b4aa1dda6c563249902; no voters:
I20260809 15:31:08.264189 17832 leader_election.cc:288] T 00000000000000000000000000000000 P a2a3510f6c724b4aa1dda6c563249902 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:31:08.264290 17837 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a2a3510f6c724b4aa1dda6c563249902 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:31:08.264564 17837 raft_consensus.cc:686] T 00000000000000000000000000000000 P a2a3510f6c724b4aa1dda6c563249902 [term 1 LEADER]: Becoming Leader. State: Replica: a2a3510f6c724b4aa1dda6c563249902, State: Running, Role: LEADER
I20260809 15:31:08.264899 17837 consensus_queue.cc:237] T 00000000000000000000000000000000 P a2a3510f6c724b4aa1dda6c563249902 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2a3510f6c724b4aa1dda6c563249902" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43249 } }
I20260809 15:31:08.265446 17832 sys_catalog.cc:564] T 00000000000000000000000000000000 P a2a3510f6c724b4aa1dda6c563249902 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:31:08.266542 17838 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2a3510f6c724b4aa1dda6c563249902 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a2a3510f6c724b4aa1dda6c563249902" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2a3510f6c724b4aa1dda6c563249902" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43249 } } }
I20260809 15:31:08.266670 17838 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2a3510f6c724b4aa1dda6c563249902 [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:08.266966 17839 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2a3510f6c724b4aa1dda6c563249902 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a2a3510f6c724b4aa1dda6c563249902. Latest consensus state: current_term: 1 leader_uuid: "a2a3510f6c724b4aa1dda6c563249902" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2a3510f6c724b4aa1dda6c563249902" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43249 } } }
I20260809 15:31:08.267064 17839 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2a3510f6c724b4aa1dda6c563249902 [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:08.267067 17846 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:31:08.270223 17846 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:31:08.276192 17846 catalog_manager.cc:1347] Generated new cluster ID: 75976bfc5a2843f78f120914d8973b07
I20260809 15:31:08.276268 17846 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:31:08.282033 17846 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:31:08.282922 17846 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:31:08.290997 17846 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a2a3510f6c724b4aa1dda6c563249902: Generated new TSK 0
I20260809 15:31:08.291729 17846 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.146.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
I20260809 15:31:08.327893 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.1:0
--local_ip_for_outbound_sockets=127.11.146.1
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:43249
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:46517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:31:08.450039 17858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:08.450330 17858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:08.450410 17858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:08.454668 17858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:08.454772 17858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:08.454870 17858 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.1
I20260809 15:31:08.460419 17858 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:46517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:43249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17858
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.1
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:08.461536 17858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:08.462576 17858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:08.472807 17864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:08.472807 17866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:08.472818 17863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:08.473083 17858 server_base.cc:1034] running on GCE node
I20260809 15:31:08.473625 17858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:08.474277 17858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:08.475473 17858 hybrid_clock.cc:648] HybridClock initialized: now 1786289468475441 us; error 34 us; skew 500 ppm
Aug 09 15:31:08 dist-test-slave-1jjb krb5kdc[17746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289468, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:08.478375 17858 init.cc:377] Logged in from keytab as kudu/127.11.146.1@KRBTEST.COM (short username kudu)
I20260809 15:31:08.479274 17858 webserver.cc:460] Webserver started at http://127.11.146.1:43541/ using document root <none> and password file <none>
I20260809 15:31:08.479867 17858 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:08.479962 17858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:08.480255 17858 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:08.482363 17858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-0/data/instance:
uuid: "77d867e2932a4913aa1c9a57521037f3"
format_stamp: "Formatted at 2026-08-09 15:31:08 on dist-test-slave-1jjb"
server_key: "601ecb16a06be5aed2675ed7b0048ebf"
server_key_iv: "400bc49d639b27fa8c107bc7f2cfcd2c"
server_key_version: "encryptionkey@0"
I20260809 15:31:08.482959 17858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance:
uuid: "77d867e2932a4913aa1c9a57521037f3"
format_stamp: "Formatted at 2026-08-09 15:31:08 on dist-test-slave-1jjb"
server_key: "601ecb16a06be5aed2675ed7b0048ebf"
server_key_iv: "400bc49d639b27fa8c107bc7f2cfcd2c"
server_key_version: "encryptionkey@0"
I20260809 15:31:08.486745 17858 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260809 15:31:08.489266 17874 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:08.490569 17858 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:31:08.490711 17858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-0/wal
uuid: "77d867e2932a4913aa1c9a57521037f3"
format_stamp: "Formatted at 2026-08-09 15:31:08 on dist-test-slave-1jjb"
server_key: "601ecb16a06be5aed2675ed7b0048ebf"
server_key_iv: "400bc49d639b27fa8c107bc7f2cfcd2c"
server_key_version: "encryptionkey@0"
I20260809 15:31:08.490830 17858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:08.508194 17858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:08.511210 17858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:08.511449 17858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:08.512173 17858 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:31:08.513198 17858 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:08.513276 17858 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:08.513366 17858 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:08.513424 17858 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:08.523398 17858 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.1:41065
I20260809 15:31:08.523422 17992 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.1:41065 every 8 connection(s)
I20260809 15:31:08.524544 17858 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
I20260809 15:31:08.526412 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 17858
I20260809 15:31:08.526549 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance
I20260809 15:31:08.526865 11848 external_mini_cluster.cc:1428] Setting key 4a34e13c8a41cf84f84d74fd9a2ea495
Aug 09 15:31:08 dist-test-slave-1jjb krb5kdc[17746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289468, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.146.2@KRBTEST.COM; defaulting to no policy
I20260809 15:31:08.540009 17835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:08.526566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:40239 (local address 127.11.146.62:43249)
0809 15:31:08.526734 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:08.526737 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:08.527764 (+ 1027us) server_negotiation.cc:407] Connection header received
0809 15:31:08.529276 (+ 1512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:08.529282 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:08.529355 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:08.529445 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:08.530706 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:08.531228 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:08.532929 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:08.533355 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:08.533496 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:08.536335 (+ 2839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:08.536339 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:08.536341 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:08.536367 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:08.537818 (+ 1451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:08.538356 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:08.538365 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:08.538366 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:08.538443 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:08.538827 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:08.538830 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:08.538832 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:08.539031 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:08.539144 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:08.539678 (+ 534us) server_negotiation.cc:299] Negotiation successful
0809 15:31:08.539812 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 15:31:08.540822 17995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:08.527044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43249 (local address 127.11.146.1:40239)
0809 15:31:08.527576 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:08.527632 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:08.529037 (+ 1405us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:08.529611 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:08.529618 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:08.529977 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:08.530526 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:08.530550 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:08.531366 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:08.531372 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:08.532793 (+ 1421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:08.532804 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:08.533533 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:08.533536 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:08.533685 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:08.534418 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:08.534446 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:08.536156 (+ 1710us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:08.537943 (+ 1787us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:08.537949 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:08.537965 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:08.538239 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:08.538546 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:08.538549 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:08.538551 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:08.538719 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:08.539144 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:08.539152 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:08.539413 (+ 261us) client_negotiation.cc:769] Sending connection context
0809 15:31:08.539615 (+ 202us) client_negotiation.cc:240] Negotiation successful
0809 15:31:08.539949 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":144,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.2@KRBTEST.COM" created.
I20260809 15:31:08.542207 17993 heartbeater.cc:347] Connected to a master server at 127.11.146.62:43249
I20260809 15:31:08.542460 17993 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:08.542963 17993 heartbeater.cc:511] Master 127.11.146.62:43249 requested a full tablet report, sending...
I20260809 15:31:08.544586 17794 ts_manager.cc:194] Registered new tserver with Master: 77d867e2932a4913aa1c9a57521037f3 (127.11.146.1:41065)
I20260809 15:31:08.545729 17794 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.1@KRBTEST.COM'} at 127.11.146.1:40239
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
I20260809 15:31:08.559232 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.2:0
--local_ip_for_outbound_sockets=127.11.146.2
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:43249
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:46517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:31:08.678200 17998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:08.678467 17998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:08.678516 17998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:08.682685 17998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:08.682749 17998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:08.682855 17998 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.2
I20260809 15:31:08.688060 17998 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:46517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:43249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17998
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.2
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:08.689179 17998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:08.690212 17998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:08.700029 18007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:08.700028 18004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:08.700038 18005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:08.700343 17998 server_base.cc:1034] running on GCE node
I20260809 15:31:08.700836 17998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:08.701509 17998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:08.702706 17998 hybrid_clock.cc:648] HybridClock initialized: now 1786289468702689 us; error 25 us; skew 500 ppm
Aug 09 15:31:08 dist-test-slave-1jjb krb5kdc[17746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289468, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:08.705595 17998 init.cc:377] Logged in from keytab as kudu/127.11.146.2@KRBTEST.COM (short username kudu)
I20260809 15:31:08.706501 17998 webserver.cc:460] Webserver started at http://127.11.146.2:38055/ using document root <none> and password file <none>
I20260809 15:31:08.707015 17998 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:08.707077 17998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:08.707240 17998 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:08.709329 17998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-1/data/instance:
uuid: "a5235cb4952644cb866ef6ce4c11f736"
format_stamp: "Formatted at 2026-08-09 15:31:08 on dist-test-slave-1jjb"
server_key: "1c3238486355313c676a2e02e0bf41d5"
server_key_iv: "48ac44b249c7a0057e2794ccc694651c"
server_key_version: "encryptionkey@0"
I20260809 15:31:08.709856 17998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance:
uuid: "a5235cb4952644cb866ef6ce4c11f736"
format_stamp: "Formatted at 2026-08-09 15:31:08 on dist-test-slave-1jjb"
server_key: "1c3238486355313c676a2e02e0bf41d5"
server_key_iv: "48ac44b249c7a0057e2794ccc694651c"
server_key_version: "encryptionkey@0"
I20260809 15:31:08.713549 17998 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.001s
I20260809 15:31:08.716188 18015 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:08.717409 17998 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 15:31:08.717545 17998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-1/wal
uuid: "a5235cb4952644cb866ef6ce4c11f736"
format_stamp: "Formatted at 2026-08-09 15:31:08 on dist-test-slave-1jjb"
server_key: "1c3238486355313c676a2e02e0bf41d5"
server_key_iv: "48ac44b249c7a0057e2794ccc694651c"
server_key_version: "encryptionkey@0"
I20260809 15:31:08.717653 17998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:08.730182 17998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:08.733529 17998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:08.733744 17998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:08.734361 17998 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:31:08.735226 17998 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:08.735308 17998 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:08.735383 17998 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:08.735428 17998 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:08.745543 17998 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.2:44393
I20260809 15:31:08.745559 18137 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.2:44393 every 8 connection(s)
I20260809 15:31:08.746440 17998 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
I20260809 15:31:08.746874 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 17998
I20260809 15:31:08.747023 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance
I20260809 15:31:08.747304 11848 external_mini_cluster.cc:1428] Setting key 36181262497f1b164d400428ca956bff
Aug 09 15:31:08 dist-test-slave-1jjb krb5kdc[17746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289468, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.146.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.3@KRBTEST.COM" created.
I20260809 15:31:08.762243 17835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:08.748280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:41345 (local address 127.11.146.62:43249)
0809 15:31:08.748433 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:08.748437 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:08.749619 (+ 1182us) server_negotiation.cc:407] Connection header received
0809 15:31:08.751737 (+ 2118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:08.751743 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:08.751807 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:08.751906 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:08.753156 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:08.754020 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:08.755361 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:08.755588 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:08.755675 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:08.758582 (+ 2907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:08.758592 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:08.758594 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:08.758617 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:08.760197 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:08.760705 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:08.760709 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:08.760710 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:08.760796 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:08.761145 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:08.761149 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:08.761151 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:08.761341 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:08.761452 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:08.761940 (+ 488us) server_negotiation.cc:299] Negotiation successful
0809 15:31:08.762068 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 15:31:08.763028 18140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:08.748831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43249 (local address 127.11.146.2:41345)
0809 15:31:08.749433 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:08.749493 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:08.751416 (+ 1923us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:08.752063 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:08.752070 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:08.752503 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:08.753005 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:08.753019 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:08.754150 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:08.754152 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:08.755187 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:08.755219 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:08.755764 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:08.755772 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:08.756044 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:08.756719 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:08.756747 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:08.758403 (+ 1656us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:08.760308 (+ 1905us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:08.760314 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:08.760329 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:08.760595 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:08.760892 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:08.760896 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:08.760898 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:08.761043 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:08.761452 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:08.761459 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:08.761705 (+ 246us) client_negotiation.cc:769] Sending connection context
0809 15:31:08.761898 (+ 193us) client_negotiation.cc:240] Negotiation successful
0809 15:31:08.762219 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":159,"threads_started":1}
I20260809 15:31:08.764389 18138 heartbeater.cc:347] Connected to a master server at 127.11.146.62:43249
I20260809 15:31:08.764649 18138 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:08.765214 18138 heartbeater.cc:511] Master 127.11.146.62:43249 requested a full tablet report, sending...
I20260809 15:31:08.766513 17794 ts_manager.cc:194] Registered new tserver with Master: a5235cb4952644cb866ef6ce4c11f736 (127.11.146.2:44393)
I20260809 15:31:08.767227 17794 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.2@KRBTEST.COM'} at 127.11.146.2:41345
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
I20260809 15:31:08.780161 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.3:0
--local_ip_for_outbound_sockets=127.11.146.3
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:43249
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:46517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:31:08.899016 18143 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:08.899271 18143 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:08.899315 18143 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:08.903396 18143 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:08.903455 18143 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:08.903513 18143 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.3
I20260809 15:31:08.908850 18143 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:46517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:43249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18143
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.3
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:08.909837 18143 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:08.910796 18143 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:08.920967 18149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:08.920967 18151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:08.921012 18148 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:08.921053 18143 server_base.cc:1034] running on GCE node
I20260809 15:31:08.921715 18143 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:08.922346 18143 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:08.923539 18143 hybrid_clock.cc:648] HybridClock initialized: now 1786289468923508 us; error 45 us; skew 500 ppm
Aug 09 15:31:08 dist-test-slave-1jjb krb5kdc[17746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289468, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:08.926268 18143 init.cc:377] Logged in from keytab as kudu/127.11.146.3@KRBTEST.COM (short username kudu)
I20260809 15:31:08.927098 18143 webserver.cc:460] Webserver started at http://127.11.146.3:38841/ using document root <none> and password file <none>
I20260809 15:31:08.927654 18143 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:08.927747 18143 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:08.927979 18143 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:08.930058 18143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-2/data/instance:
uuid: "21a84f13446a470c9d16cd5bc1c1b14f"
format_stamp: "Formatted at 2026-08-09 15:31:08 on dist-test-slave-1jjb"
server_key: "d9392de02ad2e0d0354329a7f326300c"
server_key_iv: "414d2768c2a05c21eb1206ffedc23df7"
server_key_version: "encryptionkey@0"
I20260809 15:31:08.930624 18143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance:
uuid: "21a84f13446a470c9d16cd5bc1c1b14f"
format_stamp: "Formatted at 2026-08-09 15:31:08 on dist-test-slave-1jjb"
server_key: "d9392de02ad2e0d0354329a7f326300c"
server_key_iv: "414d2768c2a05c21eb1206ffedc23df7"
server_key_version: "encryptionkey@0"
I20260809 15:31:08.934291 18143 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 15:31:08.936746 18158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:08.937994 18143 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260809 15:31:08.938136 18143 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-2/wal
uuid: "21a84f13446a470c9d16cd5bc1c1b14f"
format_stamp: "Formatted at 2026-08-09 15:31:08 on dist-test-slave-1jjb"
server_key: "d9392de02ad2e0d0354329a7f326300c"
server_key_iv: "414d2768c2a05c21eb1206ffedc23df7"
server_key_version: "encryptionkey@0"
I20260809 15:31:08.938252 18143 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:08.953045 18143 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:08.956008 18143 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:08.956243 18143 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:08.956849 18143 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:31:08.957667 18143 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:08.957739 18143 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:08.957813 18143 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:08.957864 18143 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:08.967485 18143 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.3:43955
I20260809 15:31:08.967507 18275 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.3:43955 every 8 connection(s)
I20260809 15:31:08.968410 18143 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
Aug 09 15:31:08 dist-test-slave-1jjb krb5kdc[17746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289468, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:31:08.977986 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 18143
I20260809 15:31:08.978128 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance
I20260809 15:31:08.978413 11848 external_mini_cluster.cc:1428] Setting key f31307ca00f8cafa1f69038dd90c1a26
I20260809 15:31:08.982322 17835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:08.970194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:39987 (local address 127.11.146.62:43249)
0809 15:31:08.970364 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:08.970369 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:08.971165 (+ 796us) server_negotiation.cc:407] Connection header received
0809 15:31:08.972552 (+ 1387us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:08.972556 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:08.972605 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:08.972683 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:08.973813 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:08.974357 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:08.975444 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:08.975810 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:08.975908 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:08.978578 (+ 2670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:08.978582 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:08.978584 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:08.978608 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:08.980365 (+ 1757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:08.980944 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:08.980947 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:08.980948 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:08.981034 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:08.981332 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:08.981334 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:08.981335 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:08.981517 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:08.981594 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:08.982096 (+ 502us) server_negotiation.cc:299] Negotiation successful
0809 15:31:08.982195 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 15:31:08.983111 18278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:08.970566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43249 (local address 127.11.146.3:39987)
0809 15:31:08.971010 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:08.971054 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:08.972329 (+ 1275us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:08.972843 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:08.972850 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:08.973194 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:08.973679 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:08.973692 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:08.974462 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:08.974464 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:08.975325 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:08.975334 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:08.975962 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:08.975965 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:08.976182 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:08.976811 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:08.976828 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:08.978393 (+ 1565us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:08.980470 (+ 2077us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:08.980475 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:08.980487 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:08.980859 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:08.981116 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:08.981118 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:08.981119 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:08.981250 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:08.981607 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:08.981612 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:08.981854 (+ 242us) client_negotiation.cc:769] Sending connection context
0809 15:31:08.982015 (+ 161us) client_negotiation.cc:240] Negotiation successful
0809 15:31:08.982286 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":110,"threads_started":1}
I20260809 15:31:08.984443 18276 heartbeater.cc:347] Connected to a master server at 127.11.146.62:43249
I20260809 15:31:08.984714 18276 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:08.985208 18276 heartbeater.cc:511] Master 127.11.146.62:43249 requested a full tablet report, sending...
I20260809 15:31:08.986229 17794 ts_manager.cc:194] Registered new tserver with Master: 21a84f13446a470c9d16cd5bc1c1b14f (127.11.146.3:43955)
I20260809 15:31:08.986773 17794 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.3@KRBTEST.COM'} at 127.11.146.3:39987
I20260809 15:31:08.992864 11848 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/test-admin.keytab.
Aug 09 15:31:09 dist-test-slave-1jjb krb5kdc[17746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289469, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:09.010773 11848 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260809 15:31:09.014190 18283 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:09.012526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60994 (local address 127.11.146.1:41065)
0809 15:31:09.012823 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:09.012841 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:09.012871 (+ 30us) server_negotiation.cc:407] Connection header received
0809 15:31:09.012990 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:09.012998 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:09.013220 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:09.013430 (+ 210us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:09.013983 (+ 553us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60994: BlockingRecv error: recv got EOF from 127.0.0.1:60994 (error 108)
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":69,"threads_started":1}
W20260809 15:31:09.014300 11848 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/krb5cc' of type FILE
Aug 09 15:31:09 dist-test-slave-1jjb krb5kdc[17746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289469, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:09.015443 11848 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 15:31:09 dist-test-slave-1jjb krb5kdc[17746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289469, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:09.016477 11848 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 15:31:09 dist-test-slave-1jjb krb5kdc[17746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289469, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.1@KRBTEST.COM
I20260809 15:31:09.026582 18283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:09.017346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32768 (local address 127.11.146.1:41065)
0809 15:31:09.017490 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:09.017494 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:09.017509 (+ 15us) server_negotiation.cc:407] Connection header received
0809 15:31:09.017615 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:09.017617 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:09.017655 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:09.017725 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:09.018257 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:09.019367 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:09.020469 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:09.020964 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:09.021062 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:09.023330 (+ 2268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:09.023340 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:09.023353 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:09.023377 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:09.024942 (+ 1565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:09.025352 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:09.025357 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:09.025358 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:09.025435 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:09.025673 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:09.025676 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:09.025677 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:09.025905 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:09.026080 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:09.026246 (+ 166us) server_negotiation.cc:299] Negotiation successful
0809 15:31:09.026424 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
W20260809 15:31:09.030488 18283 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:09.029456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32776 (local address 127.11.146.1:41065)
0809 15:31:09.029584 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:09.029588 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:09.029706 (+ 118us) server_negotiation.cc:407] Connection header received
0809 15:31:09.029839 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:09.029841 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:09.029885 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:09.029969 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:09.030376 (+ 407us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32776: BlockingRecv error: recv got EOF from 127.0.0.1:32776 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260809 15:31:09.030661 11848 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/krb5cc' of type FILE
Aug 09 15:31:09 dist-test-slave-1jjb krb5kdc[17746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289469, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:09.031798 11848 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 15:31:09 dist-test-slave-1jjb krb5kdc[17746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289469, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:09.032722 11848 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 15:31:09 dist-test-slave-1jjb krb5kdc[17746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289469, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.1@KRBTEST.COM
I20260809 15:31:09.041657 18283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:09.033584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32784 (local address 127.11.146.1:41065)
0809 15:31:09.033713 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:09.033717 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:09.033824 (+ 107us) server_negotiation.cc:407] Connection header received
0809 15:31:09.033966 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:09.033969 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:09.034011 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:09.034090 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:09.034583 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:09.035104 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:09.035919 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:09.036242 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:09.036357 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:09.038618 (+ 2261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:09.038622 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:09.038625 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:09.038650 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:09.039909 (+ 1259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:09.040384 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:09.040389 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:09.040391 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:09.040475 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:09.040770 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:09.040774 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:09.040776 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:09.040947 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:09.041081 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:09.041362 (+ 281us) server_negotiation.cc:299] Negotiation successful
0809 15:31:09.041473 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
W20260809 15:31:09.044641 18283 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:09.043609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32788 (local address 127.11.146.1:41065)
0809 15:31:09.043755 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:09.043760 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:09.043871 (+ 111us) server_negotiation.cc:407] Connection header received
0809 15:31:09.043987 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:09.043990 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:09.044026 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:09.044166 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:09.044553 (+ 387us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32788: BlockingRecv error: recv got EOF from 127.0.0.1:32788 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260809 15:31:09.044880 11848 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786289437399694-11848-0/krb5kdc/krb5cc' of type FILE
Aug 09 15:31:09 dist-test-slave-1jjb krb5kdc[17746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289469, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:09.045840 11848 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 15:31:09 dist-test-slave-1jjb krb5kdc[17746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289469, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:09.046691 11848 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 15:31:09 dist-test-slave-1jjb krb5kdc[17746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289469, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.1@KRBTEST.COM
I20260809 15:31:09.054693 18283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:09.047495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32798 (local address 127.11.146.1:41065)
0809 15:31:09.047619 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:09.047622 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:09.047742 (+ 120us) server_negotiation.cc:407] Connection header received
0809 15:31:09.047831 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:09.047833 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:09.047864 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:09.047927 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:09.048477 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:09.048935 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:09.049688 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:09.049885 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:09.049958 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:09.052176 (+ 2218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:09.052179 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:09.052181 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:09.052202 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:09.053372 (+ 1170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:09.053754 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:09.053756 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:09.053757 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:09.053827 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:09.054055 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:09.054057 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:09.054058 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:09.054202 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:09.054294 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:09.054503 (+ 209us) server_negotiation.cc:299] Negotiation successful
0809 15:31:09.054588 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 15:31:09.055787 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 17858
I20260809 15:31:09.063952 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 17998
I20260809 15:31:09.072188 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 18143
I20260809 15:31:09.080693 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 17759
2026-08-09T15:31:09Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2299 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:31:09 dist-test-slave-1jjb krb5kdc[18298](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:31:09 dist-test-slave-1jjb krb5kdc[18298](info): set up 2 sockets
Aug 09 15:31:09 dist-test-slave-1jjb krb5kdc[18298](info): commencing operation
krb5kdc: starting...
W20260809 15:31:10.198858 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.094s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:31:10 dist-test-slave-1jjb krb5kdc[18298](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289470, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:31:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:31:10Z Disabled control of system clock
WARNING: no policy specified for oryx/127.11.146.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.146.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.146.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.62.keytab.
Entry for principal oryx/127.11.146.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.62.keytab.
I20260809 15:31:10.340036 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:40039
--webserver_interface=127.11.146.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.62.keytab
--principal=oryx/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:44781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:40039
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:31:10.462670 18312 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:10.462997 18312 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:10.463073 18312 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:10.467309 18312 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:31:10.467408 18312 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:10.467447 18312 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:10.467492 18312 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:31:10.467527 18312 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:31:10.473516 18312 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:44781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:40039
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.62.keytab
--principal=oryx/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:40039
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18312
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:10.474733 18312 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:10.475970 18312 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:10.485421 18320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:10.485421 18317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:10.485551 18318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:10.485608 18312 server_base.cc:1034] running on GCE node
I20260809 15:31:10.486457 18312 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:10.487649 18312 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:10.488847 18312 hybrid_clock.cc:648] HybridClock initialized: now 1786289470488826 us; error 32 us; skew 500 ppm
Aug 09 15:31:10 dist-test-slave-1jjb krb5kdc[18298](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289470, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:10.492013 18312 init.cc:377] Logged in from keytab as oryx/127.11.146.62@KRBTEST.COM (short username oryx)
I20260809 15:31:10.493109 18312 webserver.cc:460] Webserver started at http://127.11.146.62:42507/ using document root <none> and password file <none>
I20260809 15:31:10.493728 18312 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:10.493795 18312 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:10.494100 18312 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:10.496551 18312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "f57efaf1e2f9446bbf8749519c42eb75"
format_stamp: "Formatted at 2026-08-09 15:31:10 on dist-test-slave-1jjb"
server_key: "b32a7cc4d3fbae5660f0a4617b9ac004"
server_key_iv: "2b991d6c275067a72109617060eeb356"
server_key_version: "encryptionkey@0"
I20260809 15:31:10.497148 18312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "f57efaf1e2f9446bbf8749519c42eb75"
format_stamp: "Formatted at 2026-08-09 15:31:10 on dist-test-slave-1jjb"
server_key: "b32a7cc4d3fbae5660f0a4617b9ac004"
server_key_iv: "2b991d6c275067a72109617060eeb356"
server_key_version: "encryptionkey@0"
I20260809 15:31:10.501045 18312 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 15:31:10.503692 18328 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:10.505170 18312 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 15:31:10.505322 18312 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "f57efaf1e2f9446bbf8749519c42eb75"
format_stamp: "Formatted at 2026-08-09 15:31:10 on dist-test-slave-1jjb"
server_key: "b32a7cc4d3fbae5660f0a4617b9ac004"
server_key_iv: "2b991d6c275067a72109617060eeb356"
server_key_version: "encryptionkey@0"
I20260809 15:31:10.505476 18312 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:10.527459 18312 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:10.531057 18312 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:10.531282 18312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:10.538929 18312 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:40039
I20260809 15:31:10.539227 18381 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:40039 every 8 connection(s)
I20260809 15:31:10.540134 18312 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:31:10.542927 18382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:10.548619 18382 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75: Bootstrap starting.
I20260809 15:31:10.548645 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 18312
I20260809 15:31:10.548771 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:31:10.549091 11848 external_mini_cluster.cc:1428] Setting key 990056eef9d1847c4ada8e4b51b0ea2e
I20260809 15:31:10.551312 18382 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:10.552382 18382 log.cc:824] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75: Log is configured to *not* fsync() on all Append() calls
I20260809 15:31:10.554535 18382 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75: No bootstrap required, opened a new log
Aug 09 15:31:10 dist-test-slave-1jjb krb5kdc[18298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289470, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM
I20260809 15:31:10.558406 18382 raft_consensus.cc:348] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } }
I20260809 15:31:10.558763 18382 raft_consensus.cc:374] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:10.558876 18382 raft_consensus.cc:729] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f57efaf1e2f9446bbf8749519c42eb75, State: Initialized, Role: FOLLOWER
I20260809 15:31:10.559402 18382 consensus_queue.cc:260] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } }
I20260809 15:31:10.559561 18382 raft_consensus.cc:388] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:31:10.559631 18382 raft_consensus.cc:482] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:31:10.559779 18382 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:10.560827 18382 raft_consensus.cc:504] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } }
I20260809 15:31:10.561192 18382 leader_election.cc:302] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f57efaf1e2f9446bbf8749519c42eb75; no voters:
I20260809 15:31:10.561554 18382 leader_election.cc:288] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:31:10.561621 18388 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:31:10.561836 18388 raft_consensus.cc:686] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [term 1 LEADER]: Becoming Leader. State: Replica: f57efaf1e2f9446bbf8749519c42eb75, State: Running, Role: LEADER
I20260809 15:31:10.562194 18388 consensus_queue.cc:237] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } }
I20260809 15:31:10.562923 18382 sys_catalog.cc:564] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:31:10.563810 18389 sys_catalog.cc:455] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f57efaf1e2f9446bbf8749519c42eb75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } }
I20260809 15:31:10.564227 18389 sys_catalog.cc:458] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:10.564131 18391 sys_catalog.cc:455] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f57efaf1e2f9446bbf8749519c42eb75. Latest consensus state: current_term: 1 leader_uuid: "f57efaf1e2f9446bbf8749519c42eb75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } }
I20260809 15:31:10.564569 18391 sys_catalog.cc:458] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:10.564627 18385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:10.550449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34154 (local address 127.11.146.62:40039)
0809 15:31:10.550872 (+ 423us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:10.550888 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:10.550923 (+ 35us) server_negotiation.cc:407] Connection header received
0809 15:31:10.551764 (+ 841us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:10.551787 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:10.552271 (+ 484us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:10.552648 (+ 377us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:10.553575 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:10.554690 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:10.555820 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:10.556373 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:10.556595 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:10.559150 (+ 2555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:10.559155 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:10.559169 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:10.559197 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:10.561095 (+ 1898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:10.561589 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:10.561595 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:10.561601 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:10.561839 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:10.562156 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:10.562161 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:10.562163 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:10.562639 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:10.562852 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:10.563160 (+ 308us) server_negotiation.cc:299] Negotiation successful
0809 15:31:10.563513 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":134,"threads_started":1}
I20260809 15:31:10.565753 18399 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:31:10.568972 18399 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:31:10.574424 18399 catalog_manager.cc:1347] Generated new cluster ID: 748ddb72d29049e8886e1c4a8a559dae
I20260809 15:31:10.574492 18399 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:31:10.587105 18399 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:31:10.588167 18399 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:31:10.596719 18399 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75: Generated new TSK 0
I20260809 15:31:10.597465 18399 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.11.146.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.146.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.146.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.1.keytab.
Entry for principal oryx/127.11.146.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.1.keytab.
I20260809 15:31:10.632488 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.1:0
--local_ip_for_outbound_sockets=127.11.146.1
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:40039
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.1.keytab
--principal=oryx/127.11.146.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:44781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:31:10.756047 18412 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:10.756417 18412 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:10.756465 18412 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:10.760648 18412 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:10.760715 18412 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:10.760775 18412 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.1
I20260809 15:31:10.766587 18412 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:44781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.1.keytab
--principal=oryx/127.11.146.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:40039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18412
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.1
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:10.767693 18412 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:10.768748 18412 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 15:31:10.780418 18412 server_base.cc:1034] running on GCE node
W20260809 15:31:10.780330 18417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:10.780383 18418 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:10.780329 18421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:10.781180 18412 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:10.781888 18412 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:10.783102 18412 hybrid_clock.cc:648] HybridClock initialized: now 1786289470783059 us; error 56 us; skew 500 ppm
Aug 09 15:31:10 dist-test-slave-1jjb krb5kdc[18298](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289470, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:10.786386 18412 init.cc:377] Logged in from keytab as oryx/127.11.146.1@KRBTEST.COM (short username oryx)
I20260809 15:31:10.787357 18412 webserver.cc:460] Webserver started at http://127.11.146.1:44641/ using document root <none> and password file <none>
I20260809 15:31:10.787969 18412 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:10.788033 18412 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:10.788296 18412 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:10.790488 18412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-0/data/instance:
uuid: "3911b5d8312f41a7abb4264402dcc625"
format_stamp: "Formatted at 2026-08-09 15:31:10 on dist-test-slave-1jjb"
server_key: "4f376de16d9cd2494704c320121fd65b"
server_key_iv: "2d42f69d802433c0045dacac9e7755e4"
server_key_version: "encryptionkey@0"
I20260809 15:31:10.791102 18412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance:
uuid: "3911b5d8312f41a7abb4264402dcc625"
format_stamp: "Formatted at 2026-08-09 15:31:10 on dist-test-slave-1jjb"
server_key: "4f376de16d9cd2494704c320121fd65b"
server_key_iv: "2d42f69d802433c0045dacac9e7755e4"
server_key_version: "encryptionkey@0"
I20260809 15:31:10.795416 18412 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.005s
I20260809 15:31:10.798591 18428 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:10.800165 18412 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:31:10.800319 18412 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-0/wal
uuid: "3911b5d8312f41a7abb4264402dcc625"
format_stamp: "Formatted at 2026-08-09 15:31:10 on dist-test-slave-1jjb"
server_key: "4f376de16d9cd2494704c320121fd65b"
server_key_iv: "2d42f69d802433c0045dacac9e7755e4"
server_key_version: "encryptionkey@0"
I20260809 15:31:10.800457 18412 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:10.813213 18412 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:10.817597 18412 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:10.817857 18412 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:10.818572 18412 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:31:10.819545 18412 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:10.819626 18412 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:10.819715 18412 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:10.819774 18412 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:10.830338 18412 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.1:37663
I20260809 15:31:10.830384 18547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.1:37663 every 8 connection(s)
I20260809 15:31:10.831300 18412 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
I20260809 15:31:10.841068 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 18412
I20260809 15:31:10.841182 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance
I20260809 15:31:10.841601 11848 external_mini_cluster.cc:1428] Setting key 651d47cb47b6f8636d2ee90a3835fc71
Aug 09 15:31:10 dist-test-slave-1jjb krb5kdc[18298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289470, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM
I20260809 15:31:10.847308 18385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:10.833417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:47945 (local address 127.11.146.62:40039)
0809 15:31:10.833612 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:10.833616 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:10.834492 (+ 876us) server_negotiation.cc:407] Connection header received
0809 15:31:10.835945 (+ 1453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:10.835949 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:10.836013 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:10.836176 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:10.837467 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:10.838027 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:10.839226 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:10.839473 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:10.839790 (+ 317us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:10.842864 (+ 3074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:10.842868 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:10.842870 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:10.842895 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:10.844663 (+ 1768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:10.845391 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:10.845394 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:10.845395 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:10.845541 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:10.845938 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:10.845943 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:10.845945 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:10.846208 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:10.846321 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:10.846908 (+ 587us) server_negotiation.cc:299] Negotiation successful
0809 15:31:10.847065 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260809 15:31:10.848143 18550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:10.833782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.11.146.1:47945)
0809 15:31:10.834308 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:10.834355 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:10.835717 (+ 1362us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:10.836383 (+ 666us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:10.836390 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:10.836769 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:10.837301 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:10.837316 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:10.838167 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:10.838171 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:10.839084 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:10.839095 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:10.839838 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:10.839843 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:10.840036 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:10.840729 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:10.840745 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:10.842657 (+ 1912us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:10.844815 (+ 2158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:10.844824 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:10.844844 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:10.845263 (+ 419us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:10.845670 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:10.845674 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:10.845676 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:10.845836 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:10.846338 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:10.846344 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:10.846648 (+ 304us) client_negotiation.cc:769] Sending connection context
0809 15:31:10.846826 (+ 178us) client_negotiation.cc:240] Negotiation successful
0809 15:31:10.847110 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":126,"threads_started":1}
I20260809 15:31:10.849665 18548 heartbeater.cc:347] Connected to a master server at 127.11.146.62:40039
I20260809 15:31:10.849941 18548 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:10.850469 18548 heartbeater.cc:511] Master 127.11.146.62:40039 requested a full tablet report, sending...
I20260809 15:31:10.852663 18345 ts_manager.cc:194] Registered new tserver with Master: 3911b5d8312f41a7abb4264402dcc625 (127.11.146.1:37663)
WARNING: no policy specified for oryx/127.11.146.2@KRBTEST.COM; defaulting to no policy
I20260809 15:31:10.853897 18345 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.146.1@KRBTEST.COM'} at 127.11.146.1:47945
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.146.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.146.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.2.keytab.
Entry for principal oryx/127.11.146.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.2.keytab.
I20260809 15:31:10.876211 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.2:0
--local_ip_for_outbound_sockets=127.11.146.2
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:40039
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.2.keytab
--principal=oryx/127.11.146.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:44781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:31:11.003234 18553 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:11.003556 18553 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:11.003638 18553 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:11.008105 18553 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:11.008205 18553 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:11.008304 18553 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.2
I20260809 15:31:11.014290 18553 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:44781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.2.keytab
--principal=oryx/127.11.146.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:40039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18553
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.2
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:11.015556 18553 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:11.016707 18553 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:11.027297 18561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:11.027281 18558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:11.027354 18553 server_base.cc:1034] running on GCE node
W20260809 15:31:11.027251 18559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:11.027983 18553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:11.028719 18553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:11.029929 18553 hybrid_clock.cc:648] HybridClock initialized: now 1786289471029908 us; error 34 us; skew 500 ppm
Aug 09 15:31:11 dist-test-slave-1jjb krb5kdc[18298](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289471, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:11.033010 18553 init.cc:377] Logged in from keytab as oryx/127.11.146.2@KRBTEST.COM (short username oryx)
I20260809 15:31:11.033900 18553 webserver.cc:460] Webserver started at http://127.11.146.2:44343/ using document root <none> and password file <none>
I20260809 15:31:11.034546 18553 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:11.034639 18553 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:11.034881 18553 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:11.037592 18553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-1/data/instance:
uuid: "5ddb4be8bc354f3fa2d90f8f5f722ba0"
format_stamp: "Formatted at 2026-08-09 15:31:11 on dist-test-slave-1jjb"
server_key: "8f6b01896b57285c53ddcb0dbdec0565"
server_key_iv: "92020532f74eb875d3097073361ea580"
server_key_version: "encryptionkey@0"
I20260809 15:31:11.038221 18553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance:
uuid: "5ddb4be8bc354f3fa2d90f8f5f722ba0"
format_stamp: "Formatted at 2026-08-09 15:31:11 on dist-test-slave-1jjb"
server_key: "8f6b01896b57285c53ddcb0dbdec0565"
server_key_iv: "92020532f74eb875d3097073361ea580"
server_key_version: "encryptionkey@0"
I20260809 15:31:11.042387 18553 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 15:31:11.045003 18568 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:11.046298 18553 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:31:11.046448 18553 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-1/wal
uuid: "5ddb4be8bc354f3fa2d90f8f5f722ba0"
format_stamp: "Formatted at 2026-08-09 15:31:11 on dist-test-slave-1jjb"
server_key: "8f6b01896b57285c53ddcb0dbdec0565"
server_key_iv: "92020532f74eb875d3097073361ea580"
server_key_version: "encryptionkey@0"
I20260809 15:31:11.046568 18553 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:11.058025 18553 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:11.061537 18553 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:11.061753 18553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:11.062376 18553 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:31:11.063227 18553 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:11.063299 18553 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:11.063365 18553 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:11.063402 18553 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:11.072727 18553 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.2:37007
I20260809 15:31:11.072757 18686 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.2:37007 every 8 connection(s)
I20260809 15:31:11.073616 18553 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
I20260809 15:31:11.075225 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 18553
I20260809 15:31:11.075366 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance
I20260809 15:31:11.075680 11848 external_mini_cluster.cc:1428] Setting key a5412ba3417d027679f7e12797c62f4f
Aug 09 15:31:11 dist-test-slave-1jjb krb5kdc[18298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289471, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM
WARNING: no policy specified for oryx/127.11.146.3@KRBTEST.COM; defaulting to no policy
I20260809 15:31:11.088183 18385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:11.075671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:56053 (local address 127.11.146.62:40039)
0809 15:31:11.075819 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:11.075823 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:11.076987 (+ 1164us) server_negotiation.cc:407] Connection header received
0809 15:31:11.078402 (+ 1415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:11.078406 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:11.078458 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:11.078538 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:11.079725 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.080350 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.081483 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.081710 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.081818 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:11.084419 (+ 2601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:11.084423 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:11.084426 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:11.084456 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:11.085970 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:11.086542 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:11.086549 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:11.086553 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:11.086639 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:11.087029 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:11.087033 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:11.087034 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:11.087228 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:11.087341 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:11.087850 (+ 509us) server_negotiation.cc:299] Negotiation successful
0809 15:31:11.087984 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.146.3@KRBTEST.COM" created.
I20260809 15:31:11.089128 18689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:11.076194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.11.146.2:56053)
0809 15:31:11.076802 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:11.076858 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:11.078190 (+ 1332us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:11.078715 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:11.078722 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:11.079078 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:11.079567 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:11.079590 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.080475 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.080481 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:11.081351 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:11.081361 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.081871 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.081875 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:11.082045 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:11.082727 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:11.082744 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:11.084255 (+ 1511us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:11.086104 (+ 1849us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:11.086110 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:11.086125 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:11.086435 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:11.086736 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:11.086740 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:11.086742 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:11.086884 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:11.087338 (+ 454us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:11.087344 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:11.087608 (+ 264us) client_negotiation.cc:769] Sending connection context
0809 15:31:11.087805 (+ 197us) client_negotiation.cc:240] Negotiation successful
0809 15:31:11.088188 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":155,"threads_started":1}
I20260809 15:31:11.090353 18687 heartbeater.cc:347] Connected to a master server at 127.11.146.62:40039
I20260809 15:31:11.090627 18687 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:11.091166 18687 heartbeater.cc:511] Master 127.11.146.62:40039 requested a full tablet report, sending...
I20260809 15:31:11.092514 18345 ts_manager.cc:194] Registered new tserver with Master: 5ddb4be8bc354f3fa2d90f8f5f722ba0 (127.11.146.2:37007)
I20260809 15:31:11.093395 18345 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.146.2@KRBTEST.COM'} at 127.11.146.2:56053
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.146.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.3.keytab.
Entry for principal oryx/127.11.146.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.3.keytab.
I20260809 15:31:11.107600 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.3:0
--local_ip_for_outbound_sockets=127.11.146.3
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:40039
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.3.keytab
--principal=oryx/127.11.146.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:44781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:31:11.223803 18692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:11.224053 18692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:11.224179 18692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:11.228262 18692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:11.228322 18692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:11.228402 18692 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.3
I20260809 15:31:11.234194 18692 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:44781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.3.keytab
--principal=oryx/127.11.146.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:40039
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18692
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.3
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:11.235494 18692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:11.236778 18692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:11.247156 18702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:11.247236 18692 server_base.cc:1034] running on GCE node
W20260809 15:31:11.247164 18700 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:11.247177 18697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:11.247936 18692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:11.248587 18692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:11.249750 18692 hybrid_clock.cc:648] HybridClock initialized: now 1786289471249736 us; error 24 us; skew 500 ppm
Aug 09 15:31:11 dist-test-slave-1jjb krb5kdc[18298](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289471, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:11.252744 18692 init.cc:377] Logged in from keytab as oryx/127.11.146.3@KRBTEST.COM (short username oryx)
I20260809 15:31:11.253629 18692 webserver.cc:460] Webserver started at http://127.11.146.3:41525/ using document root <none> and password file <none>
I20260809 15:31:11.254204 18692 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:11.254267 18692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:11.254496 18692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:11.256870 18692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-2/data/instance:
uuid: "1241cab0d60e4684834cdd1d140b5d86"
format_stamp: "Formatted at 2026-08-09 15:31:11 on dist-test-slave-1jjb"
server_key: "8b149cedd7798d22230aec0ee0b1ae2c"
server_key_iv: "a95469c01fb549b9d7a1ecee90941bf8"
server_key_version: "encryptionkey@0"
I20260809 15:31:11.257452 18692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance:
uuid: "1241cab0d60e4684834cdd1d140b5d86"
format_stamp: "Formatted at 2026-08-09 15:31:11 on dist-test-slave-1jjb"
server_key: "8b149cedd7798d22230aec0ee0b1ae2c"
server_key_iv: "a95469c01fb549b9d7a1ecee90941bf8"
server_key_version: "encryptionkey@0"
I20260809 15:31:11.261158 18692 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20260809 15:31:11.263691 18709 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:11.265204 18692 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:31:11.265340 18692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-2/wal
uuid: "1241cab0d60e4684834cdd1d140b5d86"
format_stamp: "Formatted at 2026-08-09 15:31:11 on dist-test-slave-1jjb"
server_key: "8b149cedd7798d22230aec0ee0b1ae2c"
server_key_iv: "a95469c01fb549b9d7a1ecee90941bf8"
server_key_version: "encryptionkey@0"
I20260809 15:31:11.265455 18692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:11.288525 18692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:11.291684 18692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:11.291900 18692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:11.292794 18692 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:31:11.293859 18692 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:11.294034 18692 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:11.294113 18692 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:11.294165 18692 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:11.304472 18692 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.3:37151
I20260809 15:31:11.304554 18825 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.3:37151 every 8 connection(s)
I20260809 15:31:11.305460 18692 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
I20260809 15:31:11.305727 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 18692
I20260809 15:31:11.305878 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance
I20260809 15:31:11.306253 11848 external_mini_cluster.cc:1428] Setting key a13eb6c7fd53a7080920c624ca9b8406
Aug 09 15:31:11 dist-test-slave-1jjb krb5kdc[18298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289471, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM
I20260809 15:31:11.320842 18385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:11.307546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:45821 (local address 127.11.146.62:40039)
0809 15:31:11.307698 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:11.307701 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:11.308892 (+ 1191us) server_negotiation.cc:407] Connection header received
0809 15:31:11.310513 (+ 1621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:11.310515 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:11.310562 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:11.310629 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:11.311948 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.312562 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.313921 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.314325 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.314430 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:11.317097 (+ 2667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:11.317101 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:11.317104 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:11.317134 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:11.318418 (+ 1284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:11.318956 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:11.318960 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:11.318962 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:11.319070 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:11.319518 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:11.319521 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:11.319522 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:11.319714 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:11.319846 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:11.320512 (+ 666us) server_negotiation.cc:299] Negotiation successful
0809 15:31:11.320651 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 15:31:11.321727 18828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:11.308141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.11.146.3:45821)
0809 15:31:11.308699 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:11.308759 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:11.310312 (+ 1553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:11.310818 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:11.310826 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:11.311228 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:11.311792 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:11.311807 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.312691 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.312694 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:11.313753 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:11.313780 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.314477 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.314482 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:11.314691 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:11.315358 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:11.315376 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:11.316917 (+ 1541us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:11.318551 (+ 1634us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:11.318557 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:11.318572 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:11.318826 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:11.319188 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:11.319194 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:11.319199 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:11.319383 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:11.319842 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:11.319848 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:11.320217 (+ 369us) client_negotiation.cc:769] Sending connection context
0809 15:31:11.320452 (+ 235us) client_negotiation.cc:240] Negotiation successful
0809 15:31:11.320800 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":147,"threads_started":1}
I20260809 15:31:11.322918 18826 heartbeater.cc:347] Connected to a master server at 127.11.146.62:40039
I20260809 15:31:11.323174 18826 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:11.323661 18826 heartbeater.cc:511] Master 127.11.146.62:40039 requested a full tablet report, sending...
I20260809 15:31:11.324841 18345 ts_manager.cc:194] Registered new tserver with Master: 1241cab0d60e4684834cdd1d140b5d86 (127.11.146.3:37151)
I20260809 15:31:11.325415 18345 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.146.3@KRBTEST.COM'} at 127.11.146.3:45821
I20260809 15:31:11.333077 11848 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.11.146.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.146.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.146.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.61.keytab.
Entry for principal oryx/127.11.146.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.61.keytab.
I20260809 15:31:11.363433 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.61:33205
--webserver_interface=127.11.146.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.61.keytab
--principal=oryx/127.11.146.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:44781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:40039,127.11.146.61:33205
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:31:11.484841 18831 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:11.485108 18831 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:11.485191 18831 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:11.489301 18831 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:31:11.489357 18831 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:11.489377 18831 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:11.489393 18831 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:31:11.489446 18831 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:31:11.495151 18831 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:44781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:40039,127.11.146.61:33205
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.61.keytab
--principal=oryx/127.11.146.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.61:33205
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.146.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18831
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
W20260809 15:31:11.495388 18831 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.11.146.62:40039,127.11.146.61:33205'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260809 15:31:11.496356 18831 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:11.497417 18831 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:11.506146 18840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:11.506174 18837 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:11.506174 18838 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:11.506533 18831 server_base.cc:1034] running on GCE node
I20260809 15:31:11.507071 18831 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:11.508169 18831 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:11.509361 18831 hybrid_clock.cc:648] HybridClock initialized: now 1786289471509331 us; error 35 us; skew 500 ppm
Aug 09 15:31:11 dist-test-slave-1jjb krb5kdc[18298](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289471, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:11.512382 18831 init.cc:377] Logged in from keytab as oryx/127.11.146.61@KRBTEST.COM (short username oryx)
I20260809 15:31:11.513263 18831 webserver.cc:460] Webserver started at http://127.11.146.61:38797/ using document root <none> and password file <none>
I20260809 15:31:11.513849 18831 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:11.513942 18831 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:11.514185 18831 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:11.516526 18831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-1/data/instance:
uuid: "e6aa47478e2e4531ac29d13cbb23eb63"
format_stamp: "Formatted at 2026-08-09 15:31:11 on dist-test-slave-1jjb"
server_key: "d3ab4221e0797ee58ec53837d24479e5"
server_key_iv: "f152793bf81db6dc55dbfba4b26eba18"
server_key_version: "encryptionkey@0"
I20260809 15:31:11.517117 18831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-1/wal/instance:
uuid: "e6aa47478e2e4531ac29d13cbb23eb63"
format_stamp: "Formatted at 2026-08-09 15:31:11 on dist-test-slave-1jjb"
server_key: "d3ab4221e0797ee58ec53837d24479e5"
server_key_iv: "f152793bf81db6dc55dbfba4b26eba18"
server_key_version: "encryptionkey@0"
I20260809 15:31:11.521039 18831 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 15:31:11.523531 18847 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:11.524861 18831 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 15:31:11.525022 18831 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-1/wal
uuid: "e6aa47478e2e4531ac29d13cbb23eb63"
format_stamp: "Formatted at 2026-08-09 15:31:11 on dist-test-slave-1jjb"
server_key: "d3ab4221e0797ee58ec53837d24479e5"
server_key_iv: "f152793bf81db6dc55dbfba4b26eba18"
server_key_version: "encryptionkey@0"
I20260809 15:31:11.525143 18831 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:11.549552 18831 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:11.553097 18831 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:11.553316 18831 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:11.561569 18831 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.61:33205
I20260809 15:31:11.561861 18901 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.61:33205 every 8 connection(s)
I20260809 15:31:11.562801 18831 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-1/data/info.pb
I20260809 15:31:11.565966 18902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:11.570580 18902 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:31:11.571313 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 18831
Aug 09 15:31:11 dist-test-slave-1jjb krb5kdc[18298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289471, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.61@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM
Aug 09 15:31:11 dist-test-slave-1jjb krb5kdc[18298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289470, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.146.61@KRBTEST.COM
I20260809 15:31:11.585987 18385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:11.572897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41756 (local address 127.11.146.62:40039)
0809 15:31:11.573096 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:11.573100 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:11.574089 (+ 989us) server_negotiation.cc:407] Connection header received
0809 15:31:11.575130 (+ 1041us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:11.575134 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:11.575209 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:11.575306 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:11.576189 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.576748 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.577815 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.578052 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.578167 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:11.581266 (+ 3099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:11.581272 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:11.581275 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:11.581308 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:11.583310 (+ 2002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:11.583874 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:11.583880 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:11.583883 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:11.583988 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:11.584533 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:11.584541 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:11.584542 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:11.584896 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:11.584983 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:11.585632 (+ 649us) server_negotiation.cc:299] Negotiation successful
0809 15:31:11.585790 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260809 15:31:11.586932 18907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:11.574322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56910 (local address 127.11.146.61:33205)
0809 15:31:11.574704 (+ 382us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:11.574717 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:11.574767 (+ 50us) server_negotiation.cc:407] Connection header received
0809 15:31:11.574899 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:11.574913 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:11.575098 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:11.575299 (+ 201us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:11.576192 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.577579 (+ 1387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.578482 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.578834 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.578965 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:11.581824 (+ 2859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:11.581835 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:11.581852 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:11.581883 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:11.584017 (+ 2134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:11.584587 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:11.584596 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:11.584600 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:11.584691 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:11.585063 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:11.585066 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:11.585067 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:11.585352 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:11.585566 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:11.585819 (+ 253us) server_negotiation.cc:299] Negotiation successful
0809 15:31:11.586131 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":105,"threads_started":1}
I20260809 15:31:11.586935 18905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:11.573336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.0.0.1:41756)
0809 15:31:11.573859 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:11.573914 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:11.574893 (+ 979us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:11.575363 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:11.575368 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:11.575748 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:11.576012 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:11.576026 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.576887 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.576890 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:11.577680 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:11.577690 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.578220 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.578225 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:11.578420 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:11.579074 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:11.579091 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:11.581075 (+ 1984us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:11.583454 (+ 2379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:11.583461 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:11.583470 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:11.583754 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:11.584151 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:11.584154 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:11.584156 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:11.584387 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:11.585032 (+ 645us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:11.585040 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:11.585318 (+ 278us) client_negotiation.cc:769] Sending connection context
0809 15:31:11.585523 (+ 205us) client_negotiation.cc:240] Negotiation successful
0809 15:31:11.585899 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":154,"threads_started":1}
I20260809 15:31:11.588752 18902 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 15:31:11 dist-test-slave-1jjb krb5kdc[18298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289471, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.61@KRBTEST.COM for oryx/127.11.146.61@KRBTEST.COM
I20260809 15:31:11.597118 18907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:11.589398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56926 (local address 127.11.146.61:33205)
0809 15:31:11.589518 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:11.589521 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:11.589553 (+ 32us) server_negotiation.cc:407] Connection header received
0809 15:31:11.589593 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:11.589596 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:11.589634 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:11.589713 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:11.590113 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.590649 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.591366 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.592318 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.592414 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:11.594296 (+ 1882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:11.594298 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:11.594300 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:11.594319 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:11.595494 (+ 1175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:11.595995 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:11.595997 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:11.595998 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:11.596126 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:11.596374 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:11.596376 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:11.596377 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:11.596532 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:11.596607 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:11.596853 (+ 246us) server_negotiation.cc:299] Negotiation successful
0809 15:31:11.596973 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":41}
I20260809 15:31:11.597167 18905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:11.589296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:33205 (local address 127.0.0.1:56926)
0809 15:31:11.589428 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:11.589446 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:11.589525 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:11.589805 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:11.589807 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:11.589933 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:11.590006 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:11.590011 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.590754 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.590756 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:11.591244 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:11.591251 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.592442 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.592445 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:11.592534 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:11.593004 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:11.593016 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:11.594176 (+ 1160us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:11.595693 (+ 1517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:11.595696 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:11.595697 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:11.595894 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:11.596211 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:11.596213 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:11.596214 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:11.596292 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:11.596619 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:11.596621 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:11.596696 (+ 75us) client_negotiation.cc:769] Sending connection context
0809 15:31:11.596776 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 15:31:11.596923 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260809 15:31:11.599961 18902 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63: Bootstrap starting.
I20260809 15:31:11.602280 18902 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:11.603006 18902 log.cc:824] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63: Log is configured to *not* fsync() on all Append() calls
I20260809 15:31:11.605253 18902 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63: No bootstrap required, opened a new log
I20260809 15:31:11.608294 18902 raft_consensus.cc:348] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } }
I20260809 15:31:11.608516 18902 raft_consensus.cc:374] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:11.608599 18902 raft_consensus.cc:729] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6aa47478e2e4531ac29d13cbb23eb63, State: Initialized, Role: FOLLOWER
I20260809 15:31:11.609031 18902 consensus_queue.cc:260] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } }
I20260809 15:31:11.609622 18909 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } } }
I20260809 15:31:11.609748 18909 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:31:11.610329 18902 sys_catalog.cc:564] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 15:31:11.615528 18920 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:31:11.615751 18920 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:31:11.617405 18831 master_runner.cc:428] Detected that this master e6aa47478e2e4531ac29d13cbb23eb63 is joining an existing cluster
I20260809 15:31:11.617475 18831 master_runner.cc:432] Initiating AddMaster RPC to add 127.11.146.61:33205
I20260809 15:31:11.628428 18927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:11.619911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:33205 (local address 127.0.0.1:56932)
0809 15:31:11.620273 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:11.620287 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:11.620389 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:11.620639 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:11.620642 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:11.620932 (+ 290us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:11.621076 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:11.621084 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.622108 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.622111 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:11.623026 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:11.623037 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.623487 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.623490 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:11.623580 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:11.624178 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:11.624193 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:11.624650 (+ 457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:11.626723 (+ 2073us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:11.626728 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:11.626733 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:11.626973 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:11.627281 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:11.627285 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:11.627287 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:11.627369 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:11.627815 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:11.627818 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:11.627922 (+ 104us) client_negotiation.cc:769] Sending connection context
0809 15:31:11.628029 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 15:31:11.628177 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":81,"threads_started":1}
I20260809 15:31:11.628445 18907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:11.619942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56932 (local address 127.11.146.61:33205)
0809 15:31:11.620125 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:11.620129 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:11.620349 (+ 220us) server_negotiation.cc:407] Connection header received
0809 15:31:11.620476 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:11.620479 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:11.620517 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:11.620596 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:11.621206 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.621970 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.623145 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.623359 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.623476 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:11.624792 (+ 1316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:11.624801 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:11.624803 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:11.624822 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:11.626612 (+ 1790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:11.627100 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:11.627104 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:11.627106 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:11.627191 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:11.627459 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:11.627464 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:11.627466 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:11.627697 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:11.627830 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:11.628174 (+ 344us) server_negotiation.cc:299] Negotiation successful
0809 15:31:11.628293 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 15:31:11.629681 18385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:11.619559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41768 (local address 127.11.146.62:40039)
0809 15:31:11.619691 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:11.619695 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:11.620285 (+ 590us) server_negotiation.cc:407] Connection header received
0809 15:31:11.620431 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:11.620437 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:11.620491 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:11.620571 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:11.621180 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.621976 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.624192 (+ 2216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.624525 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.624645 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:11.625915 (+ 1270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:11.625926 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:11.625928 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:11.625953 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:11.627542 (+ 1589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:11.628009 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:11.628012 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:11.628014 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:11.628150 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:11.628494 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:11.628498 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:11.628500 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:11.628739 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:11.628859 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:11.629453 (+ 594us) server_negotiation.cc:299] Negotiation successful
0809 15:31:11.629574 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 15:31:11.630165 18928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:11.619460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.0.0.1:41768)
0809 15:31:11.620186 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:11.620200 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:11.620339 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:11.620711 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:11.620713 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:11.620931 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:11.621057 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:11.621063 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.623166 (+ 2103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.623169 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:11.624048 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:11.624060 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.624661 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.624665 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:11.624761 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:11.625241 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:11.625256 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:11.625736 (+ 480us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:11.627648 (+ 1912us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:11.627651 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:11.627653 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:11.627912 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:11.628263 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:11.628266 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:11.628268 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:11.628378 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:11.629152 (+ 774us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:11.629155 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:11.629242 (+ 87us) client_negotiation.cc:769] Sending connection context
0809 15:31:11.629902 (+ 660us) client_negotiation.cc:240] Negotiation successful
0809 15:31:11.630043 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":647,"mutex_wait_us":1,"spinlock_wait_cycles":4480,"thread_start_us":116,"threads_started":1}
Aug 09 15:31:11 dist-test-slave-1jjb krb5kdc[18298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289470, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.62@KRBTEST.COM for oryx/127.11.146.61@KRBTEST.COM
I20260809 15:31:11.644580 18907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:11.634697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56936 (local address 127.11.146.61:33205)
0809 15:31:11.634815 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:11.634820 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:11.635170 (+ 350us) server_negotiation.cc:407] Connection header received
0809 15:31:11.635346 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:11.635348 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:11.635391 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:11.635456 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:11.636360 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.636820 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.638051 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.638250 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.638331 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:11.641006 (+ 2675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:11.641010 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:11.641012 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:11.641042 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:11.642498 (+ 1456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:11.643010 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:11.643017 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:11.643019 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:11.643111 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:11.643459 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:11.643463 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:11.643465 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:11.643692 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:11.643798 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:11.644292 (+ 494us) server_negotiation.cc:299] Negotiation successful
0809 15:31:11.644418 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 15:31:11.644961 18929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:11.634651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:33205 (local address 127.0.0.1:56936)
0809 15:31:11.635034 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:11.635086 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:11.635214 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:11.635515 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:11.635522 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:11.636058 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:11.636221 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:11.636229 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.636928 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.636932 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:11.637916 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:11.637928 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.638363 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.638367 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:11.638475 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:11.638965 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:11.638989 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:11.640858 (+ 1869us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:11.642629 (+ 1771us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:11.642638 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:11.642645 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:11.642898 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:11.643218 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:11.643221 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:11.643222 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:11.643321 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:11.643819 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:11.643830 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:11.644002 (+ 172us) client_negotiation.cc:769] Sending connection context
0809 15:31:11.644219 (+ 217us) client_negotiation.cc:240] Negotiation successful
0809 15:31:11.644462 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":103,"threads_started":1}
I20260809 15:31:11.646526 18345 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.11.146.61:33205: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63"
member_type: NON_VOTER
last_known_addr {
host: "127.11.146.61"
port: 33205
}
attrs {
promote: true
}
}
dest_uuid: "f57efaf1e2f9446bbf8749519c42eb75"
cas_config_opid_index: -1
I20260809 15:31:11.647323 18345 consensus_queue.cc:237] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: NON_VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: true } }
I20260809 15:31:11.649469 18932 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER e6aa47478e2e4531ac29d13cbb23eb63 (127.11.146.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: NON_VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: true } } }
I20260809 15:31:11.650419 18875 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:11.651866 18875 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [term 1 FOLLOWER]: Refusing update from remote peer f57efaf1e2f9446bbf8749519c42eb75: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260809 15:31:11.652174 18932 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.11.146.61:33205
I20260809 15:31:11.652774 18831 master.cc:537] Master@127.11.146.61:33205 shutting down...
I20260809 15:31:11.652810 18933 sys_catalog.cc:455] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "f57efaf1e2f9446bbf8749519c42eb75" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: NON_VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: true } } }
I20260809 15:31:11.652926 18933 sys_catalog.cc:458] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [sys.catalog]: This master's current role is: LEADER
WARNING: no policy specified for oryx/127.11.146.60@KRBTEST.COM; defaulting to no policy
I20260809 15:31:11.653712 18932 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: NON_VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.001s
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.146.60@KRBTEST.COM" created.
W20260809 15:31:11.656760 18332 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260809 15:31:11.657773 18332 consensus_peers.cc:487] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 -> Peer e6aa47478e2e4531ac29d13cbb23eb63 (127.11.146.61:33205): Couldn't send request to peer e6aa47478e2e4531ac29d13cbb23eb63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260809 15:31:11.658149 18831 raft_consensus.cc:2229] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:31:11.658459 18831 raft_consensus.cc:2258] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:31:11.658598 18831 tablet_replica.cc:330] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63: stopping tablet replica
I20260809 15:31:11.665117 18831 master.cc:552] Master@127.11.146.61:33205 shutdown complete.
I20260809 15:31:11.665215 18831 master_runner.cc:305] Clearing existing system tablet
I20260809 15:31:11.665513 18831 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:11.665617 18831 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:11.666963 18831 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 15:31:11.668855 18941 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:11.669133 18831 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:11.669265 18831 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 15:31:11.669298 18831 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-1/wal
uuid: "e6aa47478e2e4531ac29d13cbb23eb63"
format_stamp: "Formatted at 2026-08-09 15:31:11 on dist-test-slave-1jjb"
server_key: "d3ab4221e0797ee58ec53837d24479e5"
server_key_iv: "f152793bf81db6dc55dbfba4b26eba18"
server_key_version: "encryptionkey@0"
I20260809 15:31:11.671691 18831 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63: Deleting tablet data with delete state TABLET_DATA_DELETED
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.146.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.60.keytab.
Entry for principal oryx/127.11.146.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.60.keytab.
I20260809 15:31:11.675244 18831 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 15:31:11.675344 18831 log.cc:1196] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260809 15:31:11.675624 18831 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63: Deleting consensus metadata
I20260809 15:31:11.675611 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.60:45561
--webserver_interface=127.11.146.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.60.keytab
--principal=oryx/127.11.146.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:44781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:40039,127.11.146.61:33205,127.11.146.60:45561
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:31:11.675807 18831 master_runner.cc:315] Copying system tablet from 127.11.146.62:40039
I20260809 15:31:11.677302 18831 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63: tablet copy: Beginning tablet copy session from remote peer at address 127.11.146.62:40039
I20260809 15:31:11.686738 18385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:11.678106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41784 (local address 127.11.146.62:40039)
0809 15:31:11.678247 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:11.678256 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:11.679253 (+ 997us) server_negotiation.cc:407] Connection header received
0809 15:31:11.679414 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:11.679417 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:11.679471 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:11.679562 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:11.680030 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.680633 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.681553 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.681783 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.681895 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:11.683448 (+ 1553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:11.683452 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:11.683455 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:11.683488 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:11.685059 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:11.685498 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:11.685502 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:11.685503 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:11.685592 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:11.685873 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:11.685876 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:11.685878 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:11.686078 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:11.686190 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:11.686468 (+ 278us) server_negotiation.cc:299] Negotiation successful
0809 15:31:11.686581 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 15:31:11.686753 18948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:11.677995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.0.0.1:41784)
0809 15:31:11.679145 (+ 1150us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:11.679158 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:11.679301 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:11.679591 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:11.679594 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:11.679797 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:11.679904 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:11.679910 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.680765 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.680769 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:11.681428 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:11.681438 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.681904 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.681907 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:11.682003 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:11.682947 (+ 944us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:11.682959 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:11.683296 (+ 337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:11.685178 (+ 1882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:11.685183 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:11.685185 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:11.685395 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:11.685687 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:11.685691 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:11.685693 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:11.685781 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:11.686179 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:11.686182 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:11.686290 (+ 108us) client_negotiation.cc:769] Sending connection context
0809 15:31:11.686395 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 15:31:11.686557 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1079,"thread_start_us":105,"threads_started":1}
I20260809 15:31:11.688669 18366 tablet_copy_service.cc:140] P f57efaf1e2f9446bbf8749519c42eb75: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer e6aa47478e2e4531ac29d13cbb23eb63 ({username='oryx', principal='oryx/127.11.146.61@KRBTEST.COM'} at 127.0.0.1:41784)
I20260809 15:31:11.688864 18366 tablet_copy_service.cc:161] P f57efaf1e2f9446bbf8749519c42eb75: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer e6aa47478e2e4531ac29d13cbb23eb63 at {username='oryx', principal='oryx/127.11.146.61@KRBTEST.COM'} at 127.0.0.1:41784: session id = e6aa47478e2e4531ac29d13cbb23eb63-00000000000000000000000000000000
I20260809 15:31:11.690487 18366 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 15:31:11.692268 18831 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 15:31:11.694307 18831 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63: tablet copy: Starting download of 0 data blocks...
I20260809 15:31:11.694527 18831 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63: tablet copy: Starting download of 1 WAL segments...
I20260809 15:31:11.696331 18831 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 15:31:11.697943 18366 tablet_copy_service.cc:342] P f57efaf1e2f9446bbf8749519c42eb75: Request end of tablet copy session e6aa47478e2e4531ac29d13cbb23eb63-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.11.146.61@KRBTEST.COM'} at 127.0.0.1:41784
I20260809 15:31:11.698073 18366 tablet_copy_service.cc:433] P f57efaf1e2f9446bbf8749519c42eb75: ending tablet copy session e6aa47478e2e4531ac29d13cbb23eb63-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer e6aa47478e2e4531ac29d13cbb23eb63
I20260809 15:31:11.706126 18831 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:11.707880 18949 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:11.708225 18950 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:11.708495 18952 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:11.712280 18831 server_base.cc:1034] running on GCE node
I20260809 15:31:11.712469 18831 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:11.712805 18831 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:11.713944 18831 hybrid_clock.cc:648] HybridClock initialized: now 1786289471713946 us; error 51 us; skew 500 ppm
Aug 09 15:31:11 dist-test-slave-1jjb krb5kdc[18298](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289471, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:11.715454 18831 init.cc:377] Logged in from keytab as oryx/127.11.146.61@KRBTEST.COM (short username oryx)
I20260809 15:31:11.716063 18831 webserver.cc:460] Webserver started at http://127.11.146.61:44271/ using document root <none> and password file <none>
I20260809 15:31:11.716284 18831 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:11.716341 18831 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:11.717473 18831 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 15:31:11.720286 18959 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:11.720551 18831 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260809 15:31:11.720649 18831 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-1/wal
uuid: "e6aa47478e2e4531ac29d13cbb23eb63"
format_stamp: "Formatted at 2026-08-09 15:31:11 on dist-test-slave-1jjb"
server_key: "d3ab4221e0797ee58ec53837d24479e5"
server_key_iv: "f152793bf81db6dc55dbfba4b26eba18"
server_key_version: "encryptionkey@0"
I20260809 15:31:11.720736 18831 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:11.728514 18831 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:11.730516 18831 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:11.735462 18831 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.61:33205
I20260809 15:31:11.736056 18831 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-1/data/info.pb
I20260809 15:31:11.736335 19014 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.61:33205 every 8 connection(s)
I20260809 15:31:11.737763 19015 sys_catalog.cc:263] Verifying existing consensus state
I20260809 15:31:11.738580 19015 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63: Bootstrap starting.
I20260809 15:31:11.747107 19015 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 15:31:11.747407 19015 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63: Bootstrap complete.
I20260809 15:31:11.747895 19015 raft_consensus.cc:348] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: NON_VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: true } }
I20260809 15:31:11.748034 19015 raft_consensus.cc:729] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e6aa47478e2e4531ac29d13cbb23eb63, State: Initialized, Role: LEARNER
I20260809 15:31:11.748193 19015 consensus_queue.cc:260] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: NON_VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: true } }
I20260809 15:31:11.748535 19018 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: NON_VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: true } } }
I20260809 15:31:11.748705 19018 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [sys.catalog]: This master's current role is: LEARNER
I20260809 15:31:11.748708 19015 sys_catalog.cc:564] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:31:11.754763 19029 catalog_manager.cc:1259] Loaded cluster ID: 748ddb72d29049e8886e1c4a8a559dae
I20260809 15:31:11.754838 19029 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63: loading cluster ID for follower catalog manager: success
I20260809 15:31:11.756669 19029 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63: acquiring CA information for follower catalog manager: success
I20260809 15:31:11.757738 19029 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260809 15:31:11.828056 18947 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:11.828421 18947 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:11.828526 18947 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:11.833791 18947 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:31:11.833870 18947 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:11.833896 18947 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:11.833928 18947 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:31:11.833950 18947 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:31:11.839566 18947 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:44781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:40039,127.11.146.61:33205,127.11.146.60:45561
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.60.keytab
--principal=oryx/127.11.146.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.60:45561
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.146.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18947
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:11.840638 18947 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:11.841605 18947 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:11.850419 19035 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:11.850447 19034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:11.850621 18947 server_base.cc:1034] running on GCE node
W20260809 15:31:11.850471 19037 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:11.851331 18947 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:11.852687 18947 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:11.853893 18947 hybrid_clock.cc:648] HybridClock initialized: now 1786289471853881 us; error 30 us; skew 500 ppm
Aug 09 15:31:11 dist-test-slave-1jjb krb5kdc[18298](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289471, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:11.856755 18548 heartbeater.cc:503] Master 127.11.146.62:40039 was elected leader, sending a full tablet report...
I20260809 15:31:11.857139 18947 init.cc:377] Logged in from keytab as oryx/127.11.146.60@KRBTEST.COM (short username oryx)
I20260809 15:31:11.858282 18947 webserver.cc:460] Webserver started at http://127.11.146.60:46883/ using document root <none> and password file <none>
I20260809 15:31:11.858917 18947 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:11.858980 18947 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:11.859196 18947 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:11.861384 18947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-2/data/instance:
uuid: "967c09c37c92447ab8a318d8352867ab"
format_stamp: "Formatted at 2026-08-09 15:31:11 on dist-test-slave-1jjb"
server_key: "852baf8ed490ab82198dd9d6f6b0c4c6"
server_key_iv: "a3e3c8367c0f4f6a9e138cd2f6ea9abd"
server_key_version: "encryptionkey@0"
I20260809 15:31:11.861963 18947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-2/wal/instance:
uuid: "967c09c37c92447ab8a318d8352867ab"
format_stamp: "Formatted at 2026-08-09 15:31:11 on dist-test-slave-1jjb"
server_key: "852baf8ed490ab82198dd9d6f6b0c4c6"
server_key_iv: "a3e3c8367c0f4f6a9e138cd2f6ea9abd"
server_key_version: "encryptionkey@0"
I20260809 15:31:11.866317 18947 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 15:31:11.869169 19044 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:11.870712 18947 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:31:11.870859 18947 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-2/wal
uuid: "967c09c37c92447ab8a318d8352867ab"
format_stamp: "Formatted at 2026-08-09 15:31:11 on dist-test-slave-1jjb"
server_key: "852baf8ed490ab82198dd9d6f6b0c4c6"
server_key_iv: "a3e3c8367c0f4f6a9e138cd2f6ea9abd"
server_key_version: "encryptionkey@0"
I20260809 15:31:11.870985 18947 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:11.887722 18947 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:11.891438 18947 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:11.891821 18947 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:11.899570 18947 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.60:45561
I20260809 15:31:11.899854 19100 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.60:45561 every 8 connection(s)
I20260809 15:31:11.900684 18947 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-2/data/info.pb
I20260809 15:31:11.903664 19101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:11.904963 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 18947
I20260809 15:31:11.909938 19101 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 15:31:11 dist-test-slave-1jjb krb5kdc[18298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289470, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.146.60@KRBTEST.COM
Aug 09 15:31:11 dist-test-slave-1jjb krb5kdc[18298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289471, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.60@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM
I20260809 15:31:11.922166 19103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:11.906610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51626 (local address 127.11.146.60:45561)
0809 15:31:11.907034 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:11.907061 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:11.907099 (+ 38us) server_negotiation.cc:407] Connection header received
0809 15:31:11.908235 (+ 1136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:11.908256 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:11.908614 (+ 358us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:11.908955 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:11.909978 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.911109 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.912598 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.913327 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.913496 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:11.916841 (+ 3345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:11.916848 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:11.916859 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:11.916887 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:11.918809 (+ 1922us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:11.919330 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:11.919335 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:11.919340 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:11.919438 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:11.919741 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:11.919747 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:11.919749 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:11.920229 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:11.920436 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:11.920749 (+ 313us) server_negotiation.cc:299] Negotiation successful
0809 15:31:11.921052 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":107,"threads_started":1}
I20260809 15:31:11.923074 18385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:11.912321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41794 (local address 127.11.146.62:40039)
0809 15:31:11.912489 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:11.912494 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:11.912822 (+ 328us) server_negotiation.cc:407] Connection header received
0809 15:31:11.912962 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:11.912966 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:11.913018 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:11.913086 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:11.913890 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.914508 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.915888 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.916309 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.916420 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:11.919198 (+ 2778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:11.919202 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:11.919204 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:11.919235 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:11.920775 (+ 1540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:11.921455 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:11.921458 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:11.921459 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:11.921558 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:11.921885 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:11.921888 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:11.921890 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:11.922255 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:11.922377 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:11.922782 (+ 405us) server_negotiation.cc:299] Negotiation successful
0809 15:31:11.922904 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 15:31:11.923087 19104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:11.912181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.0.0.1:41794)
0809 15:31:11.912688 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:11.912736 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:11.912862 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:11.913162 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:11.913168 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:11.913632 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:11.913767 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:11.913772 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.914652 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.914658 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:11.915738 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:11.915750 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.916511 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.916514 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:11.916604 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:11.917184 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:11.917204 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:11.919037 (+ 1833us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:11.921030 (+ 1993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:11.921038 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:11.921075 (+ 37us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:11.921344 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:11.921658 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:11.921661 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:11.921663 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:11.921756 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:11.922451 (+ 695us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:11.922456 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:11.922556 (+ 100us) client_negotiation.cc:769] Sending connection context
0809 15:31:11.922707 (+ 151us) client_negotiation.cc:240] Negotiation successful
0809 15:31:11.922904 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":210,"threads_started":1}
I20260809 15:31:11.924386 19101 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 15:31:11 dist-test-slave-1jjb krb5kdc[18298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289471, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.60@KRBTEST.COM for oryx/127.11.146.61@KRBTEST.COM
I20260809 15:31:11.932753 19104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:11.924863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:33205 (local address 127.0.0.1:56940)
0809 15:31:11.924993 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:11.925006 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:11.925071 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:11.925515 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:11.925518 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:11.925691 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:11.925780 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:11.925786 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.926717 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.926725 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:11.927240 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:11.927248 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.927727 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.927731 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:11.927842 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:11.928344 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:11.928356 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:11.929578 (+ 1222us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:11.931160 (+ 1582us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:11.931165 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:11.931167 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:11.931361 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:11.931661 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:11.931665 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:11.931667 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:11.931754 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:11.932225 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:11.932228 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:11.932325 (+ 97us) client_negotiation.cc:769] Sending connection context
0809 15:31:11.932432 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 15:31:11.932585 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 15:31:11.932770 19105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:11.925039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56940 (local address 127.11.146.61:33205)
0809 15:31:11.925302 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:11.925306 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:11.925317 (+ 11us) server_negotiation.cc:407] Connection header received
0809 15:31:11.925354 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:11.925356 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:11.925395 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:11.925500 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:11.925902 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.926591 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.927367 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.927612 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.927727 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:11.929721 (+ 1994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:11.929725 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:11.929729 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:11.929758 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:11.931037 (+ 1279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:11.931467 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:11.931471 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:11.931473 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:11.931562 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:11.931852 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:11.931855 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:11.931857 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:11.932052 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:11.932226 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:11.932500 (+ 274us) server_negotiation.cc:299] Negotiation successful
0809 15:31:11.932620 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":89,"threads_started":1}
I20260809 15:31:11.933648 19101 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45561 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 15:31:11 dist-test-slave-1jjb krb5kdc[18298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289471, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.60@KRBTEST.COM for oryx/127.11.146.60@KRBTEST.COM
I20260809 15:31:11.941425 19104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:11.934177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:45561 (local address 127.0.0.1:51634)
0809 15:31:11.934270 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:11.934285 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:11.934360 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:11.934557 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:11.934559 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:11.934692 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:11.934759 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:11.934763 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.935918 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.935920 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:11.936519 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:11.936528 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.936955 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.936958 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:11.937014 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:11.937383 (+ 369us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:11.937394 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:11.938529 (+ 1135us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:11.940191 (+ 1662us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:11.940194 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:11.940195 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:11.940374 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:11.940632 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:11.940634 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:11.940635 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:11.940708 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:11.941036 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:11.941038 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:11.941117 (+ 79us) client_negotiation.cc:769] Sending connection context
0809 15:31:11.941197 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 15:31:11.941290 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260809 15:31:11.941459 19103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:11.934220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51634 (local address 127.11.146.60:45561)
0809 15:31:11.934337 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:11.934340 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:11.934352 (+ 12us) server_negotiation.cc:407] Connection header received
0809 15:31:11.934432 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:11.934434 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:11.934468 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:11.934548 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:11.934848 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.935800 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.936629 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.936854 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.936938 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:11.938652 (+ 1714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:11.938655 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:11.938656 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:11.938677 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:11.940059 (+ 1382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:11.940457 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:11.940460 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:11.940461 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:11.940547 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:11.940788 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:11.940791 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:11.940792 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:11.940951 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:11.941032 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:11.941256 (+ 224us) server_negotiation.cc:299] Negotiation successful
0809 15:31:11.941343 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 15:31:11.944592 19101 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab: Bootstrap starting.
I20260809 15:31:11.946874 19101 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:11.947618 19101 log.cc:824] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab: Log is configured to *not* fsync() on all Append() calls
I20260809 15:31:11.949712 19101 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab: No bootstrap required, opened a new log
I20260809 15:31:11.952869 19101 raft_consensus.cc:348] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45561 } }
I20260809 15:31:11.953094 19101 raft_consensus.cc:374] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:11.953179 19101 raft_consensus.cc:729] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 967c09c37c92447ab8a318d8352867ab, State: Initialized, Role: FOLLOWER
I20260809 15:31:11.953606 19101 consensus_queue.cc:260] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45561 } }
I20260809 15:31:11.954085 19107 sys_catalog.cc:455] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45561 } } }
I20260809 15:31:11.954195 19107 sys_catalog.cc:458] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:31:11.954790 19101 sys_catalog.cc:564] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [sys.catalog]: configured and running, proceeding with master startup.
W20260809 15:31:11.959189 19118 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:31:11.959268 19118 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:31:11.962937 18947 master_runner.cc:428] Detected that this master 967c09c37c92447ab8a318d8352867ab is joining an existing cluster
I20260809 15:31:11.963011 18947 master_runner.cc:432] Initiating AddMaster RPC to add 127.11.146.60:45561
I20260809 15:31:11.975463 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 18412
I20260809 15:31:11.988938 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.1:37663
--local_ip_for_outbound_sockets=127.11.146.1
--tserver_master_addrs=127.11.146.62:40039
--webserver_port=44641
--webserver_interface=127.11.146.1
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.1.keytab
--principal=oryx/127.11.146.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:44781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.146.62:40039,127.11.146.61:33205
--tserver_master_addrs=127.11.146.62:40039,127.11.146.61:33205,127.11.146.60:45561 with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:31:11.995085 19124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:11.965240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:45561 (local address 127.0.0.1:51648)
0809 15:31:11.965501 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:11.965512 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:11.965622 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:11.965943 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:11.965946 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:11.966179 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:11.966317 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:11.966328 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.967305 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.967307 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:11.968256 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:11.968264 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.968955 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.968958 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:11.969098 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:11.969684 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:11.969700 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:11.970124 (+ 424us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:11.972132 (+ 2008us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:11.972137 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:11.972142 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:11.992892 (+ 20750us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:11.993227 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:11.993231 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:11.993236 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:11.993326 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:11.994179 (+ 853us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:11.994181 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:11.994572 (+ 391us) client_negotiation.cc:769] Sending connection context
0809 15:31:11.994696 (+ 124us) client_negotiation.cc:240] Negotiation successful
0809 15:31:11.994845 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":110,"threads_started":1}
I20260809 15:31:11.995690 19103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:11.965281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51648 (local address 127.11.146.60:45561)
0809 15:31:11.965407 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:11.965411 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:11.965577 (+ 166us) server_negotiation.cc:407] Connection header received
0809 15:31:11.965730 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:11.965734 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:11.965772 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:11.965841 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:11.966434 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.967196 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.968361 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.968701 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.968780 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:11.970247 (+ 1467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:11.970252 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:11.970256 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:11.970279 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:11.971984 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:11.993030 (+ 21046us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:11.993034 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:11.993036 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:11.993122 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:11.993410 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:11.993413 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:11.993415 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:11.994029 (+ 614us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:11.994138 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:11.995308 (+ 1170us) server_negotiation.cc:299] Negotiation successful
0809 15:31:11.995499 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":10,"server-negotiator.queue_time_us":48}
I20260809 15:31:11.997124 19125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:11.966034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:33205 (local address 127.0.0.1:56954)
0809 15:31:11.966362 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:11.966376 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:11.966518 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:11.966890 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:11.966893 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:11.967135 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:11.967305 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:11.967314 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.968431 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.968434 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:11.969447 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:11.969459 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.970237 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.970240 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:11.970396 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:11.992699 (+ 22303us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:11.992718 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:11.993204 (+ 486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:11.995325 (+ 2121us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:11.995328 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:11.995329 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:11.995616 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:11.995969 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:11.995972 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:11.995974 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:11.996102 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:11.996593 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:11.996596 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:11.996692 (+ 96us) client_negotiation.cc:769] Sending connection context
0809 15:31:11.996791 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 15:31:11.996924 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"mutex_wait_us":84,"thread_start_us":85,"threads_started":1}
I20260809 15:31:11.997696 19105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:11.966145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56954 (local address 127.11.146.61:33205)
0809 15:31:11.966277 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:11.966281 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:11.966443 (+ 162us) server_negotiation.cc:407] Connection header received
0809 15:31:11.966644 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:11.966648 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:11.966692 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:11.966744 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:11.967452 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.968276 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.969603 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.969977 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.970056 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:11.993389 (+ 23333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:11.993396 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:11.993400 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:11.993431 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:11.995199 (+ 1768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:11.995753 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:11.995758 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:11.995763 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:11.995860 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:11.996215 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:11.996219 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:11.996221 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:11.996450 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:11.996548 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:11.997334 (+ 786us) server_negotiation.cc:299] Negotiation successful
0809 15:31:11.997499 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 15:31:12.000651 19126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:11.965694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.0.0.1:41802)
0809 15:31:11.966294 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:11.966308 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:11.966443 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:11.966774 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:11.966777 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:11.967050 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:11.967159 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:11.967167 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.968265 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.968268 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:11.970348 (+ 2080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:11.970365 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.971731 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.971735 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:11.971857 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:11.972397 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:11.972411 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:11.997033 (+ 24622us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:11.999107 (+ 2074us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:11.999114 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:11.999116 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:11.999305 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:11.999607 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:11.999611 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:11.999613 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:11.999691 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:12.000135 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:12.000138 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:12.000236 (+ 98us) client_negotiation.cc:769] Sending connection context
0809 15:31:12.000348 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 15:31:12.000480 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"mutex_wait_us":51,"thread_start_us":90,"threads_started":1}
I20260809 15:31:12.000679 18385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:11.965753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41802 (local address 127.11.146.62:40039)
0809 15:31:11.965876 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:11.965880 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:11.966384 (+ 504us) server_negotiation.cc:407] Connection header received
0809 15:31:11.966546 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:11.966549 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:11.966593 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:11.966642 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:11.967301 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.968133 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.970798 (+ 2665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:11.971488 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:11.971571 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:11.997220 (+ 25649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:11.997224 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:11.997227 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:11.997263 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:11.998987 (+ 1724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:11.999413 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:11.999417 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:11.999419 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:11.999503 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:11.999788 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:11.999792 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:11.999794 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:11.999986 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:12.000165 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:12.000407 (+ 242us) server_negotiation.cc:299] Negotiation successful
0809 15:31:12.000535 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
Aug 09 15:31:12 dist-test-slave-1jjb krb5kdc[18298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289470, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.62@KRBTEST.COM for oryx/127.11.146.60@KRBTEST.COM
I20260809 15:31:12.012276 18929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.004103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:45561 (local address 127.0.0.1:51662)
0809 15:31:12.004284 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:12.004306 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:12.004414 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:12.004745 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:12.004777 (+ 32us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:12.004944 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:12.005034 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.005039 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.005840 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.005844 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.006390 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.006398 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.006863 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.006867 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.006967 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.007436 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:12.007448 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:12.008798 (+ 1350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:12.010701 (+ 1903us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:12.010704 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:12.010706 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:12.010908 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:12.011263 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:12.011266 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:12.011268 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:12.011358 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:12.011733 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:12.011737 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:12.011836 (+ 99us) client_negotiation.cc:769] Sending connection context
0809 15:31:12.011945 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 15:31:12.012114 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107}
I20260809 15:31:12.012275 19103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.004216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51662 (local address 127.11.146.60:45561)
0809 15:31:12.004314 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:12.004320 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:12.004353 (+ 33us) server_negotiation.cc:407] Connection header received
0809 15:31:12.004539 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:12.004542 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:12.004648 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:12.004727 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:12.005149 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.005735 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.006516 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.006741 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.006849 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.008940 (+ 2091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:12.008943 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:12.008945 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:12.008965 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:12.010549 (+ 1584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:12.011013 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:12.011017 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:12.011018 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:12.011161 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:12.011452 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:12.011456 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:12.011458 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:12.011628 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:12.011737 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:12.011998 (+ 261us) server_negotiation.cc:299] Negotiation successful
0809 15:31:12.012155 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 15:31:12.013478 18345 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.11.146.60:45561: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "967c09c37c92447ab8a318d8352867ab"
member_type: NON_VOTER
last_known_addr {
host: "127.11.146.60"
port: 45561
}
attrs {
promote: true
}
}
dest_uuid: "f57efaf1e2f9446bbf8749519c42eb75"
cas_config_opid_index: 5
I20260809 15:31:12.014094 18345 consensus_queue.cc:237] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: NON_VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: true } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: NON_VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: true } }
I20260809 15:31:12.015195 18935 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 967c09c37c92447ab8a318d8352867ab (127.11.146.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: NON_VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: true } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: NON_VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: true } } }
I20260809 15:31:12.015861 19074 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:12.016803 18935 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.11.146.60:45561
I20260809 15:31:12.017154 18934 sys_catalog.cc:455] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "f57efaf1e2f9446bbf8749519c42eb75" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: NON_VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: true } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: NON_VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: true } } }
I20260809 15:31:12.017285 18934 sys_catalog.cc:458] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:12.017405 19074 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [term 1 FOLLOWER]: Refusing update from remote peer f57efaf1e2f9446bbf8749519c42eb75: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 15:31:12.017457 18947 master.cc:537] Master@127.11.146.60:45561 shutting down...
I20260809 15:31:12.018181 18934 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: NON_VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 15:31:12.019848 18331 consensus_peers.cc:487] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 -> Peer 967c09c37c92447ab8a318d8352867ab (127.11.146.60:45561): Couldn't send request to peer 967c09c37c92447ab8a318d8352867ab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260809 15:31:12.020535 19105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.015557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56964 (local address 127.11.146.61:33205)
0809 15:31:12.015762 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:12.015766 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:12.015777 (+ 11us) server_negotiation.cc:407] Connection header received
0809 15:31:12.015816 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:12.015819 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:12.015864 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:12.015977 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:31:12.016256 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.016747 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.018901 (+ 2154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.019539 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.019620 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.019771 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:12.020340 (+ 569us) server_negotiation.cc:299] Negotiation successful
0809 15:31:12.020412 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125}
I20260809 15:31:12.022522 18929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.015334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:33205 (local address 127.0.0.1:56964)
0809 15:31:12.015539 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:12.015553 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:12.015632 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:12.015991 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:12.015994 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:12.016011 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:31:12.016130 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.016137 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.017239 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.017242 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.018756 (+ 1514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.018766 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.019868 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.019872 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.020132 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.020179 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 15:31:12.021204 (+ 1025us) client_negotiation.cc:240] Negotiation successful
0809 15:31:12.021282 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125}
I20260809 15:31:12.023365 18988 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [term 1 LEARNER]: Refusing update from remote peer f57efaf1e2f9446bbf8749519c42eb75: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 15:31:12.023774 18934 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: NON_VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260809 15:31:12.025619 18988 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 967c09c37c92447ab8a318d8352867ab (127.11.146.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: NON_VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: true } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: NON_VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: true } } }
I20260809 15:31:12.027545 19018 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f57efaf1e2f9446bbf8749519c42eb75. Latest consensus state: current_term: 1 leader_uuid: "f57efaf1e2f9446bbf8749519c42eb75" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: NON_VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: true } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: NON_VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: true } } }
I20260809 15:31:12.027665 19018 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [sys.catalog]: This master's current role is: LEARNER
I20260809 15:31:12.027774 19018 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f57efaf1e2f9446bbf8749519c42eb75" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: NON_VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: true } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: NON_VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: true } } }
I20260809 15:31:12.027858 19018 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [sys.catalog]: This master's current role is: LEARNER
I20260809 15:31:12.028574 18934 raft_consensus.cc:1050] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75: attempting to promote NON_VOTER e6aa47478e2e4531ac29d13cbb23eb63 to VOTER
I20260809 15:31:12.028584 18947 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:31:12.028841 18947 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:31:12.028954 18947 tablet_replica.cc:330] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab: stopping tablet replica
I20260809 15:31:12.029011 18934 consensus_queue.cc:237] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: false } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: NON_VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: true } }
I20260809 15:31:12.030745 18988 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [term 1 LEARNER]: Refusing update from remote peer f57efaf1e2f9446bbf8749519c42eb75: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20260809 15:31:12.031077 18331 consensus_peers.cc:487] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 -> Peer 967c09c37c92447ab8a318d8352867ab (127.11.146.60:45561): Couldn't send request to peer 967c09c37c92447ab8a318d8352867ab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260809 15:31:12.031220 18932 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260809 15:31:12.033037 18932 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, e6aa47478e2e4531ac29d13cbb23eb63 (127.11.146.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: false } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: NON_VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: true } } }
I20260809 15:31:12.034678 18932 sys_catalog.cc:455] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "f57efaf1e2f9446bbf8749519c42eb75" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: false } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: NON_VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: true } } }
I20260809 15:31:12.034797 18932 sys_catalog.cc:458] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:12.034950 18932 sys_catalog.cc:455] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f57efaf1e2f9446bbf8749519c42eb75" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: false } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: NON_VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: true } } }
I20260809 15:31:12.035004 18932 sys_catalog.cc:458] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:12.035614 18988 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, e6aa47478e2e4531ac29d13cbb23eb63 (127.11.146.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: false } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: NON_VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: true } } }
I20260809 15:31:12.037075 19130 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f57efaf1e2f9446bbf8749519c42eb75" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: false } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: NON_VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: true } } }
I20260809 15:31:12.037220 19130 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:31:12.045315 18947 master.cc:552] Master@127.11.146.60:45561 shutdown complete.
I20260809 15:31:12.045377 18947 master_runner.cc:305] Clearing existing system tablet
I20260809 15:31:12.045598 18947 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:12.045666 18947 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:12.046900 18947 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 15:31:12.047716 19132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:12.047940 18947 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:12.048116 18947 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 15:31:12.048156 18947 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-2/wal
uuid: "967c09c37c92447ab8a318d8352867ab"
format_stamp: "Formatted at 2026-08-09 15:31:11 on dist-test-slave-1jjb"
server_key: "852baf8ed490ab82198dd9d6f6b0c4c6"
server_key_iv: "a3e3c8367c0f4f6a9e138cd2f6ea9abd"
server_key_version: "encryptionkey@0"
I20260809 15:31:12.049984 18947 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:31:12.052230 18947 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 15:31:12.052330 18947 log.cc:1196] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260809 15:31:12.052579 18947 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab: Deleting consensus metadata
I20260809 15:31:12.052767 18947 master_runner.cc:315] Copying system tablet from 127.11.146.62:40039
I20260809 15:31:12.053825 18947 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab: tablet copy: Beginning tablet copy session from remote peer at address 127.11.146.62:40039
I20260809 15:31:12.062187 18385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.054385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41816 (local address 127.11.146.62:40039)
0809 15:31:12.054508 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:12.054513 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:12.054813 (+ 300us) server_negotiation.cc:407] Connection header received
0809 15:31:12.054967 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:12.054971 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:12.055022 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:12.055119 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:12.055675 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.056517 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.057431 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.057664 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.057769 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.058893 (+ 1124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:12.058897 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:12.058899 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:12.058923 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:12.060585 (+ 1662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:12.061011 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:12.061014 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:12.061016 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:12.061101 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:12.061374 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:12.061378 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:12.061380 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:12.061563 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:12.061671 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:12.061926 (+ 255us) server_negotiation.cc:299] Negotiation successful
0809 15:31:12.062033 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 15:31:12.062206 19138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.054333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.0.0.1:41816)
0809 15:31:12.054715 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:12.054728 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:12.054877 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:12.055136 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:12.055139 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:12.055427 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:12.055558 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.055564 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.056645 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.056650 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.057312 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.057322 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.057783 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.057786 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.057878 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.058409 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:12.058421 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:12.058751 (+ 330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:12.060710 (+ 1959us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:12.060713 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:12.060715 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:12.060911 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:12.061194 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:12.061197 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:12.061199 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:12.061284 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:12.061662 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:12.061665 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:12.061765 (+ 100us) client_negotiation.cc:769] Sending connection context
0809 15:31:12.061872 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 15:31:12.062017 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":85,"threads_started":1}
I20260809 15:31:12.063002 18366 tablet_copy_service.cc:140] P f57efaf1e2f9446bbf8749519c42eb75: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 967c09c37c92447ab8a318d8352867ab ({username='oryx', principal='oryx/127.11.146.60@KRBTEST.COM'} at 127.0.0.1:41816)
I20260809 15:31:12.063154 18366 tablet_copy_service.cc:161] P f57efaf1e2f9446bbf8749519c42eb75: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 967c09c37c92447ab8a318d8352867ab at {username='oryx', principal='oryx/127.11.146.60@KRBTEST.COM'} at 127.0.0.1:41816: session id = 967c09c37c92447ab8a318d8352867ab-00000000000000000000000000000000
I20260809 15:31:12.064262 18366 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 15:31:12.065596 18947 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 15:31:12.067832 18947 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab: tablet copy: Starting download of 0 data blocks...
I20260809 15:31:12.067993 18947 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab: tablet copy: Starting download of 1 WAL segments...
I20260809 15:31:12.069643 18947 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 15:31:12.071307 18366 tablet_copy_service.cc:342] P f57efaf1e2f9446bbf8749519c42eb75: Request end of tablet copy session 967c09c37c92447ab8a318d8352867ab-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.11.146.60@KRBTEST.COM'} at 127.0.0.1:41816
I20260809 15:31:12.071393 18366 tablet_copy_service.cc:433] P f57efaf1e2f9446bbf8749519c42eb75: ending tablet copy session 967c09c37c92447ab8a318d8352867ab-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 967c09c37c92447ab8a318d8352867ab
I20260809 15:31:12.079663 18947 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:12.081568 19139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:12.081866 19140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:12.082099 18947 server_base.cc:1034] running on GCE node
W20260809 15:31:12.082271 19142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:12.082515 18947 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:12.082829 18947 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:12.083989 18947 hybrid_clock.cc:648] HybridClock initialized: now 1786289472083977 us; error 28 us; skew 500 ppm
Aug 09 15:31:12 dist-test-slave-1jjb krb5kdc[18298](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289472, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:12.085793 18947 init.cc:377] Logged in from keytab as oryx/127.11.146.60@KRBTEST.COM (short username oryx)
I20260809 15:31:12.086328 18947 webserver.cc:460] Webserver started at http://127.11.146.60:33495/ using document root <none> and password file <none>
I20260809 15:31:12.086575 18947 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:12.086661 18947 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:12.088292 18947 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 15:31:12.089401 19150 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:12.089689 18947 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 15:31:12.089799 18947 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-2/wal
uuid: "967c09c37c92447ab8a318d8352867ab"
format_stamp: "Formatted at 2026-08-09 15:31:11 on dist-test-slave-1jjb"
server_key: "852baf8ed490ab82198dd9d6f6b0c4c6"
server_key_iv: "a3e3c8367c0f4f6a9e138cd2f6ea9abd"
server_key_version: "encryptionkey@0"
I20260809 15:31:12.089963 18947 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:12.095494 18687 heartbeater.cc:503] Master 127.11.146.62:40039 was elected leader, sending a full tablet report...
I20260809 15:31:12.112826 18947 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:12.115279 18947 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:12.120719 19205 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.60:45561 every 8 connection(s)
I20260809 15:31:12.120735 18947 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.60:45561
I20260809 15:31:12.121680 18947 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/master-2/data/info.pb
I20260809 15:31:12.123780 19206 sys_catalog.cc:263] Verifying existing consensus state
I20260809 15:31:12.124904 19206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab: Bootstrap starting.
I20260809 15:31:12.136734 19206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 15:31:12.137085 19206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab: Bootstrap complete.
I20260809 15:31:12.137732 19206 raft_consensus.cc:348] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: false } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: NON_VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: true } }
I20260809 15:31:12.137884 19206 raft_consensus.cc:729] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 967c09c37c92447ab8a318d8352867ab, State: Initialized, Role: LEARNER
I20260809 15:31:12.138013 19206 consensus_queue.cc:260] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: false } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: NON_VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: true } }
I20260809 15:31:12.138411 19209 sys_catalog.cc:455] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: false } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: NON_VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: true } } }
I20260809 15:31:12.138554 19206 sys_catalog.cc:564] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:31:12.138648 19209 sys_catalog.cc:458] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [sys.catalog]: This master's current role is: LEARNER
I20260809 15:31:12.143056 19224 catalog_manager.cc:1259] Loaded cluster ID: 748ddb72d29049e8886e1c4a8a559dae
I20260809 15:31:12.143122 19224 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab: loading cluster ID for follower catalog manager: success
I20260809 15:31:12.145413 19224 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab: acquiring CA information for follower catalog manager: success
I20260809 15:31:12.146824 19224 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260809 15:31:12.147464 19128 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:12.147709 19128 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:12.147794 19128 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:12.153273 19128 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:12.153343 19128 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:12.153438 19128 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.1
I20260809 15:31:12.159292 19128 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:44781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.1.keytab
--principal=oryx/127.11.146.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.1:37663
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.146.1
--webserver_port=44641
--tserver_master_addrs=127.11.146.62:40039,127.11.146.61:33205,127.11.146.60:45561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19128
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.1
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:12.160528 19128 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:12.161592 19128 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:12.172176 19229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:12.172169 19226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:12.172169 19227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:12.172520 19128 server_base.cc:1034] running on GCE node
I20260809 15:31:12.173046 19128 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:12.173671 19128 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:12.174880 19128 hybrid_clock.cc:648] HybridClock initialized: now 1786289472174842 us; error 50 us; skew 500 ppm
Aug 09 15:31:12 dist-test-slave-1jjb krb5kdc[18298](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289472, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:12.178006 19128 init.cc:377] Logged in from keytab as oryx/127.11.146.1@KRBTEST.COM (short username oryx)
I20260809 15:31:12.178890 19128 webserver.cc:460] Webserver started at http://127.11.146.1:44641/ using document root <none> and password file <none>
I20260809 15:31:12.179421 19128 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:12.179494 19128 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:12.183450 19128 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:31:12.185652 19236 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:12.186995 19128 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:31:12.187096 19128 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-0/wal
uuid: "3911b5d8312f41a7abb4264402dcc625"
format_stamp: "Formatted at 2026-08-09 15:31:10 on dist-test-slave-1jjb"
server_key: "4f376de16d9cd2494704c320121fd65b"
server_key_iv: "2d42f69d802433c0045dacac9e7755e4"
server_key_version: "encryptionkey@0"
I20260809 15:31:12.187677 19128 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:12.202750 19128 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:12.206362 19128 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:12.206538 19128 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:12.207132 19128 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:31:12.208048 19128 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:12.208148 19128 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:12.208209 19128 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:12.208232 19128 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:12.218572 19128 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.1:37663
I20260809 15:31:12.218596 19355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.1:37663 every 8 connection(s)
I20260809 15:31:12.219836 19128 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
I20260809 15:31:12.228775 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 19128
I20260809 15:31:12.229005 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 18553
Aug 09 15:31:12 dist-test-slave-1jjb krb5kdc[18298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289472, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.60@KRBTEST.COM
I20260809 15:31:12.238408 19360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.221954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:53563 (local address 127.11.146.60:45561)
0809 15:31:12.222391 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:12.222396 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:12.223117 (+ 721us) server_negotiation.cc:407] Connection header received
0809 15:31:12.224495 (+ 1378us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:12.224498 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:12.224564 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:12.224646 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:12.226279 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.227325 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.228884 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.229302 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.229414 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.234086 (+ 4672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:12.234090 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:12.234092 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:12.234129 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:12.235734 (+ 1605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:12.236419 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:12.236425 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:12.236429 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:12.236529 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:12.236920 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:12.236925 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:12.236929 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:12.237178 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:12.237272 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:12.238003 (+ 731us) server_negotiation.cc:299] Negotiation successful
0809 15:31:12.238155 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":126,"threads_started":1}
I20260809 15:31:12.240234 19362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.222401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:45561 (local address 127.11.146.1:53563)
0809 15:31:12.223008 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:12.223030 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:12.224238 (+ 1208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:12.224970 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:12.224980 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:12.225508 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:12.226126 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.226132 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.227793 (+ 1661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.227799 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.228739 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.228750 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.230796 (+ 2046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.230802 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.231045 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.231790 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:12.231816 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:12.233876 (+ 2060us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:12.235874 (+ 1998us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:12.235881 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:12.235900 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:12.236300 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:12.236637 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:12.236642 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:12.236646 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:12.236823 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:12.237346 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:12.237353 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:12.237702 (+ 349us) client_negotiation.cc:769] Sending connection context
0809 15:31:12.238623 (+ 921us) client_negotiation.cc:240] Negotiation successful
0809 15:31:12.239015 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"mutex_wait_us":55,"spinlock_wait_cycles":4096,"thread_start_us":152,"threads_started":1}
Aug 09 15:31:12 dist-test-slave-1jjb krb5kdc[18298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289472, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM
Aug 09 15:31:12 dist-test-slave-1jjb krb5kdc[18298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289472, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.61@KRBTEST.COM
I20260809 15:31:12.245555 18385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.221890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:42531 (local address 127.11.146.62:40039)
0809 15:31:12.222048 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:12.222053 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:12.223093 (+ 1040us) server_negotiation.cc:407] Connection header received
0809 15:31:12.224602 (+ 1509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:12.224609 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:12.224669 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:12.224749 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:12.226279 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.227104 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.237374 (+ 10270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.237711 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.237802 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.241536 (+ 3734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:12.241543 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:12.241549 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:12.241589 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:12.243507 (+ 1918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:12.244245 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:12.244250 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:12.244252 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:12.244351 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:12.244679 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:12.244682 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:12.244684 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:12.244877 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:12.245015 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:12.245278 (+ 263us) server_negotiation.cc:299] Negotiation successful
0809 15:31:12.245401 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 15:31:12.245568 19363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.222401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.11.146.1:42531)
0809 15:31:12.222918 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:12.222975 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:12.224257 (+ 1282us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:12.224970 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:12.224980 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:12.225504 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:12.226122 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.226132 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.227219 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.227222 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.237212 (+ 9990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.237225 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.237990 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.237995 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.238106 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.238960 (+ 854us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:12.238990 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:12.241034 (+ 2044us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:12.243779 (+ 2745us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:12.243786 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:12.243791 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:12.244077 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:12.244468 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:12.244471 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:12.244473 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:12.244576 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:12.244981 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:12.244984 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:12.245082 (+ 98us) client_negotiation.cc:769] Sending connection context
0809 15:31:12.245202 (+ 120us) client_negotiation.cc:240] Negotiation successful
0809 15:31:12.245356 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"mutex_wait_us":8806,"spinlock_wait_cycles":60160,"thread_start_us":146,"threads_started":1}
I20260809 15:31:12.246354 19357 heartbeater.cc:347] Connected to a master server at 127.11.146.62:40039
I20260809 15:31:12.246517 19356 heartbeater.cc:347] Connected to a master server at 127.11.146.60:45561
I20260809 15:31:12.246659 19357 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:12.246692 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.2:37007
--local_ip_for_outbound_sockets=127.11.146.2
--tserver_master_addrs=127.11.146.62:40039
--webserver_port=44343
--webserver_interface=127.11.146.2
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.2.keytab
--principal=oryx/127.11.146.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:44781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.146.62:40039,127.11.146.61:33205
--tserver_master_addrs=127.11.146.62:40039,127.11.146.61:33205,127.11.146.60:45561 with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:31:12.246658 19356 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:12.247386 19357 heartbeater.cc:511] Master 127.11.146.62:40039 requested a full tablet report, sending...
I20260809 15:31:12.247386 19356 heartbeater.cc:511] Master 127.11.146.60:45561 requested a full tablet report, sending...
I20260809 15:31:12.248363 19105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.223654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:36767 (local address 127.11.146.61:33205)
0809 15:31:12.223775 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:12.223779 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:12.223975 (+ 196us) server_negotiation.cc:407] Connection header received
0809 15:31:12.224808 (+ 833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:12.224811 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:12.224866 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:12.224965 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:12.226261 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.226808 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.239659 (+ 12851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.240007 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.240123 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.243079 (+ 2956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:12.243083 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:12.243086 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:12.243122 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:12.245171 (+ 2049us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:12.246138 (+ 967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:12.246144 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:12.246149 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:12.246249 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:12.246731 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:12.246736 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:12.246738 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:12.246968 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:12.247058 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:12.248043 (+ 985us) server_negotiation.cc:299] Negotiation successful
0809 15:31:12.248214 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 15:31:12.248874 18345 ts_manager.cc:194] Re-registered known tserver with Master: 3911b5d8312f41a7abb4264402dcc625 (127.11.146.1:37663)
I20260809 15:31:12.249001 19364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.223567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:33205 (local address 127.11.146.1:36767)
0809 15:31:12.223875 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:12.223888 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:12.224238 (+ 350us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:12.224984 (+ 746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:12.224987 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:12.225483 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:12.226109 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.226123 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.226955 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.226959 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.238421 (+ 11462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.238435 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.240902 (+ 2467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.240907 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.240994 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.241526 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:12.241540 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:12.242912 (+ 1372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:12.245319 (+ 2407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:12.245325 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:12.245330 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:12.246020 (+ 690us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:12.246374 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:12.246392 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:12.246396 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:12.246608 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:12.247346 (+ 738us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:12.247348 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:12.247451 (+ 103us) client_negotiation.cc:769] Sending connection context
0809 15:31:12.248673 (+ 1222us) client_negotiation.cc:240] Negotiation successful
0809 15:31:12.248827 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"mutex_wait_us":10069,"thread_start_us":108,"threads_started":1}
I20260809 15:31:12.249291 19170 ts_manager.cc:194] Registered new tserver with Master: 3911b5d8312f41a7abb4264402dcc625 (127.11.146.1:37663)
I20260809 15:31:12.249678 19358 heartbeater.cc:347] Connected to a master server at 127.11.146.61:33205
I20260809 15:31:12.249773 19358 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:12.249760 18345 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.146.1@KRBTEST.COM'} at 127.11.146.1:42531
I20260809 15:31:12.249963 19358 heartbeater.cc:511] Master 127.11.146.61:33205 requested a full tablet report, sending...
I20260809 15:31:12.251104 18977 ts_manager.cc:194] Registered new tserver with Master: 3911b5d8312f41a7abb4264402dcc625 (127.11.146.1:37663)
I20260809 15:31:12.327453 18826 heartbeater.cc:503] Master 127.11.146.62:40039 was elected leader, sending a full tablet report...
W20260809 15:31:12.371438 19365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:12.371846 19365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:12.371963 19365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:12.376353 19365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:12.376410 19365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:12.376499 19365 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.2
I20260809 15:31:12.382396 19365 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:44781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.2.keytab
--principal=oryx/127.11.146.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.2:37007
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.146.2
--webserver_port=44343
--tserver_master_addrs=127.11.146.62:40039,127.11.146.61:33205,127.11.146.60:45561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19365
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.2
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:12.383536 19365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:12.384676 19365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:12.394927 19375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:12.394879 19373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:12.394925 19372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:12.395205 19365 server_base.cc:1034] running on GCE node
I20260809 15:31:12.395823 19365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:12.396618 19365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:12.397869 19365 hybrid_clock.cc:648] HybridClock initialized: now 1786289472397852 us; error 30 us; skew 500 ppm
Aug 09 15:31:12 dist-test-slave-1jjb krb5kdc[18298](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289472, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:12.400831 19365 init.cc:377] Logged in from keytab as oryx/127.11.146.2@KRBTEST.COM (short username oryx)
I20260809 15:31:12.401685 19365 webserver.cc:460] Webserver started at http://127.11.146.2:44343/ using document root <none> and password file <none>
I20260809 15:31:12.402218 19365 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:12.402289 19365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:12.406466 19365 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260809 15:31:12.408587 19382 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:12.409986 19365 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:31:12.410089 19365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-1/wal
uuid: "5ddb4be8bc354f3fa2d90f8f5f722ba0"
format_stamp: "Formatted at 2026-08-09 15:31:11 on dist-test-slave-1jjb"
server_key: "8f6b01896b57285c53ddcb0dbdec0565"
server_key_iv: "92020532f74eb875d3097073361ea580"
server_key_version: "encryptionkey@0"
I20260809 15:31:12.410732 19365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:12.445044 19365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:12.448606 19365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:12.448763 19365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:12.449442 19365 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:31:12.450338 19365 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:12.450435 19365 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:12.450507 19365 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:12.450543 19365 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:12.460497 19365 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.2:37007
I20260809 15:31:12.460521 19501 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.2:37007 every 8 connection(s)
I20260809 15:31:12.461550 19365 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
I20260809 15:31:12.467669 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 19365
I20260809 15:31:12.467839 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 18692
Aug 09 15:31:12 dist-test-slave-1jjb krb5kdc[18298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289472, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM
Aug 09 15:31:12 dist-test-slave-1jjb krb5kdc[18298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289472, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.60@KRBTEST.COM
Aug 09 15:31:12 dist-test-slave-1jjb krb5kdc[18298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289472, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.61@KRBTEST.COM
I20260809 15:31:12.480495 19105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.465551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:50349 (local address 127.11.146.61:33205)
0809 15:31:12.465688 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:12.465693 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:12.465767 (+ 74us) server_negotiation.cc:407] Connection header received
0809 15:31:12.466180 (+ 413us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:12.466183 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:12.466243 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:12.466320 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:12.467915 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.468952 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.471018 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.471527 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.471768 (+ 241us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.476348 (+ 4580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:12.476354 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:12.476358 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:12.476394 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:12.478422 (+ 2028us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:12.478946 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:12.478949 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:12.478951 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:12.479033 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:12.479369 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:12.479373 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:12.479374 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:12.479712 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:12.479799 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:12.480198 (+ 399us) server_negotiation.cc:299] Negotiation successful
0809 15:31:12.480323 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 15:31:12.480495 18385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.463536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:35513 (local address 127.11.146.62:40039)
0809 15:31:12.463777 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:12.463784 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:12.465226 (+ 1442us) server_negotiation.cc:407] Connection header received
0809 15:31:12.466200 (+ 974us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:12.466203 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:12.466257 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:12.466311 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:12.468044 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.468844 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.470801 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.471157 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.471232 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.475203 (+ 3971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:12.475207 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:12.475210 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:12.475237 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:12.477698 (+ 2461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:12.478400 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:12.478404 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:12.478406 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:12.478509 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:12.478946 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:12.478950 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:12.478951 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:12.479206 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:12.479279 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:12.480179 (+ 900us) server_negotiation.cc:299] Negotiation successful
0809 15:31:12.480315 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 15:31:12.480984 19360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.463579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:41177 (local address 127.11.146.60:45561)
0809 15:31:12.463917 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:12.463920 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:12.464896 (+ 976us) server_negotiation.cc:407] Connection header received
0809 15:31:12.466199 (+ 1303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:12.466203 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:12.466257 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:12.466311 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:12.467907 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.468781 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.470801 (+ 2020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.471157 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.471232 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.475718 (+ 4486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:12.475723 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:12.475730 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:12.475769 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:12.478326 (+ 2557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:12.479080 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:12.479087 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:12.479092 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:12.479209 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:12.479636 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:12.479643 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:12.479647 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:12.479946 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:12.480037 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:12.480551 (+ 514us) server_negotiation.cc:299] Negotiation successful
0809 15:31:12.480728 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254}
I20260809 15:31:12.482424 19508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.464099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.11.146.2:35513)
0809 15:31:12.465126 (+ 1027us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:12.465140 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:12.465953 (+ 813us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:12.466524 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:12.466532 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:12.466995 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:12.467843 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.467856 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.468979 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.468981 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.470658 (+ 1677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.470669 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.471443 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.471448 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.471792 (+ 344us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.472742 (+ 950us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:12.472759 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:12.475026 (+ 2267us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:12.477848 (+ 2822us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:12.477858 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:12.477876 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:12.478266 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:12.478640 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:12.478644 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:12.478645 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:12.478826 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:12.479366 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:12.479373 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:12.479847 (+ 474us) client_negotiation.cc:769] Sending connection context
0809 15:31:12.481215 (+ 1368us) client_negotiation.cc:240] Negotiation successful
0809 15:31:12.481478 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":937,"mutex_wait_us":631,"spinlock_wait_cycles":94080,"thread_start_us":202,"threads_started":1}
I20260809 15:31:12.482430 19509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.465414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:33205 (local address 127.11.146.2:50349)
0809 15:31:12.465691 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:12.465704 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:12.465959 (+ 255us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:12.466522 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:12.466529 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:12.466991 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:12.467726 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.467751 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.469155 (+ 1404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.469161 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.470845 (+ 1684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.470861 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.472010 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.472018 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.472872 (+ 854us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.473464 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:12.473501 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:12.476171 (+ 2670us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:12.478543 (+ 2372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:12.478546 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:12.478549 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:12.478832 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:12.479168 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:12.479171 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:12.479173 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:12.479264 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:12.479889 (+ 625us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:12.479892 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:12.479982 (+ 90us) client_negotiation.cc:769] Sending connection context
0809 15:31:12.480762 (+ 780us) client_negotiation.cc:240] Negotiation successful
0809 15:31:12.481253 (+ 491us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"mutex_wait_us":191,"spinlock_wait_cycles":1920,"thread_start_us":115,"threads_started":1}
I20260809 15:31:12.482652 19507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.464099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:45561 (local address 127.11.146.2:41177)
0809 15:31:12.464721 (+ 622us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:12.464764 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:12.465953 (+ 1189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:12.466524 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:12.466532 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:12.466996 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:12.467729 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.467751 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.468973 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.468976 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.470658 (+ 1682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.470669 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.471443 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.471448 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.471789 (+ 341us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.472846 (+ 1057us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:12.472859 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:12.475448 (+ 2589us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:12.478500 (+ 3052us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:12.478506 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:12.478511 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:12.478935 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:12.479354 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:12.479360 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:12.479365 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:12.479496 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:12.480153 (+ 657us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:12.480159 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:12.480289 (+ 130us) client_negotiation.cc:769] Sending connection context
0809 15:31:12.481161 (+ 872us) client_negotiation.cc:240] Negotiation successful
0809 15:31:12.481374 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":434,"mutex_wait_us":344,"spinlock_wait_cycles":12800,"thread_start_us":759,"threads_started":1}
I20260809 15:31:12.484058 19502 heartbeater.cc:347] Connected to a master server at 127.11.146.60:45561
I20260809 15:31:12.484352 19502 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:12.484822 19502 heartbeater.cc:511] Master 127.11.146.60:45561 requested a full tablet report, sending...
I20260809 15:31:12.485986 19170 ts_manager.cc:194] Registered new tserver with Master: 5ddb4be8bc354f3fa2d90f8f5f722ba0 (127.11.146.2:37007)
I20260809 15:31:12.486163 19504 heartbeater.cc:347] Connected to a master server at 127.11.146.61:33205
I20260809 15:31:12.486272 19504 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:12.486490 19504 heartbeater.cc:511] Master 127.11.146.61:33205 requested a full tablet report, sending...
I20260809 15:31:12.486168 19503 heartbeater.cc:347] Connected to a master server at 127.11.146.62:40039
I20260809 15:31:12.486766 19503 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:12.486945 19503 heartbeater.cc:511] Master 127.11.146.62:40039 requested a full tablet report, sending...
I20260809 15:31:12.487252 18977 ts_manager.cc:194] Registered new tserver with Master: 5ddb4be8bc354f3fa2d90f8f5f722ba0 (127.11.146.2:37007)
I20260809 15:31:12.487727 18345 ts_manager.cc:194] Re-registered known tserver with Master: 5ddb4be8bc354f3fa2d90f8f5f722ba0 (127.11.146.2:37007)
I20260809 15:31:12.488620 18345 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.146.2@KRBTEST.COM'} at 127.11.146.2:35513
I20260809 15:31:12.492496 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.3:37151
--local_ip_for_outbound_sockets=127.11.146.3
--tserver_master_addrs=127.11.146.62:40039
--webserver_port=41525
--webserver_interface=127.11.146.3
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.3.keytab
--principal=oryx/127.11.146.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:44781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.146.62:40039,127.11.146.61:33205
--tserver_master_addrs=127.11.146.62:40039,127.11.146.61:33205,127.11.146.60:45561 with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:31:12.510138 19360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.506072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51668 (local address 127.11.146.60:45561)
0809 15:31:12.506206 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:12.506211 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:12.506229 (+ 18us) server_negotiation.cc:407] Connection header received
0809 15:31:12.506360 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:12.506363 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:12.506435 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:12.506561 (+ 126us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:31:12.506781 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.507615 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.508793 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.509510 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.509624 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.509808 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:12.509897 (+ 89us) server_negotiation.cc:299] Negotiation successful
0809 15:31:12.509968 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 15:31:12.510129 18929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.505991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:45561 (local address 127.0.0.1:51668)
0809 15:31:12.506136 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:12.506154 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:12.506250 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:12.506577 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:12.506578 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:12.506593 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:31:12.506681 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.506685 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.507765 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.507768 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.508658 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.508671 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.509693 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.509696 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.509772 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.509796 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 15:31:12.509877 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 15:31:12.509942 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260809 15:31:12.511056 19180 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260809 15:31:12.511487 19209 sys_catalog.cc:455] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader f57efaf1e2f9446bbf8749519c42eb75. Latest consensus state: current_term: 1 leader_uuid: "f57efaf1e2f9446bbf8749519c42eb75" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: false } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: NON_VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: true } } }
I20260809 15:31:12.511785 19209 sys_catalog.cc:458] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [sys.catalog]: This master's current role is: LEARNER
W20260809 15:31:12.613765 19510 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:12.614120 19510 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:12.614207 19510 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:12.618314 19510 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:12.618408 19510 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:12.618515 19510 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.3
I20260809 15:31:12.624032 19510 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:44781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.3.keytab
--principal=oryx/127.11.146.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.3:37151
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.146.3
--webserver_port=41525
--tserver_master_addrs=127.11.146.62:40039,127.11.146.61:33205,127.11.146.60:45561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19510
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.3
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:12.625234 19510 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:12.626278 19510 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:12.636350 19518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:12.636523 19510 server_base.cc:1034] running on GCE node
W20260809 15:31:12.636380 19516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:12.636356 19515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:12.637135 19510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:12.637773 19510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:12.638962 19510 hybrid_clock.cc:648] HybridClock initialized: now 1786289472638931 us; error 41 us; skew 500 ppm
Aug 09 15:31:12 dist-test-slave-1jjb krb5kdc[18298](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289472, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:12.642306 19510 init.cc:377] Logged in from keytab as oryx/127.11.146.3@KRBTEST.COM (short username oryx)
I20260809 15:31:12.643173 19510 webserver.cc:460] Webserver started at http://127.11.146.3:41525/ using document root <none> and password file <none>
I20260809 15:31:12.643769 19510 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:12.643882 19510 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:12.647758 19510 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:31:12.650079 19525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:12.651340 19510 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 15:31:12.651485 19510 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-2/wal
uuid: "1241cab0d60e4684834cdd1d140b5d86"
format_stamp: "Formatted at 2026-08-09 15:31:11 on dist-test-slave-1jjb"
server_key: "8b149cedd7798d22230aec0ee0b1ae2c"
server_key_iv: "a95469c01fb549b9d7a1ecee90941bf8"
server_key_version: "encryptionkey@0"
I20260809 15:31:12.652038 19510 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:12.672931 19510 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:12.676297 19510 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:12.676504 19510 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:12.677121 19510 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:31:12.678035 19510 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:12.678108 19510 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:12.678180 19510 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:12.678232 19510 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:12.687762 19510 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.3:37151
I20260809 15:31:12.687786 19644 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.3:37151 every 8 connection(s)
I20260809 15:31:12.688843 19510 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
I20260809 15:31:12.690290 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 19510
Aug 09 15:31:12 dist-test-slave-1jjb krb5kdc[18298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289472, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.60@KRBTEST.COM
Aug 09 15:31:12 dist-test-slave-1jjb krb5kdc[18298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289472, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.61@KRBTEST.COM
Aug 09 15:31:12 dist-test-slave-1jjb krb5kdc[18298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289472, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM
I20260809 15:31:12.708655 19360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.691215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:54639 (local address 127.11.146.60:45561)
0809 15:31:12.691339 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:12.691344 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:12.692418 (+ 1074us) server_negotiation.cc:407] Connection header received
0809 15:31:12.693740 (+ 1322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:12.693744 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:12.693799 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:12.693853 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:12.696045 (+ 2192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.696895 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.698678 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.699012 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.699102 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.703817 (+ 4715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:12.703822 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:12.703827 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:12.703856 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:12.705656 (+ 1800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:12.706376 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:12.706394 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:12.706396 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:12.706488 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:12.706914 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:12.706920 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:12.706924 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:12.707162 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:12.707260 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:12.708335 (+ 1075us) server_negotiation.cc:299] Negotiation successful
0809 15:31:12.708486 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 15:31:12.708691 19105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.690713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:35605 (local address 127.11.146.61:33205)
0809 15:31:12.690894 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:12.690899 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:12.691993 (+ 1094us) server_negotiation.cc:407] Connection header received
0809 15:31:12.693740 (+ 1747us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:12.693744 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:12.693799 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:12.693853 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:12.696047 (+ 2194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.696901 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.698674 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.698969 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.699055 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.705177 (+ 6122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:12.705183 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:12.705189 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:12.705219 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:12.706875 (+ 1656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:12.707346 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:12.707349 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:12.707351 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:12.707435 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:12.707749 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:12.707752 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:12.707754 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:12.707982 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:12.708062 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:12.708455 (+ 393us) server_negotiation.cc:299] Negotiation successful
0809 15:31:12.708564 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260809 15:31:12.709587 19652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.691212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:33205 (local address 127.11.146.3:35605)
0809 15:31:12.691833 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:12.691889 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:12.693491 (+ 1602us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:12.694183 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:12.694192 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:12.694950 (+ 758us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:12.695890 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.695901 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.697072 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.697076 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.698536 (+ 1460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.698558 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.699266 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.699272 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.699534 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.701308 (+ 1774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:12.701322 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:12.704303 (+ 2981us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:12.707003 (+ 2700us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:12.707006 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:12.707008 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:12.707238 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:12.707548 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:12.707551 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:12.707553 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:12.707641 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:12.708156 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:12.708158 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:12.708240 (+ 82us) client_negotiation.cc:769] Sending connection context
0809 15:31:12.708915 (+ 675us) client_negotiation.cc:240] Negotiation successful
0809 15:31:12.709061 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":416,"mutex_wait_us":558,"spinlock_wait_cycles":14592,"thread_start_us":151,"threads_started":1}
I20260809 15:31:12.710261 19654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.691212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:45561 (local address 127.11.146.3:54639)
0809 15:31:12.692299 (+ 1087us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:12.692315 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:12.693491 (+ 1176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:12.694184 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:12.694192 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:12.695133 (+ 941us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:12.695855 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.695879 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.697070 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.697074 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.698539 (+ 1465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.698550 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.699266 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.699270 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.699538 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.700501 (+ 963us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:12.700523 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:12.703602 (+ 3079us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:12.705780 (+ 2178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:12.705871 (+ 91us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:12.705888 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:12.706249 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:12.706604 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:12.706608 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:12.706610 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:12.706797 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:12.707319 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:12.707329 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:12.707687 (+ 358us) client_negotiation.cc:769] Sending connection context
0809 15:31:12.707915 (+ 228us) client_negotiation.cc:240] Negotiation successful
0809 15:31:12.708476 (+ 561us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":996,"mutex_wait_us":276,"spinlock_wait_cycles":24320,"thread_start_us":153,"threads_started":1}
I20260809 15:31:12.710942 19647 heartbeater.cc:347] Connected to a master server at 127.11.146.61:33205
I20260809 15:31:12.711076 19645 heartbeater.cc:347] Connected to a master server at 127.11.146.60:45561
I20260809 15:31:12.711180 19647 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:12.711180 19645 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:12.711472 19659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.693853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56974 (local address 127.11.146.61:33205)
0809 15:31:12.694478 (+ 625us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:12.694483 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:12.694808 (+ 325us) server_negotiation.cc:407] Connection header received
0809 15:31:12.694961 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:12.694964 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:12.695010 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:12.695082 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:12.696210 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.696944 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.698173 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.698518 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.698632 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.701304 (+ 2672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:12.701308 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:12.701310 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:12.701337 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:12.703887 (+ 2550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:12.709775 (+ 5888us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:12.709782 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:12.709786 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:12.709877 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:12.710421 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:12.710427 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:12.710432 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:12.710683 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:12.710802 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:12.711172 (+ 370us) server_negotiation.cc:299] Negotiation successful
0809 15:31:12.711306 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":92,"threads_started":1}
I20260809 15:31:12.711927 19647 heartbeater.cc:511] Master 127.11.146.61:33205 requested a full tablet report, sending...
I20260809 15:31:12.712209 18385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.692673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:53437 (local address 127.11.146.62:40039)
0809 15:31:12.692792 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:12.692797 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:12.692813 (+ 16us) server_negotiation.cc:407] Connection header received
0809 15:31:12.693847 (+ 1034us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:12.693850 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:12.693904 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:12.693987 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:12.699965 (+ 5978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.700855 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.702054 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.702450 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.702554 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.705670 (+ 3116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:12.705674 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:12.705679 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:12.705710 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:12.707847 (+ 2137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:12.710588 (+ 2741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:12.710591 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:12.710593 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:12.710677 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:12.711014 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:12.711018 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:12.711020 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:12.711251 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:12.711337 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:12.711886 (+ 549us) server_negotiation.cc:299] Negotiation successful
0809 15:31:12.712023 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 15:31:12.713182 19655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.692333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.11.146.3:53437)
0809 15:31:12.692632 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:12.692646 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:12.693508 (+ 862us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:12.694186 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:12.694195 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:12.694857 (+ 662us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:12.697348 (+ 2491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.697368 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.701004 (+ 3636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.701007 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.701904 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.701917 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.702736 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.702739 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.702857 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.703349 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:12.703370 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:12.705475 (+ 2105us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:12.707979 (+ 2504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:12.707983 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:12.707986 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:12.708314 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:12.710803 (+ 2489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:12.710806 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:12.710808 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:12.710901 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:12.711397 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:12.711400 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:12.711488 (+ 88us) client_negotiation.cc:769] Sending connection context
0809 15:31:12.712342 (+ 854us) client_negotiation.cc:240] Negotiation successful
0809 15:31:12.712951 (+ 609us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"mutex_wait_us":1679,"thread_start_us":80,"threads_started":1}
I20260809 15:31:12.713379 18977 ts_manager.cc:194] Registered new tserver with Master: 1241cab0d60e4684834cdd1d140b5d86 (127.11.146.3:37151)
I20260809 15:31:12.712042 19645 heartbeater.cc:511] Master 127.11.146.60:45561 requested a full tablet report, sending...
I20260809 15:31:12.713876 19646 heartbeater.cc:347] Connected to a master server at 127.11.146.62:40039
I20260809 15:31:12.713963 19646 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:12.714170 19170 ts_manager.cc:194] Registered new tserver with Master: 1241cab0d60e4684834cdd1d140b5d86 (127.11.146.3:37151)
I20260809 15:31:12.714175 19646 heartbeater.cc:511] Master 127.11.146.62:40039 requested a full tablet report, sending...
I20260809 15:31:12.714912 18345 ts_manager.cc:194] Re-registered known tserver with Master: 1241cab0d60e4684834cdd1d140b5d86 (127.11.146.3:37151)
I20260809 15:31:12.715198 19657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.693153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41820 (local address 127.11.146.62:40039)
0809 15:31:12.693373 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:12.693377 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:12.695673 (+ 2296us) server_negotiation.cc:407] Connection header received
0809 15:31:12.695739 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:12.695742 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:12.695791 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:12.695964 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:12.696892 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.697711 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.698828 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.699167 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.699259 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.702811 (+ 3552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:12.702815 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:12.702818 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:12.702845 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:12.705358 (+ 2513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:12.709499 (+ 4141us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:12.709502 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:12.709504 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:12.709617 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:12.710174 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:12.710177 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:12.710179 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:12.714060 (+ 3881us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:12.714209 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:12.714840 (+ 631us) server_negotiation.cc:299] Negotiation successful
0809 15:31:12.714989 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":81,"threads_started":1}
I20260809 15:31:12.715687 18345 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.146.3@KRBTEST.COM'} at 127.11.146.3:53437
I20260809 15:31:12.716063 19656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.693093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51674 (local address 127.11.146.60:45561)
0809 15:31:12.693327 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:12.693331 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:12.694598 (+ 1267us) server_negotiation.cc:407] Connection header received
0809 15:31:12.694739 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:12.694745 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:12.694804 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:12.694904 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:12.700740 (+ 5836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.701491 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.706433 (+ 4942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.706885 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.706975 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.712164 (+ 5189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:12.712168 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:12.712170 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:12.712196 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:12.714121 (+ 1925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:12.714661 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:12.714665 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:12.714667 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:12.714758 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:12.715105 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:12.715108 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:12.715110 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:12.715334 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:12.715483 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:12.715746 (+ 263us) server_negotiation.cc:299] Negotiation successful
0809 15:31:12.715877 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"spinlock_wait_cycles":1920,"thread_start_us":103,"threads_started":1}
I20260809 15:31:12.718801 18345 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41820:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:31:12.722251 18345 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:31:12.724958 18934 sys_catalog.cc:455] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f57efaf1e2f9446bbf8749519c42eb75" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: false } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: NON_VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: true } } }
I20260809 15:31:12.725132 18934 sys_catalog.cc:458] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:12.729372 19663 raft_consensus.cc:1050] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75: attempting to promote NON_VOTER 967c09c37c92447ab8a318d8352867ab to VOTER
I20260809 15:31:12.729755 19663 consensus_queue.cc:237] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: false } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: false } }
I20260809 15:31:12.731276 19180 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [term 1 LEARNER]: Refusing update from remote peer f57efaf1e2f9446bbf8749519c42eb75: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260809 15:31:12.731321 18988 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [term 1 FOLLOWER]: Refusing update from remote peer f57efaf1e2f9446bbf8749519c42eb75: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260809 15:31:12.731726 19665 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260809 15:31:12.731987 19663 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260809 15:31:12.733668 19665 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 967c09c37c92447ab8a318d8352867ab (127.11.146.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: false } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: false } } }
I20260809 15:31:12.734463 19180 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 967c09c37c92447ab8a318d8352867ab (127.11.146.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: false } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: false } } }
I20260809 15:31:12.735272 19665 sys_catalog.cc:455] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "f57efaf1e2f9446bbf8749519c42eb75" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: false } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: false } } }
I20260809 15:31:12.735423 19665 sys_catalog.cc:458] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:12.735800 19663 sys_catalog.cc:455] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f57efaf1e2f9446bbf8749519c42eb75" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: false } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: false } } }
I20260809 15:31:12.735960 19663 sys_catalog.cc:458] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:12.737105 19209 sys_catalog.cc:455] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f57efaf1e2f9446bbf8749519c42eb75" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: false } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: false } } }
I20260809 15:31:12.737224 19209 sys_catalog.cc:458] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:31:12.737479 19665 sys_catalog.cc:455] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f57efaf1e2f9446bbf8749519c42eb75" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: false } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: false } } }
I20260809 15:31:12.737596 19665 sys_catalog.cc:458] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75 [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:12.738178 18988 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 967c09c37c92447ab8a318d8352867ab (127.11.146.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: false } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: false } } }
I20260809 15:31:12.740129 19673 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f57efaf1e2f9446bbf8749519c42eb75" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: false } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: false } } }
I20260809 15:31:12.740324 19673 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:31:12.746829 18929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.741310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:37007 (local address 127.0.0.1:43764)
0809 15:31:12.741890 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:12.741903 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:12.741973 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:12.742995 (+ 1022us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:12.742998 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:12.743024 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:31:12.743129 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.743135 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.744458 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.744462 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.745524 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.745533 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.746443 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.746446 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.746531 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.746553 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 15:31:12.746619 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 15:31:12.746693 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":117,"threads_started":1}
I20260809 15:31:12.746886 19678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.742151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43764 (local address 127.11.146.2:37007)
0809 15:31:12.742455 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:12.742469 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:12.742503 (+ 34us) server_negotiation.cc:407] Connection header received
0809 15:31:12.742595 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:12.742602 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:12.742840 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:12.743011 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:31:12.743276 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.744304 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.745646 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.746308 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.746445 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.746608 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:12.746661 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 15:31:12.746745 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":120,"threads_started":1}
I20260809 15:31:12.749709 19676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.741046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:37151 (local address 127.0.0.1:39248)
0809 15:31:12.741592 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:12.741608 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:12.741702 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:12.745260 (+ 3558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:12.745263 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:12.745285 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:31:12.745376 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.745383 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.746868 (+ 1485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.746871 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.748007 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.748027 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.749237 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.749241 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.749398 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.749435 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 15:31:12.749511 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 15:31:12.749586 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454}
I20260809 15:31:12.750324 19674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.741214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39248 (local address 127.11.146.3:37151)
0809 15:31:12.744810 (+ 3596us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:12.744822 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:12.744844 (+ 22us) server_negotiation.cc:407] Connection header received
0809 15:31:12.744916 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:12.744921 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:12.745111 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:12.745532 (+ 421us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:31:12.745658 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.746737 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.748287 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.749111 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.749215 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.749339 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:12.750041 (+ 702us) server_negotiation.cc:299] Negotiation successful
0809 15:31:12.750185 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3491,"thread_start_us":108,"threads_started":1}
I20260809 15:31:12.750326 19433 tablet_service.cc:1467] Processing CreateTablet for tablet 741e334b5c664f3b93db9445f035ec2f (DEFAULT_TABLE table=test-table [id=5bd17ed20c8b4f6b8772eabfc516287c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:31:12.751430 19433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 741e334b5c664f3b93db9445f035ec2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:12.753363 19576 tablet_service.cc:1467] Processing CreateTablet for tablet 741e334b5c664f3b93db9445f035ec2f (DEFAULT_TABLE table=test-table [id=5bd17ed20c8b4f6b8772eabfc516287c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:31:12.753971 19677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.741644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:37663 (local address 127.0.0.1:55552)
0809 15:31:12.742852 (+ 1208us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:12.742867 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:12.742957 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:12.750095 (+ 7138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:12.750098 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:12.750115 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:31:12.750218 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.750223 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.751506 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.751511 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.752720 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.752731 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.753529 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.753533 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.753635 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.753659 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 15:31:12.753759 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 15:31:12.753837 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1149,"thread_start_us":81,"threads_started":1}
I20260809 15:31:12.754448 19576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 741e334b5c664f3b93db9445f035ec2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:12.754712 19679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.742643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55552 (local address 127.11.146.1:37663)
0809 15:31:12.749528 (+ 6885us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:12.749535 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:12.749559 (+ 24us) server_negotiation.cc:407] Connection header received
0809 15:31:12.749643 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:12.749648 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:12.749821 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:12.749949 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:31:12.750339 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.751374 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.752863 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.753397 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.753527 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.753678 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:12.753788 (+ 110us) server_negotiation.cc:299] Negotiation successful
0809 15:31:12.754586 (+ 798us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6774,"thread_start_us":79,"threads_started":1}
I20260809 15:31:12.757509 19289 tablet_service.cc:1467] Processing CreateTablet for tablet 741e334b5c664f3b93db9445f035ec2f (DEFAULT_TABLE table=test-table [id=5bd17ed20c8b4f6b8772eabfc516287c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:31:12.758406 19289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 741e334b5c664f3b93db9445f035ec2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:12.761436 19680 tablet_bootstrap.cc:492] T 741e334b5c664f3b93db9445f035ec2f P 5ddb4be8bc354f3fa2d90f8f5f722ba0: Bootstrap starting.
I20260809 15:31:12.762529 19681 tablet_bootstrap.cc:492] T 741e334b5c664f3b93db9445f035ec2f P 1241cab0d60e4684834cdd1d140b5d86: Bootstrap starting.
I20260809 15:31:12.764273 19680 tablet_bootstrap.cc:654] T 741e334b5c664f3b93db9445f035ec2f P 5ddb4be8bc354f3fa2d90f8f5f722ba0: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:12.764508 19681 tablet_bootstrap.cc:654] T 741e334b5c664f3b93db9445f035ec2f P 1241cab0d60e4684834cdd1d140b5d86: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:12.765200 19680 log.cc:824] T 741e334b5c664f3b93db9445f035ec2f P 5ddb4be8bc354f3fa2d90f8f5f722ba0: Log is configured to *not* fsync() on all Append() calls
I20260809 15:31:12.765245 19681 log.cc:824] T 741e334b5c664f3b93db9445f035ec2f P 1241cab0d60e4684834cdd1d140b5d86: Log is configured to *not* fsync() on all Append() calls
I20260809 15:31:12.765600 19682 tablet_bootstrap.cc:492] T 741e334b5c664f3b93db9445f035ec2f P 3911b5d8312f41a7abb4264402dcc625: Bootstrap starting.
I20260809 15:31:12.767534 19680 tablet_bootstrap.cc:492] T 741e334b5c664f3b93db9445f035ec2f P 5ddb4be8bc354f3fa2d90f8f5f722ba0: No bootstrap required, opened a new log
I20260809 15:31:12.767580 19682 tablet_bootstrap.cc:654] T 741e334b5c664f3b93db9445f035ec2f P 3911b5d8312f41a7abb4264402dcc625: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:12.767706 19681 tablet_bootstrap.cc:492] T 741e334b5c664f3b93db9445f035ec2f P 1241cab0d60e4684834cdd1d140b5d86: No bootstrap required, opened a new log
I20260809 15:31:12.767745 19680 ts_tablet_manager.cc:1397] T 741e334b5c664f3b93db9445f035ec2f P 5ddb4be8bc354f3fa2d90f8f5f722ba0: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260809 15:31:12.767897 19681 ts_tablet_manager.cc:1397] T 741e334b5c664f3b93db9445f035ec2f P 1241cab0d60e4684834cdd1d140b5d86: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260809 15:31:12.768373 19682 log.cc:824] T 741e334b5c664f3b93db9445f035ec2f P 3911b5d8312f41a7abb4264402dcc625: Log is configured to *not* fsync() on all Append() calls
I20260809 15:31:12.770386 19682 tablet_bootstrap.cc:492] T 741e334b5c664f3b93db9445f035ec2f P 3911b5d8312f41a7abb4264402dcc625: No bootstrap required, opened a new log
I20260809 15:31:12.770570 19682 ts_tablet_manager.cc:1397] T 741e334b5c664f3b93db9445f035ec2f P 3911b5d8312f41a7abb4264402dcc625: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 15:31:12.771665 19680 raft_consensus.cc:348] T 741e334b5c664f3b93db9445f035ec2f P 5ddb4be8bc354f3fa2d90f8f5f722ba0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1241cab0d60e4684834cdd1d140b5d86" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37151 } } peers { permanent_uuid: "5ddb4be8bc354f3fa2d90f8f5f722ba0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 37007 } } peers { permanent_uuid: "3911b5d8312f41a7abb4264402dcc625" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37663 } }
I20260809 15:31:12.771952 19680 raft_consensus.cc:374] T 741e334b5c664f3b93db9445f035ec2f P 5ddb4be8bc354f3fa2d90f8f5f722ba0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:12.772013 19680 raft_consensus.cc:729] T 741e334b5c664f3b93db9445f035ec2f P 5ddb4be8bc354f3fa2d90f8f5f722ba0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ddb4be8bc354f3fa2d90f8f5f722ba0, State: Initialized, Role: FOLLOWER
I20260809 15:31:12.772512 19680 consensus_queue.cc:260] T 741e334b5c664f3b93db9445f035ec2f P 5ddb4be8bc354f3fa2d90f8f5f722ba0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1241cab0d60e4684834cdd1d140b5d86" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37151 } } peers { permanent_uuid: "5ddb4be8bc354f3fa2d90f8f5f722ba0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 37007 } } peers { permanent_uuid: "3911b5d8312f41a7abb4264402dcc625" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37663 } }
I20260809 15:31:12.772459 19681 raft_consensus.cc:348] T 741e334b5c664f3b93db9445f035ec2f P 1241cab0d60e4684834cdd1d140b5d86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1241cab0d60e4684834cdd1d140b5d86" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37151 } } peers { permanent_uuid: "5ddb4be8bc354f3fa2d90f8f5f722ba0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 37007 } } peers { permanent_uuid: "3911b5d8312f41a7abb4264402dcc625" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37663 } }
I20260809 15:31:12.772714 19681 raft_consensus.cc:374] T 741e334b5c664f3b93db9445f035ec2f P 1241cab0d60e4684834cdd1d140b5d86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:12.772783 19681 raft_consensus.cc:729] T 741e334b5c664f3b93db9445f035ec2f P 1241cab0d60e4684834cdd1d140b5d86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1241cab0d60e4684834cdd1d140b5d86, State: Initialized, Role: FOLLOWER
I20260809 15:31:12.773202 19681 consensus_queue.cc:260] T 741e334b5c664f3b93db9445f035ec2f P 1241cab0d60e4684834cdd1d140b5d86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1241cab0d60e4684834cdd1d140b5d86" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37151 } } peers { permanent_uuid: "5ddb4be8bc354f3fa2d90f8f5f722ba0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 37007 } } peers { permanent_uuid: "3911b5d8312f41a7abb4264402dcc625" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37663 } }
I20260809 15:31:12.773640 19680 ts_tablet_manager.cc:1428] T 741e334b5c664f3b93db9445f035ec2f P 5ddb4be8bc354f3fa2d90f8f5f722ba0: Time spent starting tablet: real 0.006s user 0.001s sys 0.005s
I20260809 15:31:12.774049 19503 heartbeater.cc:503] Master 127.11.146.62:40039 was elected leader, sending a full tablet report...
I20260809 15:31:12.774086 19681 ts_tablet_manager.cc:1428] T 741e334b5c664f3b93db9445f035ec2f P 1241cab0d60e4684834cdd1d140b5d86: Time spent starting tablet: real 0.006s user 0.004s sys 0.003s
I20260809 15:31:12.775024 19646 heartbeater.cc:503] Master 127.11.146.62:40039 was elected leader, sending a full tablet report...
I20260809 15:31:12.776595 19682 raft_consensus.cc:348] T 741e334b5c664f3b93db9445f035ec2f P 3911b5d8312f41a7abb4264402dcc625 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1241cab0d60e4684834cdd1d140b5d86" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37151 } } peers { permanent_uuid: "5ddb4be8bc354f3fa2d90f8f5f722ba0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 37007 } } peers { permanent_uuid: "3911b5d8312f41a7abb4264402dcc625" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37663 } }
I20260809 15:31:12.776860 19682 raft_consensus.cc:374] T 741e334b5c664f3b93db9445f035ec2f P 3911b5d8312f41a7abb4264402dcc625 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:12.776911 19682 raft_consensus.cc:729] T 741e334b5c664f3b93db9445f035ec2f P 3911b5d8312f41a7abb4264402dcc625 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3911b5d8312f41a7abb4264402dcc625, State: Initialized, Role: FOLLOWER
I20260809 15:31:12.777824 19682 consensus_queue.cc:260] T 741e334b5c664f3b93db9445f035ec2f P 3911b5d8312f41a7abb4264402dcc625 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1241cab0d60e4684834cdd1d140b5d86" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37151 } } peers { permanent_uuid: "5ddb4be8bc354f3fa2d90f8f5f722ba0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 37007 } } peers { permanent_uuid: "3911b5d8312f41a7abb4264402dcc625" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37663 } }
I20260809 15:31:12.778807 19682 ts_tablet_manager.cc:1428] T 741e334b5c664f3b93db9445f035ec2f P 3911b5d8312f41a7abb4264402dcc625: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260809 15:31:12.779423 19357 heartbeater.cc:503] Master 127.11.146.62:40039 was elected leader, sending a full tablet report...
I20260809 15:31:12.878410 19686 raft_consensus.cc:482] T 741e334b5c664f3b93db9445f035ec2f P 5ddb4be8bc354f3fa2d90f8f5f722ba0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:31:12.878729 19686 raft_consensus.cc:504] T 741e334b5c664f3b93db9445f035ec2f P 5ddb4be8bc354f3fa2d90f8f5f722ba0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1241cab0d60e4684834cdd1d140b5d86" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37151 } } peers { permanent_uuid: "5ddb4be8bc354f3fa2d90f8f5f722ba0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 37007 } } peers { permanent_uuid: "3911b5d8312f41a7abb4264402dcc625" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37663 } }
I20260809 15:31:12.880043 19686 leader_election.cc:288] T 741e334b5c664f3b93db9445f035ec2f P 5ddb4be8bc354f3fa2d90f8f5f722ba0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1241cab0d60e4684834cdd1d140b5d86 (127.11.146.3:37151), 3911b5d8312f41a7abb4264402dcc625 (127.11.146.1:37663)
I20260809 15:31:12.885406 19508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.880798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:37663 (local address 127.11.146.2:59569)
0809 15:31:12.880949 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:12.880963 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:12.881028 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:12.881380 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:12.881384 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:12.881401 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:31:12.881487 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.881491 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.882574 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.882577 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.883835 (+ 1258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.883847 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.884886 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.884891 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.885025 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.885060 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 15:31:12.885141 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 15:31:12.885202 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"mutex_wait_us":46}
I20260809 15:31:12.885437 19679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.880937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:59569 (local address 127.11.146.1:37663)
0809 15:31:12.881116 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:12.881121 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:12.881137 (+ 16us) server_negotiation.cc:407] Connection header received
0809 15:31:12.881201 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:12.881207 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:12.881263 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:12.881330 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:31:12.881600 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.882432 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.884000 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.884728 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.884863 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.884921 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:12.885188 (+ 267us) server_negotiation.cc:299] Negotiation successful
0809 15:31:12.885286 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 15:31:12.885535 19507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.880414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:37151 (local address 127.11.146.2:46355)
0809 15:31:12.880620 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:12.880638 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:12.880759 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:12.881135 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:12.881138 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:12.881160 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:31:12.881264 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.881269 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.882480 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.882483 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.883835 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:12.883847 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.885023 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.885027 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:12.885154 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.885184 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 15:31:12.885272 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 15:31:12.885343 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"mutex_wait_us":29}
I20260809 15:31:12.885571 19674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.880554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:46355 (local address 127.11.146.3:37151)
0809 15:31:12.880711 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:12.880717 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:12.880735 (+ 18us) server_negotiation.cc:407] Connection header received
0809 15:31:12.880913 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:12.880920 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:12.881010 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:12.881112 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:31:12.881411 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.882339 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.884000 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.884722 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.884863 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.884921 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:12.885342 (+ 421us) server_negotiation.cc:299] Negotiation successful
0809 15:31:12.885438 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 15:31:12.886245 19309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "741e334b5c664f3b93db9445f035ec2f" candidate_uuid: "5ddb4be8bc354f3fa2d90f8f5f722ba0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3911b5d8312f41a7abb4264402dcc625" is_pre_election: true
I20260809 15:31:12.886245 19597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "741e334b5c664f3b93db9445f035ec2f" candidate_uuid: "5ddb4be8bc354f3fa2d90f8f5f722ba0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1241cab0d60e4684834cdd1d140b5d86" is_pre_election: true
I20260809 15:31:12.886572 19309 raft_consensus.cc:2454] T 741e334b5c664f3b93db9445f035ec2f P 3911b5d8312f41a7abb4264402dcc625 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ddb4be8bc354f3fa2d90f8f5f722ba0 in term 0.
I20260809 15:31:12.886579 19597 raft_consensus.cc:2454] T 741e334b5c664f3b93db9445f035ec2f P 1241cab0d60e4684834cdd1d140b5d86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ddb4be8bc354f3fa2d90f8f5f722ba0 in term 0.
I20260809 15:31:12.887123 19383 leader_election.cc:302] T 741e334b5c664f3b93db9445f035ec2f P 5ddb4be8bc354f3fa2d90f8f5f722ba0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3911b5d8312f41a7abb4264402dcc625, 5ddb4be8bc354f3fa2d90f8f5f722ba0; no voters:
I20260809 15:31:12.887449 19686 raft_consensus.cc:2781] T 741e334b5c664f3b93db9445f035ec2f P 5ddb4be8bc354f3fa2d90f8f5f722ba0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:31:12.887535 19686 raft_consensus.cc:482] T 741e334b5c664f3b93db9445f035ec2f P 5ddb4be8bc354f3fa2d90f8f5f722ba0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:31:12.887602 19686 raft_consensus.cc:3037] T 741e334b5c664f3b93db9445f035ec2f P 5ddb4be8bc354f3fa2d90f8f5f722ba0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:12.888820 19686 raft_consensus.cc:504] T 741e334b5c664f3b93db9445f035ec2f P 5ddb4be8bc354f3fa2d90f8f5f722ba0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1241cab0d60e4684834cdd1d140b5d86" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37151 } } peers { permanent_uuid: "5ddb4be8bc354f3fa2d90f8f5f722ba0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 37007 } } peers { permanent_uuid: "3911b5d8312f41a7abb4264402dcc625" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37663 } }
I20260809 15:31:12.889207 19686 leader_election.cc:288] T 741e334b5c664f3b93db9445f035ec2f P 5ddb4be8bc354f3fa2d90f8f5f722ba0 [CANDIDATE]: Term 1 election: Requested vote from peers 1241cab0d60e4684834cdd1d140b5d86 (127.11.146.3:37151), 3911b5d8312f41a7abb4264402dcc625 (127.11.146.1:37663)
I20260809 15:31:12.889638 19597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "741e334b5c664f3b93db9445f035ec2f" candidate_uuid: "5ddb4be8bc354f3fa2d90f8f5f722ba0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1241cab0d60e4684834cdd1d140b5d86"
I20260809 15:31:12.889787 19309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "741e334b5c664f3b93db9445f035ec2f" candidate_uuid: "5ddb4be8bc354f3fa2d90f8f5f722ba0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3911b5d8312f41a7abb4264402dcc625"
I20260809 15:31:12.889793 19597 raft_consensus.cc:3037] T 741e334b5c664f3b93db9445f035ec2f P 1241cab0d60e4684834cdd1d140b5d86 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:12.889968 19309 raft_consensus.cc:3037] T 741e334b5c664f3b93db9445f035ec2f P 3911b5d8312f41a7abb4264402dcc625 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:12.891176 19309 raft_consensus.cc:2454] T 741e334b5c664f3b93db9445f035ec2f P 3911b5d8312f41a7abb4264402dcc625 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ddb4be8bc354f3fa2d90f8f5f722ba0 in term 1.
I20260809 15:31:12.891305 19597 raft_consensus.cc:2454] T 741e334b5c664f3b93db9445f035ec2f P 1241cab0d60e4684834cdd1d140b5d86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ddb4be8bc354f3fa2d90f8f5f722ba0 in term 1.
I20260809 15:31:12.891641 19383 leader_election.cc:302] T 741e334b5c664f3b93db9445f035ec2f P 5ddb4be8bc354f3fa2d90f8f5f722ba0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3911b5d8312f41a7abb4264402dcc625, 5ddb4be8bc354f3fa2d90f8f5f722ba0; no voters:
I20260809 15:31:12.891832 19686 raft_consensus.cc:2781] T 741e334b5c664f3b93db9445f035ec2f P 5ddb4be8bc354f3fa2d90f8f5f722ba0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:31:12.892129 19686 raft_consensus.cc:686] T 741e334b5c664f3b93db9445f035ec2f P 5ddb4be8bc354f3fa2d90f8f5f722ba0 [term 1 LEADER]: Becoming Leader. State: Replica: 5ddb4be8bc354f3fa2d90f8f5f722ba0, State: Running, Role: LEADER
I20260809 15:31:12.892536 19686 consensus_queue.cc:237] T 741e334b5c664f3b93db9445f035ec2f P 5ddb4be8bc354f3fa2d90f8f5f722ba0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1241cab0d60e4684834cdd1d140b5d86" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37151 } } peers { permanent_uuid: "5ddb4be8bc354f3fa2d90f8f5f722ba0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 37007 } } peers { permanent_uuid: "3911b5d8312f41a7abb4264402dcc625" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37663 } }
I20260809 15:31:12.896319 18345 catalog_manager.cc:5495] T 741e334b5c664f3b93db9445f035ec2f P 5ddb4be8bc354f3fa2d90f8f5f722ba0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ddb4be8bc354f3fa2d90f8f5f722ba0 (127.11.146.2). New cstate: current_term: 1 leader_uuid: "5ddb4be8bc354f3fa2d90f8f5f722ba0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1241cab0d60e4684834cdd1d140b5d86" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ddb4be8bc354f3fa2d90f8f5f722ba0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 37007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3911b5d8312f41a7abb4264402dcc625" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37663 } health_report { overall_health: UNKNOWN } } }
W20260809 15:31:12.940762 19648 tablet.cc:2369] T 741e334b5c664f3b93db9445f035ec2f P 1241cab0d60e4684834cdd1d140b5d86: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:31:12.941254 19678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.937389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43780 (local address 127.11.146.2:37007)
0809 15:31:12.937524 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:12.937528 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:12.937540 (+ 12us) server_negotiation.cc:407] Connection header received
0809 15:31:12.937617 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:12.937619 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:12.937671 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:12.937762 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:31:12.938053 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.938554 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.939492 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.939746 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.939832 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.940250 (+ 418us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:31:12.940740 (+ 490us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:31:12.940854 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:12.940988 (+ 134us) server_negotiation.cc:299] Negotiation successful
0809 15:31:12.941083 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 15:31:12.947084 19597 raft_consensus.cc:1261] T 741e334b5c664f3b93db9445f035ec2f P 1241cab0d60e4684834cdd1d140b5d86 [term 1 FOLLOWER]: Refusing update from remote peer 5ddb4be8bc354f3fa2d90f8f5f722ba0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:31:12.947085 19309 raft_consensus.cc:1261] T 741e334b5c664f3b93db9445f035ec2f P 3911b5d8312f41a7abb4264402dcc625 [term 1 FOLLOWER]: Refusing update from remote peer 5ddb4be8bc354f3fa2d90f8f5f722ba0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:31:12.947803 19689 consensus_queue.cc:1035] T 741e334b5c664f3b93db9445f035ec2f P 5ddb4be8bc354f3fa2d90f8f5f722ba0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1241cab0d60e4684834cdd1d140b5d86" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:31:12.948002 19686 consensus_queue.cc:1035] T 741e334b5c664f3b93db9445f035ec2f P 5ddb4be8bc354f3fa2d90f8f5f722ba0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3911b5d8312f41a7abb4264402dcc625" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:31:12.955832 19695 mvcc.cc:205] Tried to move back new op lower bound from 7316641681184227328 to 7316641680970559488. Current Snapshot: MvccSnapshot[applied={T|T < 7316641681184227328}]
I20260809 15:31:12.959303 19693 mvcc.cc:205] Tried to move back new op lower bound from 7316641681184227328 to 7316641680970559488. Current Snapshot: MvccSnapshot[applied={T|T < 7316641681184227328 or (T in {7316641681184227328})}]
I20260809 15:31:12.962567 19694 mvcc.cc:205] Tried to move back new op lower bound from 7316641681184227328 to 7316641680970559488. Current Snapshot: MvccSnapshot[applied={T|T < 7316641681184227328}]
I20260809 15:31:12.966745 18344 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41820:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:31:12.966935 18344 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41820:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:31:12.971694 18344 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f57efaf1e2f9446bbf8749519c42eb75: Sending DeleteTablet for 3 replicas of tablet 741e334b5c664f3b93db9445f035ec2f
I20260809 15:31:12.973289 19576 tablet_service.cc:1514] Processing DeleteTablet for tablet 741e334b5c664f3b93db9445f035ec2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:31:12 UTC) from {username='oryx', principal='oryx/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:39248
I20260809 15:31:12.973379 19433 tablet_service.cc:1514] Processing DeleteTablet for tablet 741e334b5c664f3b93db9445f035ec2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:31:12 UTC) from {username='oryx', principal='oryx/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:43764
I20260809 15:31:12.973888 19289 tablet_service.cc:1514] Processing DeleteTablet for tablet 741e334b5c664f3b93db9445f035ec2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:31:12 UTC) from {username='oryx', principal='oryx/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:55552
I20260809 15:31:12.974478 19705 tablet_replica.cc:330] T 741e334b5c664f3b93db9445f035ec2f P 5ddb4be8bc354f3fa2d90f8f5f722ba0: stopping tablet replica
I20260809 15:31:12.974856 19705 raft_consensus.cc:2229] T 741e334b5c664f3b93db9445f035ec2f P 5ddb4be8bc354f3fa2d90f8f5f722ba0 [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:31:12.975244 19705 raft_consensus.cc:2258] T 741e334b5c664f3b93db9445f035ec2f P 5ddb4be8bc354f3fa2d90f8f5f722ba0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:31:12.976167 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 18312
I20260809 15:31:12.978124 19703 tablet_replica.cc:330] T 741e334b5c664f3b93db9445f035ec2f P 1241cab0d60e4684834cdd1d140b5d86: stopping tablet replica
I20260809 15:31:12.978464 19703 raft_consensus.cc:2229] T 741e334b5c664f3b93db9445f035ec2f P 1241cab0d60e4684834cdd1d140b5d86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:31:12.978801 19703 raft_consensus.cc:2258] T 741e334b5c664f3b93db9445f035ec2f P 1241cab0d60e4684834cdd1d140b5d86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:31:12.980607 19705 ts_tablet_manager.cc:1905] T 741e334b5c664f3b93db9445f035ec2f P 5ddb4be8bc354f3fa2d90f8f5f722ba0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:31:12.983466 19705 ts_tablet_manager.cc:1918] T 741e334b5c664f3b93db9445f035ec2f P 5ddb4be8bc354f3fa2d90f8f5f722ba0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:31:12.983589 19705 log.cc:1196] T 741e334b5c664f3b93db9445f035ec2f P 5ddb4be8bc354f3fa2d90f8f5f722ba0: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-1/wal/wals/741e334b5c664f3b93db9445f035ec2f
I20260809 15:31:12.983923 19705 ts_tablet_manager.cc:1939] T 741e334b5c664f3b93db9445f035ec2f P 5ddb4be8bc354f3fa2d90f8f5f722ba0: Deleting consensus metadata
I20260809 15:31:12.986673 19703 ts_tablet_manager.cc:1905] T 741e334b5c664f3b93db9445f035ec2f P 1241cab0d60e4684834cdd1d140b5d86: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:31:12.988972 19659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.974277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56990 (local address 127.11.146.61:33205)
0809 15:31:12.974413 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:12.974419 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:12.974433 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:31:12.974476 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:12.974479 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:12.974533 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:12.974618 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:12.978647 (+ 4029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.979569 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.981026 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.981479 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.981581 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.983741 (+ 2160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:12.983748 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:12.983754 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:12.983789 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:12.986659 (+ 2870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:12.987258 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:12.987264 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:12.987269 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:12.987365 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:12.987695 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:12.987701 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:12.987706 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:12.987963 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:12.988122 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:12.988547 (+ 425us) server_negotiation.cc:299] Negotiation successful
0809 15:31:12.988719 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260809 15:31:12.989279 19383 connection.cc:535] server connection from 127.0.0.1:43764 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 15:31:12.990614 19706 tablet_replica.cc:330] T 741e334b5c664f3b93db9445f035ec2f P 3911b5d8312f41a7abb4264402dcc625: stopping tablet replica
I20260809 15:31:12.990947 19706 raft_consensus.cc:2229] T 741e334b5c664f3b93db9445f035ec2f P 3911b5d8312f41a7abb4264402dcc625 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:31:12.991956 19706 raft_consensus.cc:2258] T 741e334b5c664f3b93db9445f035ec2f P 3911b5d8312f41a7abb4264402dcc625 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:31:12.992877 19703 ts_tablet_manager.cc:1918] T 741e334b5c664f3b93db9445f035ec2f P 1241cab0d60e4684834cdd1d140b5d86: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:31:12.992978 19703 log.cc:1196] T 741e334b5c664f3b93db9445f035ec2f P 1241cab0d60e4684834cdd1d140b5d86: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-2/wal/wals/741e334b5c664f3b93db9445f035ec2f
I20260809 15:31:12.993304 19703 ts_tablet_manager.cc:1939] T 741e334b5c664f3b93db9445f035ec2f P 1241cab0d60e4684834cdd1d140b5d86: Deleting consensus metadata
I20260809 15:31:12.994758 19706 ts_tablet_manager.cc:1905] T 741e334b5c664f3b93db9445f035ec2f P 3911b5d8312f41a7abb4264402dcc625: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:31:12.997419 19706 ts_tablet_manager.cc:1918] T 741e334b5c664f3b93db9445f035ec2f P 3911b5d8312f41a7abb4264402dcc625: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:31:12.997534 19706 log.cc:1196] T 741e334b5c664f3b93db9445f035ec2f P 3911b5d8312f41a7abb4264402dcc625: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-0/wal/wals/741e334b5c664f3b93db9445f035ec2f
I20260809 15:31:12.997865 19706 ts_tablet_manager.cc:1939] T 741e334b5c664f3b93db9445f035ec2f P 3911b5d8312f41a7abb4264402dcc625: Deleting consensus metadata
W20260809 15:31:12.999025 19237 connection.cc:441] server connection from 127.0.0.1:55552 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55552 (request call id 1) could send its response
W20260809 15:31:13.000164 19528 connection.cc:441] server connection from 127.0.0.1:39248 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39248 (request call id 1) could send its response
I20260809 15:31:13.001057 19656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.974695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51680 (local address 127.11.146.60:45561)
0809 15:31:12.974809 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:12.974813 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:12.991214 (+ 16401us) server_negotiation.cc:407] Connection header received
0809 15:31:12.991343 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:12.991346 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:12.991402 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:12.991515 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:12.992498 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.993307 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.994408 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.994764 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.994839 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:12.996669 (+ 1830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:12.996673 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:12.996676 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:12.996703 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:12.998464 (+ 1761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:12.998954 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:12.998958 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:12.998960 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:12.999065 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:12.999385 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:12.999391 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:12.999394 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:13.000221 (+ 827us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:13.000374 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:13.000758 (+ 384us) server_negotiation.cc:299] Negotiation successful
0809 15:31:13.000894 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 15:31:13.005577 19360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.993347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51690 (local address 127.11.146.60:45561)
0809 15:31:12.993508 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:12.993512 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:12.994499 (+ 987us) server_negotiation.cc:407] Connection header received
0809 15:31:12.994648 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:12.994651 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:12.994691 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:12.994741 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:12.996437 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.997223 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.998678 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:12.999036 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:12.999120 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:13.001479 (+ 2359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:13.001483 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:13.001486 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:13.001514 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:13.003592 (+ 2078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:13.004171 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:13.004177 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:13.004181 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:13.004281 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:13.004606 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:13.004610 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:13.004612 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:13.004847 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:13.005003 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:13.005282 (+ 279us) server_negotiation.cc:299] Negotiation successful
0809 15:31:13.005408 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 15:31:13.011085 19659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:12.992874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56998 (local address 127.11.146.61:33205)
0809 15:31:12.992983 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:12.992987 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:13.001614 (+ 8627us) server_negotiation.cc:407] Connection header received
0809 15:31:13.001843 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:13.001848 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:13.001913 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:13.001984 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:13.003064 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:13.003914 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:13.005312 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:13.005694 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:13.005789 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:13.007530 (+ 1741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:13.007534 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:13.007537 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:13.007566 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:13.009233 (+ 1667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:13.009728 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:13.009732 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:13.009735 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:13.009838 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:13.010143 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:13.010148 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:13.010150 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:13.010350 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:13.010493 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:13.010758 (+ 265us) server_negotiation.cc:299] Negotiation successful
0809 15:31:13.010903 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 15:31:13.961236 19715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:13.960740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.11.146.3:56651)
0809 15:31:13.961005 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:13.961110 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":108,"threads_started":1}
W20260809 15:31:13.961621 19646 heartbeater.cc:644] Failed to heartbeat to 127.11.146.62:40039 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
I20260809 15:31:13.962910 19716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:13.962403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.11.146.2:34047)
0809 15:31:13.962672 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:13.962787 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":73,"threads_started":1}
W20260809 15:31:13.963577 19503 heartbeater.cc:644] Failed to heartbeat to 127.11.146.62:40039 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
I20260809 15:31:13.966324 19717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:13.965978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.11.146.1:44119)
0809 15:31:13.966180 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:13.966250 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":59,"threads_started":1}
W20260809 15:31:13.966611 19357 heartbeater.cc:644] Failed to heartbeat to 127.11.146.62:40039 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
I20260809 15:31:14.472623 19718 raft_consensus.cc:482] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f57efaf1e2f9446bbf8749519c42eb75)
I20260809 15:31:14.472865 19718 raft_consensus.cc:504] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: false } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: false } }
I20260809 15:31:14.473309 19719 raft_consensus.cc:482] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f57efaf1e2f9446bbf8749519c42eb75)
I20260809 15:31:14.473484 19719 raft_consensus.cc:504] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: false } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: false } }
I20260809 15:31:14.474488 19719 leader_election.cc:288] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f57efaf1e2f9446bbf8749519c42eb75 (127.11.146.62:40039), 967c09c37c92447ab8a318d8352867ab (127.11.146.60:45561)
I20260809 15:31:14.474799 19718 leader_election.cc:288] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f57efaf1e2f9446bbf8749519c42eb75 (127.11.146.62:40039), e6aa47478e2e4531ac29d13cbb23eb63 (127.11.146.61:33205)
I20260809 15:31:14.475237 19722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:14.474593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.0.0.1:42348)
0809 15:31:14.475036 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:14.475128 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":54,"threads_started":1}
W20260809 15:31:14.475473 18963 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
I20260809 15:31:14.475926 19720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:14.474167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.0.0.1:42338)
0809 15:31:14.475748 (+ 1581us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:14.475826 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1498,"thread_start_us":73,"threads_started":1}
W20260809 15:31:14.476199 19157 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
I20260809 15:31:14.476497 19722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:14.476223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.0.0.1:42352)
0809 15:31:14.476370 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:14.476429 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
W20260809 15:31:14.476651 18963 leader_election.cc:334] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f57efaf1e2f9446bbf8749519c42eb75 (127.11.146.62:40039): Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
I20260809 15:31:14.477393 19720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:14.477155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.0.0.1:42358)
0809 15:31:14.477279 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:14.477333 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260809 15:31:14.477569 19157 leader_election.cc:334] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f57efaf1e2f9446bbf8749519c42eb75 (127.11.146.62:40039): Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
I20260809 15:31:14.479646 19723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:14.474660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:45561 (local address 127.0.0.1:51696)
0809 15:31:14.475049 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:14.475064 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:14.475165 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:14.475868 (+ 703us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:14.475871 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:14.475891 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:31:14.476016 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:14.476024 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:14.477130 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:14.477135 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:14.478463 (+ 1328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:14.478475 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:14.479272 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:14.479275 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:14.479356 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:14.479379 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 15:31:14.479473 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 15:31:14.479534 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":60,"threads_started":1}
I20260809 15:31:14.479700 19724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:14.474840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51696 (local address 127.11.146.60:45561)
0809 15:31:14.475353 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:14.475358 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:14.475371 (+ 13us) server_negotiation.cc:407] Connection header received
0809 15:31:14.475414 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:14.475417 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:14.475466 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:14.475706 (+ 240us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:31:14.476223 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:14.477015 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:14.478637 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:14.479124 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:14.479240 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:14.479300 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:14.479510 (+ 210us) server_negotiation.cc:299] Negotiation successful
0809 15:31:14.479585 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":446,"thread_start_us":50,"threads_started":1}
I20260809 15:31:14.480212 19180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "967c09c37c92447ab8a318d8352867ab" is_pre_election: true
I20260809 15:31:14.480396 19721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:14.474592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:33205 (local address 127.0.0.1:57010)
0809 15:31:14.476037 (+ 1445us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:14.476052 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:14.476168 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:14.476663 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:14.476667 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:14.476682 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:31:14.476757 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:14.476762 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:14.477822 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:14.477825 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:14.478922 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:14.478933 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:14.479946 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:14.479950 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:14.480040 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:14.480065 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 15:31:14.480201 (+ 136us) client_negotiation.cc:240] Negotiation successful
0809 15:31:14.480276 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1381,"thread_start_us":58,"threads_started":1}
I20260809 15:31:14.480404 19726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:14.474849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57010 (local address 127.11.146.61:33205)
0809 15:31:14.476369 (+ 1520us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:14.476373 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:14.476386 (+ 13us) server_negotiation.cc:407] Connection header received
0809 15:31:14.476422 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:14.476425 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:14.476491 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:14.476569 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:31:14.476870 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:14.477630 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:14.479055 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:14.479721 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:14.479953 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:14.480006 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:14.480217 (+ 211us) server_negotiation.cc:299] Negotiation successful
0809 15:31:14.480283 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1456,"thread_start_us":66,"threads_started":1}
I20260809 15:31:14.480482 19180 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6aa47478e2e4531ac29d13cbb23eb63 in term 1.
I20260809 15:31:14.480888 18962 leader_election.cc:302] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 967c09c37c92447ab8a318d8352867ab, e6aa47478e2e4531ac29d13cbb23eb63; no voters: f57efaf1e2f9446bbf8749519c42eb75
I20260809 15:31:14.480911 18988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "967c09c37c92447ab8a318d8352867ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" is_pre_election: true
I20260809 15:31:14.481130 18988 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 967c09c37c92447ab8a318d8352867ab in term 1.
I20260809 15:31:14.481225 19719 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260809 15:31:14.481293 19719 raft_consensus.cc:482] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f57efaf1e2f9446bbf8749519c42eb75)
I20260809 15:31:14.481369 19719 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [term 1 FOLLOWER]: Advancing to term 2
I20260809 15:31:14.481544 19157 leader_election.cc:302] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 967c09c37c92447ab8a318d8352867ab, e6aa47478e2e4531ac29d13cbb23eb63; no voters: f57efaf1e2f9446bbf8749519c42eb75
I20260809 15:31:14.481750 19718 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260809 15:31:14.481809 19718 raft_consensus.cc:482] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [term 1 FOLLOWER]: Starting leader election (detected failure of leader f57efaf1e2f9446bbf8749519c42eb75)
I20260809 15:31:14.481848 19718 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [term 1 FOLLOWER]: Advancing to term 2
I20260809 15:31:14.482566 19719 raft_consensus.cc:504] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: false } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: false } }
I20260809 15:31:14.482859 19718 raft_consensus.cc:504] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: false } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: false } }
I20260809 15:31:14.482978 19719 leader_election.cc:288] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [CANDIDATE]: Term 2 election: Requested vote from peers f57efaf1e2f9446bbf8749519c42eb75 (127.11.146.62:40039), 967c09c37c92447ab8a318d8352867ab (127.11.146.60:45561)
I20260809 15:31:14.483249 19718 leader_election.cc:288] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [CANDIDATE]: Term 2 election: Requested vote from peers f57efaf1e2f9446bbf8749519c42eb75 (127.11.146.62:40039), e6aa47478e2e4531ac29d13cbb23eb63 (127.11.146.61:33205)
I20260809 15:31:14.483393 19180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "967c09c37c92447ab8a318d8352867ab"
I20260809 15:31:14.483564 19180 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e6aa47478e2e4531ac29d13cbb23eb63 in current term 2: Already voted for candidate 967c09c37c92447ab8a318d8352867ab in this term.
I20260809 15:31:14.483743 19721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:14.483483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.0.0.1:42376)
0809 15:31:14.483602 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:14.483658 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260809 15:31:14.483832 18988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "967c09c37c92447ab8a318d8352867ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e6aa47478e2e4531ac29d13cbb23eb63"
I20260809 15:31:14.483978 18988 raft_consensus.cc:2379] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 967c09c37c92447ab8a318d8352867ab in current term 2: Already voted for candidate e6aa47478e2e4531ac29d13cbb23eb63 in this term.
I20260809 15:31:14.483739 19723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:14.483075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.0.0.1:42362)
0809 15:31:14.483196 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:14.483255 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 15:31:14.484586 19721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:14.484353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.0.0.1:42386)
0809 15:31:14.484472 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:14.484516 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 15:31:14.484704 19157 leader_election.cc:334] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f57efaf1e2f9446bbf8749519c42eb75 (127.11.146.62:40039): Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
I20260809 15:31:14.484745 19723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:14.484519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.0.0.1:42390)
0809 15:31:14.484639 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:14.484695 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260809 15:31:14.484778 19157 leader_election.cc:302] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 967c09c37c92447ab8a318d8352867ab; no voters: e6aa47478e2e4531ac29d13cbb23eb63, f57efaf1e2f9446bbf8749519c42eb75
W20260809 15:31:14.484849 18963 leader_election.cc:334] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f57efaf1e2f9446bbf8749519c42eb75 (127.11.146.62:40039): Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
I20260809 15:31:14.484913 19718 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260809 15:31:14.484925 18963 leader_election.cc:302] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6aa47478e2e4531ac29d13cbb23eb63; no voters: 967c09c37c92447ab8a318d8352867ab, f57efaf1e2f9446bbf8749519c42eb75
I20260809 15:31:14.485070 19719 raft_consensus.cc:2726] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260809 15:31:14.962865 19729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:14.962331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.11.146.3:59129)
0809 15:31:14.962660 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:14.962736 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":125,"threads_started":1}
I20260809 15:31:14.964576 19730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:14.964122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.11.146.2:58093)
0809 15:31:14.964374 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:14.964448 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":81,"threads_started":1}
I20260809 15:31:14.967406 19731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:14.967075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.11.146.1:55769)
0809 15:31:14.967281 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:14.967330 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":69,"threads_started":1}
I20260809 15:31:15.964380 19732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:15.963701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.11.146.3:51669)
0809 15:31:15.964171 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:15.964251 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":121,"threads_started":1}
I20260809 15:31:15.965677 19733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:15.965213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.11.146.2:34529)
0809 15:31:15.965476 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:15.965553 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":78,"threads_started":1}
I20260809 15:31:15.968402 19734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:15.968033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.11.146.1:47671)
0809 15:31:15.968263 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:15.968325 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":95,"threads_started":1}
I20260809 15:31:16.054709 19735 raft_consensus.cc:482] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:31:16.054850 19735 raft_consensus.cc:504] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: false } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: false } }
I20260809 15:31:16.055353 19735 leader_election.cc:288] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f57efaf1e2f9446bbf8749519c42eb75 (127.11.146.62:40039), e6aa47478e2e4531ac29d13cbb23eb63 (127.11.146.61:33205)
I20260809 15:31:16.056201 19736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:16.055732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.0.0.1:42608)
0809 15:31:16.055989 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:16.056066 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":108,"threads_started":1}
I20260809 15:31:16.056497 18988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "967c09c37c92447ab8a318d8352867ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" is_pre_election: true
I20260809 15:31:16.056680 18988 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 967c09c37c92447ab8a318d8352867ab in term 2.
I20260809 15:31:16.057104 19157 leader_election.cc:302] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 967c09c37c92447ab8a318d8352867ab, e6aa47478e2e4531ac29d13cbb23eb63; no voters:
I20260809 15:31:16.057353 19735 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260809 15:31:16.057426 19735 raft_consensus.cc:482] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:31:16.057502 19735 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [term 2 FOLLOWER]: Advancing to term 3
I20260809 15:31:16.057637 19736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:16.056920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.0.0.1:42624)
0809 15:31:16.057435 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:16.057491 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":419}
W20260809 15:31:16.057730 19157 leader_election.cc:334] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f57efaf1e2f9446bbf8749519c42eb75 (127.11.146.62:40039): Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
I20260809 15:31:16.058657 19735 raft_consensus.cc:504] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: false } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: false } }
I20260809 15:31:16.058996 19735 leader_election.cc:288] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [CANDIDATE]: Term 3 election: Requested vote from peers f57efaf1e2f9446bbf8749519c42eb75 (127.11.146.62:40039), e6aa47478e2e4531ac29d13cbb23eb63 (127.11.146.61:33205)
I20260809 15:31:16.059335 19736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:16.059141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.0.0.1:42638)
0809 15:31:16.059243 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:16.059288 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260809 15:31:16.059530 18988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "967c09c37c92447ab8a318d8352867ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e6aa47478e2e4531ac29d13cbb23eb63"
I20260809 15:31:16.059644 18988 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [term 2 FOLLOWER]: Advancing to term 3
I20260809 15:31:16.060774 19736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:16.060510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.0.0.1:42652)
0809 15:31:16.060634 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:16.060696 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260809 15:31:16.060794 18988 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 967c09c37c92447ab8a318d8352867ab in term 3.
W20260809 15:31:16.060899 19157 leader_election.cc:334] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f57efaf1e2f9446bbf8749519c42eb75 (127.11.146.62:40039): Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
I20260809 15:31:16.061088 19157 leader_election.cc:302] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 967c09c37c92447ab8a318d8352867ab, e6aa47478e2e4531ac29d13cbb23eb63; no voters: f57efaf1e2f9446bbf8749519c42eb75
I20260809 15:31:16.061268 19735 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [term 3 FOLLOWER]: Leader election won for term 3
I20260809 15:31:16.061501 19735 raft_consensus.cc:686] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [term 3 LEADER]: Becoming Leader. State: Replica: 967c09c37c92447ab8a318d8352867ab, State: Running, Role: LEADER
I20260809 15:31:16.061789 19735 consensus_queue.cc:237] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: false } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: false } }
I20260809 15:31:16.063212 19738 sys_catalog.cc:455] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 967c09c37c92447ab8a318d8352867ab. Latest consensus state: current_term: 3 leader_uuid: "967c09c37c92447ab8a318d8352867ab" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: false } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: false } } }
I20260809 15:31:16.063328 19738 sys_catalog.cc:458] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:16.063627 19740 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:31:16.066138 19740 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:31:16.066648 19740 catalog_manager.cc:1259] Loaded cluster ID: 748ddb72d29049e8886e1c4a8a559dae
I20260809 15:31:16.066759 19740 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:31:16.067507 19740 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:31:16.067859 19740 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab: Loaded TSK: 0
I20260809 15:31:16.068598 19740 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:31:16.151515 19169 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51690:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:31:16.154603 19169 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:31:16.158109 19736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:16.157793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.0.0.1:42668)
0809 15:31:16.157962 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:16.158028 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 15:31:16.158355 18988 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [term 3 FOLLOWER]: Refusing update from remote peer 967c09c37c92447ab8a318d8352867ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260809 15:31:16.158946 19736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:16.158740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.0.0.1:42676)
0809 15:31:16.158846 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:16.158891 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260809 15:31:16.159062 19738 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260809 15:31:16.159263 19157 consensus_peers.cc:487] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab -> Peer f57efaf1e2f9446bbf8749519c42eb75 (127.11.146.62:40039): Couldn't send request to peer f57efaf1e2f9446bbf8749519c42eb75. Status: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 15:31:16.160687 19742 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 967c09c37c92447ab8a318d8352867ab. Latest consensus state: current_term: 3 leader_uuid: "967c09c37c92447ab8a318d8352867ab" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: false } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: false } } }
I20260809 15:31:16.160830 19742 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:31:16.161978 19738 sys_catalog.cc:455] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "967c09c37c92447ab8a318d8352867ab" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: false } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: false } } }
I20260809 15:31:16.162176 19738 sys_catalog.cc:458] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:16.162240 19742 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "967c09c37c92447ab8a318d8352867ab" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "f57efaf1e2f9446bbf8749519c42eb75" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 40039 } } peers { permanent_uuid: "e6aa47478e2e4531ac29d13cbb23eb63" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 33205 } attrs { promote: false } } peers { permanent_uuid: "967c09c37c92447ab8a318d8352867ab" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45561 } attrs { promote: false } } }
I20260809 15:31:16.162577 19742 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6aa47478e2e4531ac29d13cbb23eb63 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:31:16.173022 19736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:16.168569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:37007 (local address 127.0.0.1:43784)
0809 15:31:16.169154 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:16.169170 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:16.169258 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:16.169576 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:16.169580 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:16.169598 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:31:16.169698 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:16.169702 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:16.170747 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:16.170751 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:16.171785 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:16.171794 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:16.172709 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:16.172712 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:16.172777 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:16.172797 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 15:31:16.172858 (+ 61us) client_negotiation.cc:240] Negotiation successful
0809 15:31:16.172911 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"mutex_wait_us":34,"thread_start_us":94,"threads_started":1}
I20260809 15:31:16.173080 19750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:16.168788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43784 (local address 127.11.146.2:37007)
0809 15:31:16.169313 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:16.169317 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:16.169331 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:31:16.169385 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:16.169391 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:16.169442 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:16.169564 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:31:16.169803 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:16.170627 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:16.171943 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:16.172592 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:16.172698 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:16.172764 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:16.172872 (+ 108us) server_negotiation.cc:299] Negotiation successful
0809 15:31:16.172948 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":70,"threads_started":1}
I20260809 15:31:16.173646 19433 tablet_service.cc:1467] Processing CreateTablet for tablet 98c222dd2e2143b9ad5cdfa362b7e883 (DEFAULT_TABLE table=test-table [id=0886552c3a574f569e41e3361cb3eb31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:31:16.173979 19433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98c222dd2e2143b9ad5cdfa362b7e883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:16.176383 19753 tablet_bootstrap.cc:492] T 98c222dd2e2143b9ad5cdfa362b7e883 P 5ddb4be8bc354f3fa2d90f8f5f722ba0: Bootstrap starting.
I20260809 15:31:16.176579 19751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:16.168335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:37663 (local address 127.0.0.1:55564)
0809 15:31:16.169159 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:16.169175 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:16.169325 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:16.169712 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:16.169715 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:16.169737 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:31:16.169842 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:16.169847 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:16.170851 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:16.170854 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:16.172387 (+ 1533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:16.172399 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:16.173322 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:16.173325 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:16.176201 (+ 2876us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:16.176228 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 15:31:16.176375 (+ 147us) client_negotiation.cc:240] Negotiation successful
0809 15:31:16.176453 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":745,"mutex_wait_us":89}
I20260809 15:31:16.176599 19748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:16.168454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55564 (local address 127.11.146.1:37663)
0809 15:31:16.168796 (+ 342us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:16.168801 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:16.169252 (+ 451us) server_negotiation.cc:407] Connection header received
0809 15:31:16.169446 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:16.169449 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:16.169520 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:16.169578 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:31:16.169966 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:16.170716 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:16.172525 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:16.173131 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:16.173240 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:16.173312 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:16.176388 (+ 3076us) server_negotiation.cc:299] Negotiation successful
0809 15:31:16.176471 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255,"thread_start_us":79,"threads_started":1}
I20260809 15:31:16.177192 19749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:16.168888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:37151 (local address 127.0.0.1:39254)
0809 15:31:16.169422 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:16.169436 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:16.169515 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:16.169966 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:16.169969 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:16.169985 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:31:16.170067 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:16.170072 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:16.170851 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:16.170854 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:16.172393 (+ 1539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:16.172399 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:16.173987 (+ 1588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:16.173992 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:16.176812 (+ 2820us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:16.176849 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 15:31:16.176989 (+ 140us) client_negotiation.cc:240] Negotiation successful
0809 15:31:16.177073 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"mutex_wait_us":2314,"thread_start_us":95,"threads_started":1}
I20260809 15:31:16.177227 19752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:16.169014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39254 (local address 127.11.146.3:37151)
0809 15:31:16.169486 (+ 472us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:16.169491 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:16.169506 (+ 15us) server_negotiation.cc:407] Connection header received
0809 15:31:16.169816 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:16.169818 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:16.169858 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:16.169953 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:31:16.170182 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:16.170744 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:16.173368 (+ 2624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:16.173857 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:16.173958 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:16.174005 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:16.177016 (+ 3011us) server_negotiation.cc:299] Negotiation successful
0809 15:31:16.177119 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":105,"threads_started":1}
I20260809 15:31:16.177259 19289 tablet_service.cc:1467] Processing CreateTablet for tablet 98c222dd2e2143b9ad5cdfa362b7e883 (DEFAULT_TABLE table=test-table [id=0886552c3a574f569e41e3361cb3eb31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:31:16.177554 19289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98c222dd2e2143b9ad5cdfa362b7e883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:16.177920 19576 tablet_service.cc:1467] Processing CreateTablet for tablet 98c222dd2e2143b9ad5cdfa362b7e883 (DEFAULT_TABLE table=test-table [id=0886552c3a574f569e41e3361cb3eb31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:31:16.178205 19576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98c222dd2e2143b9ad5cdfa362b7e883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:16.179881 19754 tablet_bootstrap.cc:492] T 98c222dd2e2143b9ad5cdfa362b7e883 P 3911b5d8312f41a7abb4264402dcc625: Bootstrap starting.
I20260809 15:31:16.180325 19753 tablet_bootstrap.cc:654] T 98c222dd2e2143b9ad5cdfa362b7e883 P 5ddb4be8bc354f3fa2d90f8f5f722ba0: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:16.180787 19755 tablet_bootstrap.cc:492] T 98c222dd2e2143b9ad5cdfa362b7e883 P 1241cab0d60e4684834cdd1d140b5d86: Bootstrap starting.
I20260809 15:31:16.180992 19754 tablet_bootstrap.cc:654] T 98c222dd2e2143b9ad5cdfa362b7e883 P 3911b5d8312f41a7abb4264402dcc625: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:16.181742 19755 tablet_bootstrap.cc:654] T 98c222dd2e2143b9ad5cdfa362b7e883 P 1241cab0d60e4684834cdd1d140b5d86: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:16.181798 19753 tablet_bootstrap.cc:492] T 98c222dd2e2143b9ad5cdfa362b7e883 P 5ddb4be8bc354f3fa2d90f8f5f722ba0: No bootstrap required, opened a new log
I20260809 15:31:16.181921 19753 ts_tablet_manager.cc:1397] T 98c222dd2e2143b9ad5cdfa362b7e883 P 5ddb4be8bc354f3fa2d90f8f5f722ba0: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260809 15:31:16.182192 19754 tablet_bootstrap.cc:492] T 98c222dd2e2143b9ad5cdfa362b7e883 P 3911b5d8312f41a7abb4264402dcc625: No bootstrap required, opened a new log
I20260809 15:31:16.182296 19754 ts_tablet_manager.cc:1397] T 98c222dd2e2143b9ad5cdfa362b7e883 P 3911b5d8312f41a7abb4264402dcc625: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 15:31:16.182413 19753 raft_consensus.cc:348] T 98c222dd2e2143b9ad5cdfa362b7e883 P 5ddb4be8bc354f3fa2d90f8f5f722ba0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3911b5d8312f41a7abb4264402dcc625" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37663 } } peers { permanent_uuid: "5ddb4be8bc354f3fa2d90f8f5f722ba0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 37007 } } peers { permanent_uuid: "1241cab0d60e4684834cdd1d140b5d86" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37151 } }
I20260809 15:31:16.182539 19753 raft_consensus.cc:374] T 98c222dd2e2143b9ad5cdfa362b7e883 P 5ddb4be8bc354f3fa2d90f8f5f722ba0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:16.182564 19753 raft_consensus.cc:729] T 98c222dd2e2143b9ad5cdfa362b7e883 P 5ddb4be8bc354f3fa2d90f8f5f722ba0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ddb4be8bc354f3fa2d90f8f5f722ba0, State: Initialized, Role: FOLLOWER
I20260809 15:31:16.182708 19753 consensus_queue.cc:260] T 98c222dd2e2143b9ad5cdfa362b7e883 P 5ddb4be8bc354f3fa2d90f8f5f722ba0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3911b5d8312f41a7abb4264402dcc625" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37663 } } peers { permanent_uuid: "5ddb4be8bc354f3fa2d90f8f5f722ba0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 37007 } } peers { permanent_uuid: "1241cab0d60e4684834cdd1d140b5d86" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37151 } }
I20260809 15:31:16.182760 19754 raft_consensus.cc:348] T 98c222dd2e2143b9ad5cdfa362b7e883 P 3911b5d8312f41a7abb4264402dcc625 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3911b5d8312f41a7abb4264402dcc625" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37663 } } peers { permanent_uuid: "5ddb4be8bc354f3fa2d90f8f5f722ba0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 37007 } } peers { permanent_uuid: "1241cab0d60e4684834cdd1d140b5d86" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37151 } }
I20260809 15:31:16.182922 19754 raft_consensus.cc:374] T 98c222dd2e2143b9ad5cdfa362b7e883 P 3911b5d8312f41a7abb4264402dcc625 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:16.182988 19754 raft_consensus.cc:729] T 98c222dd2e2143b9ad5cdfa362b7e883 P 3911b5d8312f41a7abb4264402dcc625 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3911b5d8312f41a7abb4264402dcc625, State: Initialized, Role: FOLLOWER
I20260809 15:31:16.183081 19753 ts_tablet_manager.cc:1428] T 98c222dd2e2143b9ad5cdfa362b7e883 P 5ddb4be8bc354f3fa2d90f8f5f722ba0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 15:31:16.183117 19754 consensus_queue.cc:260] T 98c222dd2e2143b9ad5cdfa362b7e883 P 3911b5d8312f41a7abb4264402dcc625 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3911b5d8312f41a7abb4264402dcc625" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37663 } } peers { permanent_uuid: "5ddb4be8bc354f3fa2d90f8f5f722ba0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 37007 } } peers { permanent_uuid: "1241cab0d60e4684834cdd1d140b5d86" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37151 } }
I20260809 15:31:16.183544 19754 ts_tablet_manager.cc:1428] T 98c222dd2e2143b9ad5cdfa362b7e883 P 3911b5d8312f41a7abb4264402dcc625: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260809 15:31:16.183935 19733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:16.183535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.11.146.2:48879)
0809 15:31:16.183811 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:16.183868 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201}
I20260809 15:31:16.185000 19734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:16.184571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.11.146.1:48655)
0809 15:31:16.184876 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:16.184933 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235}
I20260809 15:31:16.185334 19755 tablet_bootstrap.cc:492] T 98c222dd2e2143b9ad5cdfa362b7e883 P 1241cab0d60e4684834cdd1d140b5d86: No bootstrap required, opened a new log
I20260809 15:31:16.185420 19755 ts_tablet_manager.cc:1397] T 98c222dd2e2143b9ad5cdfa362b7e883 P 1241cab0d60e4684834cdd1d140b5d86: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260809 15:31:16.186031 19502 heartbeater.cc:503] Master 127.11.146.60:45561 was elected leader, sending a full tablet report...
I20260809 15:31:16.185986 19755 raft_consensus.cc:348] T 98c222dd2e2143b9ad5cdfa362b7e883 P 1241cab0d60e4684834cdd1d140b5d86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3911b5d8312f41a7abb4264402dcc625" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37663 } } peers { permanent_uuid: "5ddb4be8bc354f3fa2d90f8f5f722ba0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 37007 } } peers { permanent_uuid: "1241cab0d60e4684834cdd1d140b5d86" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37151 } }
I20260809 15:31:16.186100 19755 raft_consensus.cc:374] T 98c222dd2e2143b9ad5cdfa362b7e883 P 1241cab0d60e4684834cdd1d140b5d86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:16.186133 19755 raft_consensus.cc:729] T 98c222dd2e2143b9ad5cdfa362b7e883 P 1241cab0d60e4684834cdd1d140b5d86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1241cab0d60e4684834cdd1d140b5d86, State: Initialized, Role: FOLLOWER
I20260809 15:31:16.186553 19356 heartbeater.cc:503] Master 127.11.146.60:45561 was elected leader, sending a full tablet report...
I20260809 15:31:16.186286 19755 consensus_queue.cc:260] T 98c222dd2e2143b9ad5cdfa362b7e883 P 1241cab0d60e4684834cdd1d140b5d86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3911b5d8312f41a7abb4264402dcc625" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37663 } } peers { permanent_uuid: "5ddb4be8bc354f3fa2d90f8f5f722ba0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 37007 } } peers { permanent_uuid: "1241cab0d60e4684834cdd1d140b5d86" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37151 } }
I20260809 15:31:16.187000 19755 ts_tablet_manager.cc:1428] T 98c222dd2e2143b9ad5cdfa362b7e883 P 1241cab0d60e4684834cdd1d140b5d86: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 15:31:16.187752 19732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:16.187463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.11.146.3:58277)
0809 15:31:16.187626 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:16.187683 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260809 15:31:16.188272 19734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:16.187571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.11.146.1:48897)
0809 15:31:16.188153 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:16.188203 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":514}
I20260809 15:31:16.188491 19733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:16.188196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.11.146.2:34017)
0809 15:31:16.188360 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:16.188423 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260809 15:31:16.189432 19732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:16.189207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.11.146.3:44141)
0809 15:31:16.189316 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:16.189369 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 15:31:16.189594 19645 heartbeater.cc:503] Master 127.11.146.60:45561 was elected leader, sending a full tablet report...
W20260809 15:31:16.215929 19505 tablet.cc:2369] T 98c222dd2e2143b9ad5cdfa362b7e883 P 5ddb4be8bc354f3fa2d90f8f5f722ba0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 15:31:16.237955 19359 tablet.cc:2369] T 98c222dd2e2143b9ad5cdfa362b7e883 P 3911b5d8312f41a7abb4264402dcc625: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:31:16.273449 19761 raft_consensus.cc:482] T 98c222dd2e2143b9ad5cdfa362b7e883 P 1241cab0d60e4684834cdd1d140b5d86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:31:16.273620 19761 raft_consensus.cc:504] T 98c222dd2e2143b9ad5cdfa362b7e883 P 1241cab0d60e4684834cdd1d140b5d86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3911b5d8312f41a7abb4264402dcc625" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37663 } } peers { permanent_uuid: "5ddb4be8bc354f3fa2d90f8f5f722ba0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 37007 } } peers { permanent_uuid: "1241cab0d60e4684834cdd1d140b5d86" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37151 } }
I20260809 15:31:16.274736 19761 leader_election.cc:288] T 98c222dd2e2143b9ad5cdfa362b7e883 P 1241cab0d60e4684834cdd1d140b5d86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3911b5d8312f41a7abb4264402dcc625 (127.11.146.1:37663), 5ddb4be8bc354f3fa2d90f8f5f722ba0 (127.11.146.2:37007)
I20260809 15:31:16.280156 19748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:16.275155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:40001 (local address 127.11.146.1:37663)
0809 15:31:16.275304 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:16.275311 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:16.275327 (+ 16us) server_negotiation.cc:407] Connection header received
0809 15:31:16.275506 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:16.275511 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:16.275792 (+ 281us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:16.275889 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:31:16.276254 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:16.277063 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:16.278688 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:16.279291 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:16.279439 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:16.279482 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:16.279920 (+ 438us) server_negotiation.cc:299] Negotiation successful
0809 15:31:16.280004 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 15:31:16.280156 19750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:16.275673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:51967 (local address 127.11.146.2:37007)
0809 15:31:16.275887 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:16.275891 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:16.276053 (+ 162us) server_negotiation.cc:407] Connection header received
0809 15:31:16.276176 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:16.276178 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:16.276245 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:16.276326 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:31:16.276569 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:16.277282 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:16.278688 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:16.279303 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:16.279422 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:16.279478 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:16.279918 (+ 440us) server_negotiation.cc:299] Negotiation successful
0809 15:31:16.280004 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260809 15:31:16.280196 19732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:16.275083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:37663 (local address 127.11.146.3:40001)
0809 15:31:16.275242 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:16.275259 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:16.275377 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:16.275906 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:16.275909 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:16.275931 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:31:16.276136 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:16.276146 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:16.277175 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:16.277177 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:16.278536 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:16.278543 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:16.279477 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:16.279482 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:16.279711 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:16.279785 (+ 74us) client_negotiation.cc:769] Sending connection context
0809 15:31:16.279878 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 15:31:16.279982 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":132}
I20260809 15:31:16.280206 19762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:16.275422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:37007 (local address 127.11.146.3:51967)
0809 15:31:16.275930 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:16.275943 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:16.276051 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:16.276345 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:16.276347 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:16.276365 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:31:16.276442 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:16.276446 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:16.277376 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:16.277380 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:16.278532 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:16.278543 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:16.279477 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:16.279482 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:16.279707 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:16.279788 (+ 81us) client_negotiation.cc:769] Sending connection context
0809 15:31:16.279876 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 15:31:16.279982 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"mutex_wait_us":139,"thread_start_us":273,"threads_started":1}
I20260809 15:31:16.280736 19309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98c222dd2e2143b9ad5cdfa362b7e883" candidate_uuid: "1241cab0d60e4684834cdd1d140b5d86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3911b5d8312f41a7abb4264402dcc625" is_pre_election: true
I20260809 15:31:16.280941 19309 raft_consensus.cc:2454] T 98c222dd2e2143b9ad5cdfa362b7e883 P 3911b5d8312f41a7abb4264402dcc625 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1241cab0d60e4684834cdd1d140b5d86 in term 0.
I20260809 15:31:16.281009 19453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98c222dd2e2143b9ad5cdfa362b7e883" candidate_uuid: "1241cab0d60e4684834cdd1d140b5d86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ddb4be8bc354f3fa2d90f8f5f722ba0" is_pre_election: true
I20260809 15:31:16.281286 19453 raft_consensus.cc:2454] T 98c222dd2e2143b9ad5cdfa362b7e883 P 5ddb4be8bc354f3fa2d90f8f5f722ba0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1241cab0d60e4684834cdd1d140b5d86 in term 0.
I20260809 15:31:16.281451 19526 leader_election.cc:302] T 98c222dd2e2143b9ad5cdfa362b7e883 P 1241cab0d60e4684834cdd1d140b5d86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1241cab0d60e4684834cdd1d140b5d86, 3911b5d8312f41a7abb4264402dcc625; no voters:
I20260809 15:31:16.281759 19761 raft_consensus.cc:2781] T 98c222dd2e2143b9ad5cdfa362b7e883 P 1241cab0d60e4684834cdd1d140b5d86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:31:16.281831 19761 raft_consensus.cc:482] T 98c222dd2e2143b9ad5cdfa362b7e883 P 1241cab0d60e4684834cdd1d140b5d86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:31:16.281886 19761 raft_consensus.cc:3037] T 98c222dd2e2143b9ad5cdfa362b7e883 P 1241cab0d60e4684834cdd1d140b5d86 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:16.282932 19761 raft_consensus.cc:504] T 98c222dd2e2143b9ad5cdfa362b7e883 P 1241cab0d60e4684834cdd1d140b5d86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3911b5d8312f41a7abb4264402dcc625" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37663 } } peers { permanent_uuid: "5ddb4be8bc354f3fa2d90f8f5f722ba0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 37007 } } peers { permanent_uuid: "1241cab0d60e4684834cdd1d140b5d86" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37151 } }
I20260809 15:31:16.283279 19761 leader_election.cc:288] T 98c222dd2e2143b9ad5cdfa362b7e883 P 1241cab0d60e4684834cdd1d140b5d86 [CANDIDATE]: Term 1 election: Requested vote from peers 3911b5d8312f41a7abb4264402dcc625 (127.11.146.1:37663), 5ddb4be8bc354f3fa2d90f8f5f722ba0 (127.11.146.2:37007)
I20260809 15:31:16.283659 19309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98c222dd2e2143b9ad5cdfa362b7e883" candidate_uuid: "1241cab0d60e4684834cdd1d140b5d86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3911b5d8312f41a7abb4264402dcc625"
I20260809 15:31:16.283792 19309 raft_consensus.cc:3037] T 98c222dd2e2143b9ad5cdfa362b7e883 P 3911b5d8312f41a7abb4264402dcc625 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:16.283936 19453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98c222dd2e2143b9ad5cdfa362b7e883" candidate_uuid: "1241cab0d60e4684834cdd1d140b5d86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ddb4be8bc354f3fa2d90f8f5f722ba0"
I20260809 15:31:16.284029 19453 raft_consensus.cc:3037] T 98c222dd2e2143b9ad5cdfa362b7e883 P 5ddb4be8bc354f3fa2d90f8f5f722ba0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:16.284788 19309 raft_consensus.cc:2454] T 98c222dd2e2143b9ad5cdfa362b7e883 P 3911b5d8312f41a7abb4264402dcc625 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1241cab0d60e4684834cdd1d140b5d86 in term 1.
I20260809 15:31:16.285020 19453 raft_consensus.cc:2454] T 98c222dd2e2143b9ad5cdfa362b7e883 P 5ddb4be8bc354f3fa2d90f8f5f722ba0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1241cab0d60e4684834cdd1d140b5d86 in term 1.
I20260809 15:31:16.285070 19526 leader_election.cc:302] T 98c222dd2e2143b9ad5cdfa362b7e883 P 1241cab0d60e4684834cdd1d140b5d86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1241cab0d60e4684834cdd1d140b5d86, 3911b5d8312f41a7abb4264402dcc625; no voters:
I20260809 15:31:16.285269 19761 raft_consensus.cc:2781] T 98c222dd2e2143b9ad5cdfa362b7e883 P 1241cab0d60e4684834cdd1d140b5d86 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:31:16.285552 19761 raft_consensus.cc:686] T 98c222dd2e2143b9ad5cdfa362b7e883 P 1241cab0d60e4684834cdd1d140b5d86 [term 1 LEADER]: Becoming Leader. State: Replica: 1241cab0d60e4684834cdd1d140b5d86, State: Running, Role: LEADER
I20260809 15:31:16.285851 19761 consensus_queue.cc:237] T 98c222dd2e2143b9ad5cdfa362b7e883 P 1241cab0d60e4684834cdd1d140b5d86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3911b5d8312f41a7abb4264402dcc625" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37663 } } peers { permanent_uuid: "5ddb4be8bc354f3fa2d90f8f5f722ba0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 37007 } } peers { permanent_uuid: "1241cab0d60e4684834cdd1d140b5d86" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37151 } }
I20260809 15:31:16.286350 19762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:16.286121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.11.146.3:34891)
0809 15:31:16.286216 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:16.286275 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260809 15:31:16.288486 19170 catalog_manager.cc:5495] T 98c222dd2e2143b9ad5cdfa362b7e883 P 1241cab0d60e4684834cdd1d140b5d86 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1241cab0d60e4684834cdd1d140b5d86 (127.11.146.3). New cstate: current_term: 1 leader_uuid: "1241cab0d60e4684834cdd1d140b5d86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3911b5d8312f41a7abb4264402dcc625" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ddb4be8bc354f3fa2d90f8f5f722ba0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 37007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1241cab0d60e4684834cdd1d140b5d86" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 37151 } health_report { overall_health: HEALTHY } } }
I20260809 15:31:16.326126 19752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:16.322800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39258 (local address 127.11.146.3:37151)
0809 15:31:16.322949 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:16.322953 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:16.322965 (+ 12us) server_negotiation.cc:407] Connection header received
0809 15:31:16.323039 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:16.323041 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:16.323097 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:16.323185 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:31:16.323457 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:16.323955 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:16.324861 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:16.325089 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:16.325167 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:16.325397 (+ 230us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:31:16.325816 (+ 419us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:31:16.325901 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:16.325974 (+ 73us) server_negotiation.cc:299] Negotiation successful
0809 15:31:16.326019 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 15:31:16.328912 19309 raft_consensus.cc:1261] T 98c222dd2e2143b9ad5cdfa362b7e883 P 3911b5d8312f41a7abb4264402dcc625 [term 1 FOLLOWER]: Refusing update from remote peer 1241cab0d60e4684834cdd1d140b5d86: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:31:16.329156 19453 raft_consensus.cc:1261] T 98c222dd2e2143b9ad5cdfa362b7e883 P 5ddb4be8bc354f3fa2d90f8f5f722ba0 [term 1 FOLLOWER]: Refusing update from remote peer 1241cab0d60e4684834cdd1d140b5d86: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:31:16.329484 19761 consensus_queue.cc:1035] T 98c222dd2e2143b9ad5cdfa362b7e883 P 1241cab0d60e4684834cdd1d140b5d86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3911b5d8312f41a7abb4264402dcc625" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:31:16.329782 19763 consensus_queue.cc:1035] T 98c222dd2e2143b9ad5cdfa362b7e883 P 1241cab0d60e4684834cdd1d140b5d86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ddb4be8bc354f3fa2d90f8f5f722ba0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:31:16.331573 19734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:16.331216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.11.146.1:50721)
0809 15:31:16.331400 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:16.331488 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260809 15:31:16.331938 19733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:16.331498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.11.146.2:34753)
0809 15:31:16.331781 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:16.331846 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195}
I20260809 15:31:16.336560 19762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:16.335775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.11.146.3:58511)
0809 15:31:16.336396 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:16.336463 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":498}
I20260809 15:31:16.337052 19734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:16.336754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.11.146.1:41873)
0809 15:31:16.336916 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:16.336973 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260809 15:31:16.339054 19733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:16.338791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:40039 (local address 127.11.146.2:52539)
0809 15:31:16.338923 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:16.338977 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260809 15:31:16.347007 19169 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51690:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:31:16.347167 19169 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51690:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:31:16.351418 19169 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 967c09c37c92447ab8a318d8352867ab: Sending DeleteTablet for 3 replicas of tablet 98c222dd2e2143b9ad5cdfa362b7e883
I20260809 15:31:16.352349 19433 tablet_service.cc:1514] Processing DeleteTablet for tablet 98c222dd2e2143b9ad5cdfa362b7e883 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:31:16 UTC) from {username='oryx', principal='oryx/127.11.146.60@KRBTEST.COM'} at 127.0.0.1:43784
I20260809 15:31:16.352373 19289 tablet_service.cc:1514] Processing DeleteTablet for tablet 98c222dd2e2143b9ad5cdfa362b7e883 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:31:16 UTC) from {username='oryx', principal='oryx/127.11.146.60@KRBTEST.COM'} at 127.0.0.1:55564
I20260809 15:31:16.352789 19778 tablet_replica.cc:330] T 98c222dd2e2143b9ad5cdfa362b7e883 P 5ddb4be8bc354f3fa2d90f8f5f722ba0: stopping tablet replica
I20260809 15:31:16.352893 19576 tablet_service.cc:1514] Processing DeleteTablet for tablet 98c222dd2e2143b9ad5cdfa362b7e883 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:31:16 UTC) from {username='oryx', principal='oryx/127.11.146.60@KRBTEST.COM'} at 127.0.0.1:39254
I20260809 15:31:16.352926 19778 raft_consensus.cc:2229] T 98c222dd2e2143b9ad5cdfa362b7e883 P 5ddb4be8bc354f3fa2d90f8f5f722ba0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:31:16.353077 19778 raft_consensus.cc:2258] T 98c222dd2e2143b9ad5cdfa362b7e883 P 5ddb4be8bc354f3fa2d90f8f5f722ba0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:31:16.353323 19779 tablet_replica.cc:330] T 98c222dd2e2143b9ad5cdfa362b7e883 P 3911b5d8312f41a7abb4264402dcc625: stopping tablet replica
I20260809 15:31:16.353513 19779 raft_consensus.cc:2229] T 98c222dd2e2143b9ad5cdfa362b7e883 P 3911b5d8312f41a7abb4264402dcc625 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:31:16.353694 19779 raft_consensus.cc:2258] T 98c222dd2e2143b9ad5cdfa362b7e883 P 3911b5d8312f41a7abb4264402dcc625 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:31:16.353945 19778 ts_tablet_manager.cc:1905] T 98c222dd2e2143b9ad5cdfa362b7e883 P 5ddb4be8bc354f3fa2d90f8f5f722ba0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:31:16.354163 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 19128
I20260809 15:31:16.354486 19779 ts_tablet_manager.cc:1905] T 98c222dd2e2143b9ad5cdfa362b7e883 P 3911b5d8312f41a7abb4264402dcc625: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:31:16.357920 19778 ts_tablet_manager.cc:1918] T 98c222dd2e2143b9ad5cdfa362b7e883 P 5ddb4be8bc354f3fa2d90f8f5f722ba0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:31:16.358065 19778 log.cc:1196] T 98c222dd2e2143b9ad5cdfa362b7e883 P 5ddb4be8bc354f3fa2d90f8f5f722ba0: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-1/wal/wals/98c222dd2e2143b9ad5cdfa362b7e883
I20260809 15:31:16.358412 19778 ts_tablet_manager.cc:1939] T 98c222dd2e2143b9ad5cdfa362b7e883 P 5ddb4be8bc354f3fa2d90f8f5f722ba0: Deleting consensus metadata
I20260809 15:31:16.359134 19152 catalog_manager.cc:4841] TS 5ddb4be8bc354f3fa2d90f8f5f722ba0 (127.11.146.2:37007): tablet 98c222dd2e2143b9ad5cdfa362b7e883 (table test-table [id=0886552c3a574f569e41e3361cb3eb31]) successfully deleted
I20260809 15:31:16.360591 19780 tablet_replica.cc:330] T 98c222dd2e2143b9ad5cdfa362b7e883 P 1241cab0d60e4684834cdd1d140b5d86: stopping tablet replica
I20260809 15:31:16.360754 19780 raft_consensus.cc:2229] T 98c222dd2e2143b9ad5cdfa362b7e883 P 1241cab0d60e4684834cdd1d140b5d86 [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:31:16.361100 19780 raft_consensus.cc:2258] T 98c222dd2e2143b9ad5cdfa362b7e883 P 1241cab0d60e4684834cdd1d140b5d86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:31:16.361755 19780 ts_tablet_manager.cc:1905] T 98c222dd2e2143b9ad5cdfa362b7e883 P 1241cab0d60e4684834cdd1d140b5d86: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:31:16.363808 19780 ts_tablet_manager.cc:1918] T 98c222dd2e2143b9ad5cdfa362b7e883 P 1241cab0d60e4684834cdd1d140b5d86: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:31:16.363912 19780 log.cc:1196] T 98c222dd2e2143b9ad5cdfa362b7e883 P 1241cab0d60e4684834cdd1d140b5d86: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786289437399694-11848-0/minicluster-data/ts-2/wal/wals/98c222dd2e2143b9ad5cdfa362b7e883
I20260809 15:31:16.364245 19780 ts_tablet_manager.cc:1939] T 98c222dd2e2143b9ad5cdfa362b7e883 P 1241cab0d60e4684834cdd1d140b5d86: Deleting consensus metadata
I20260809 15:31:16.364940 19152 catalog_manager.cc:4841] TS 1241cab0d60e4684834cdd1d140b5d86 (127.11.146.3:37151): tablet 98c222dd2e2143b9ad5cdfa362b7e883 (table test-table [id=0886552c3a574f569e41e3361cb3eb31]) successfully deleted
I20260809 15:31:16.366046 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 19365
I20260809 15:31:16.366251 19749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:16.365940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:37663 (local address 127.0.0.1:55578)
0809 15:31:16.366105 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:16.366166 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.1:37663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260809 15:31:16.367260 19152 catalog_manager.cc:4584] TS 3911b5d8312f41a7abb4264402dcc625 (127.11.146.1:37663): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 98c222dd2e2143b9ad5cdfa362b7e883: Network error: Client connection negotiation failed: client connection to 127.11.146.1:37663: connect: Connection refused (error 111)
I20260809 15:31:16.377450 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 19510
I20260809 15:31:16.386667 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 18831
I20260809 15:31:16.395221 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 18947
2026-08-09T15:31:16Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (7317 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:31:16 dist-test-slave-1jjb krb5kdc[19784](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:31:16 dist-test-slave-1jjb krb5kdc[19784](info): set up 2 sockets
Aug 09 15:31:16 dist-test-slave-1jjb krb5kdc[19784](info): commencing operation
krb5kdc: starting...
W20260809 15:31:17.505861 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.083s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:31:17 dist-test-slave-1jjb krb5kdc[19784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289477, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:31:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:31:17Z Disabled control of system clock
WARNING: no policy specified for oryx/127.11.146.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.146.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.146.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.62.keytab.
Entry for principal oryx/127.11.146.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.62.keytab.
I20260809 15:31:17.632323 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:46081
--webserver_interface=127.11.146.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.62.keytab
--principal=oryx/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:43705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:46081
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:31:17.758257 19797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:17.758626 19797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:17.758713 19797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:17.762703 19797 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:31:17.762789 19797 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 15:31:17.762825 19797 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:17.762868 19797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:17.762904 19797 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:31:17.762941 19797 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:31:17.768186 19797 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:43705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:46081
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.62.keytab
--principal=oryx/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:46081
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19797
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:17.769326 19797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:17.770356 19797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:17.779752 19804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:17.779855 19805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:17.779912 19797 server_base.cc:1034] running on GCE node
W20260809 15:31:17.779757 19808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:17.780712 19797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:17.781847 19797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:17.783059 19797 hybrid_clock.cc:648] HybridClock initialized: now 1786289477783049 us; error 31 us; skew 500 ppm
Aug 09 15:31:17 dist-test-slave-1jjb krb5kdc[19784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289477, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:17.786068 19797 init.cc:377] Logged in from keytab as oryx/127.11.146.62@KRBTEST.COM (short username oryx)
I20260809 15:31:17.786955 19797 webserver.cc:460] Webserver started at http://127.11.146.62:35033/ using document root <none> and password file <none>
I20260809 15:31:17.787551 19797 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:17.787647 19797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:17.787891 19797 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:17.790010 19797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "5d0ac665726e49ddbd5d4da103685916"
format_stamp: "Formatted at 2026-08-09 15:31:17 on dist-test-slave-1jjb"
server_key: "fb5faccde9ef0c13c9dc68dc6fe695aa"
server_key_iv: "9c928e1147afd3894633ad13da0b41fd"
server_key_version: "encryptionkey@0"
I20260809 15:31:17.790596 19797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "5d0ac665726e49ddbd5d4da103685916"
format_stamp: "Formatted at 2026-08-09 15:31:17 on dist-test-slave-1jjb"
server_key: "fb5faccde9ef0c13c9dc68dc6fe695aa"
server_key_iv: "9c928e1147afd3894633ad13da0b41fd"
server_key_version: "encryptionkey@0"
I20260809 15:31:17.794564 19797 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.005s
I20260809 15:31:17.797055 19816 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:17.798270 19797 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 15:31:17.798416 19797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "5d0ac665726e49ddbd5d4da103685916"
format_stamp: "Formatted at 2026-08-09 15:31:17 on dist-test-slave-1jjb"
server_key: "fb5faccde9ef0c13c9dc68dc6fe695aa"
server_key_iv: "9c928e1147afd3894633ad13da0b41fd"
server_key_version: "encryptionkey@0"
I20260809 15:31:17.798542 19797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:17.813691 19797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:17.817132 19797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:17.817354 19797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:17.825728 19797 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:46081
I20260809 15:31:17.825754 19886 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:46081 every 8 connection(s)
I20260809 15:31:17.826735 19797 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:31:17.829658 19887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:17.829663 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 19797
I20260809 15:31:17.829797 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:31:17.830111 11848 external_mini_cluster.cc:1428] Setting key d17586e7c3c52639e3f642f645ccbf80
I20260809 15:31:17.836159 19887 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d0ac665726e49ddbd5d4da103685916: Bootstrap starting.
I20260809 15:31:17.838408 19887 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5d0ac665726e49ddbd5d4da103685916: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:17.839313 19887 log.cc:824] T 00000000000000000000000000000000 P 5d0ac665726e49ddbd5d4da103685916: Log is configured to *not* fsync() on all Append() calls
Aug 09 15:31:17 dist-test-slave-1jjb krb5kdc[19784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289477, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM
I20260809 15:31:17.841408 19887 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d0ac665726e49ddbd5d4da103685916: No bootstrap required, opened a new log
I20260809 15:31:17.844610 19887 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5d0ac665726e49ddbd5d4da103685916 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d0ac665726e49ddbd5d4da103685916" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 46081 } }
I20260809 15:31:17.844851 19887 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5d0ac665726e49ddbd5d4da103685916 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:17.844919 19887 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5d0ac665726e49ddbd5d4da103685916 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0ac665726e49ddbd5d4da103685916, State: Initialized, Role: FOLLOWER
I20260809 15:31:17.845201 19890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:17.831594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39614 (local address 127.11.146.62:46081)
0809 15:31:17.832065 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:17.832136 (+ 71us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:17.832181 (+ 45us) server_negotiation.cc:407] Connection header received
0809 15:31:17.832946 (+ 765us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:17.832965 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:17.833301 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:17.833637 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:17.834454 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:17.835441 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:17.836562 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:17.837052 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:17.837227 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:17.840028 (+ 2801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:17.840034 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:17.840048 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:17.840117 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:17.842314 (+ 2197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:17.842768 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:17.842773 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:17.842778 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:17.842887 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:17.843182 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:17.843186 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:17.843187 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:17.843579 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:17.843793 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:17.844055 (+ 262us) server_negotiation.cc:299] Negotiation successful
0809 15:31:17.844365 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":135,"threads_started":1}
I20260809 15:31:17.845439 19887 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d0ac665726e49ddbd5d4da103685916 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d0ac665726e49ddbd5d4da103685916" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 46081 } }
I20260809 15:31:17.845605 19887 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5d0ac665726e49ddbd5d4da103685916 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:31:17.845676 19887 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d0ac665726e49ddbd5d4da103685916 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:31:17.845772 19887 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5d0ac665726e49ddbd5d4da103685916 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:17.846776 19887 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d0ac665726e49ddbd5d4da103685916 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d0ac665726e49ddbd5d4da103685916" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 46081 } }
I20260809 15:31:17.847119 19887 leader_election.cc:302] T 00000000000000000000000000000000 P 5d0ac665726e49ddbd5d4da103685916 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5d0ac665726e49ddbd5d4da103685916; no voters:
I20260809 15:31:17.847448 19887 leader_election.cc:288] T 00000000000000000000000000000000 P 5d0ac665726e49ddbd5d4da103685916 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:31:17.847551 19892 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5d0ac665726e49ddbd5d4da103685916 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:31:17.847802 19892 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5d0ac665726e49ddbd5d4da103685916 [term 1 LEADER]: Becoming Leader. State: Replica: 5d0ac665726e49ddbd5d4da103685916, State: Running, Role: LEADER
I20260809 15:31:17.848196 19892 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5d0ac665726e49ddbd5d4da103685916 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d0ac665726e49ddbd5d4da103685916" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 46081 } }
I20260809 15:31:17.848754 19887 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5d0ac665726e49ddbd5d4da103685916 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:31:17.849962 19894 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d0ac665726e49ddbd5d4da103685916 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d0ac665726e49ddbd5d4da103685916. Latest consensus state: current_term: 1 leader_uuid: "5d0ac665726e49ddbd5d4da103685916" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d0ac665726e49ddbd5d4da103685916" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 46081 } } }
I20260809 15:31:17.849943 19893 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d0ac665726e49ddbd5d4da103685916 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5d0ac665726e49ddbd5d4da103685916" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d0ac665726e49ddbd5d4da103685916" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 46081 } } }
I20260809 15:31:17.850085 19894 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d0ac665726e49ddbd5d4da103685916 [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:17.850085 19893 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d0ac665726e49ddbd5d4da103685916 [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:17.850466 19902 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:31:17.853593 19902 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:31:17.859371 19902 catalog_manager.cc:1347] Generated new cluster ID: 67884d38d0304b0786d473affc0336fd
I20260809 15:31:17.859445 19902 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:31:17.875474 19902 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:31:17.876627 19902 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:31:17.891691 19902 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5d0ac665726e49ddbd5d4da103685916: Generated new TSK 0
I20260809 15:31:17.892477 19902 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.11.146.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.146.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.146.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.1.keytab.
Entry for principal oryx/127.11.146.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.1.keytab.
I20260809 15:31:17.926846 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.1:0
--local_ip_for_outbound_sockets=127.11.146.1
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:46081
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.1.keytab
--principal=oryx/127.11.146.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:43705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:31:18.045432 19916 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:18.045697 19916 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:18.045742 19916 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:18.050016 19916 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:18.050094 19916 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:18.050180 19916 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 15:31:18.050235 19916 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.1
I20260809 15:31:18.055776 19916 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:43705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.1.keytab
--principal=oryx/127.11.146.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.146.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.146.62:46081
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19916
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.1
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:18.056984 19916 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:18.058166 19916 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:18.068378 19922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:18.068411 19924 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:18.068393 19926 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:18.069514 19916 server_base.cc:1034] running on GCE node
I20260809 15:31:18.069907 19916 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:18.070569 19916 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:18.071769 19916 hybrid_clock.cc:648] HybridClock initialized: now 1786289478071733 us; error 47 us; skew 500 ppm
Aug 09 15:31:18 dist-test-slave-1jjb krb5kdc[19784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289478, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:18.074903 19916 init.cc:377] Logged in from keytab as oryx/127.11.146.1@KRBTEST.COM (short username oryx)
I20260809 15:31:18.075978 19916 webserver.cc:460] Webserver started at http://127.11.146.1:40893/ using document root <none> and password file <none>
I20260809 15:31:18.076587 19916 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:18.076650 19916 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:18.076817 19916 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:18.078787 19916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-0/data/instance:
uuid: "a43f25bfb93f424fbea3dc4ae5276ea6"
format_stamp: "Formatted at 2026-08-09 15:31:18 on dist-test-slave-1jjb"
server_key: "fb8eb6983432aef68e75b9208ef695d4"
server_key_iv: "dd2acb0350b71e6143bd460308384dac"
server_key_version: "encryptionkey@0"
I20260809 15:31:18.079298 19916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance:
uuid: "a43f25bfb93f424fbea3dc4ae5276ea6"
format_stamp: "Formatted at 2026-08-09 15:31:18 on dist-test-slave-1jjb"
server_key: "fb8eb6983432aef68e75b9208ef695d4"
server_key_iv: "dd2acb0350b71e6143bd460308384dac"
server_key_version: "encryptionkey@0"
I20260809 15:31:18.083036 19916 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260809 15:31:18.085718 19933 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:18.087103 19916 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 15:31:18.087208 19916 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-0/wal
uuid: "a43f25bfb93f424fbea3dc4ae5276ea6"
format_stamp: "Formatted at 2026-08-09 15:31:18 on dist-test-slave-1jjb"
server_key: "fb8eb6983432aef68e75b9208ef695d4"
server_key_iv: "dd2acb0350b71e6143bd460308384dac"
server_key_version: "encryptionkey@0"
I20260809 15:31:18.087361 19916 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:18.098770 19916 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:18.102056 19916 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:18.102257 19916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:18.103878 19916 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:18.103956 19916 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:18.104033 19916 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:18.104107 19916 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
Aug 09 15:31:18 dist-test-slave-1jjb krb5kdc[19784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289478, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM
I20260809 15:31:18.115286 19916 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.1:45059
I20260809 15:31:18.116240 19916 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
I20260809 15:31:18.116262 20053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.1:45059 every 8 connection(s)
I20260809 15:31:18.118646 19890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:18.104740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:45307 (local address 127.11.146.62:46081)
0809 15:31:18.104911 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:18.104918 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:18.105796 (+ 878us) server_negotiation.cc:407] Connection header received
0809 15:31:18.106918 (+ 1122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:18.106924 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:18.106987 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:18.107068 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:18.108776 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.109695 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.111185 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.111470 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.111592 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:18.114687 (+ 3095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:18.114690 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:18.114692 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:18.114717 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:18.116671 (+ 1954us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:18.117305 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:18.117309 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:18.117310 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:18.117392 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:18.117688 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:18.117690 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:18.117691 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:18.117871 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:18.117952 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:18.118387 (+ 435us) server_negotiation.cc:299] Negotiation successful
0809 15:31:18.118523 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 15:31:18.119448 19942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:18.105147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:46081 (local address 127.11.146.1:45307)
0809 15:31:18.105616 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:18.105671 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:18.106652 (+ 981us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:18.107510 (+ 858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:18.107517 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:18.107924 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:18.108582 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:18.108605 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.109855 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.109864 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:18.111054 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:18.111065 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.111786 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.111793 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:18.111968 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:18.112642 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:18.112658 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:18.114492 (+ 1834us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:18.116830 (+ 2338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:18.116836 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:18.116850 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:18.117191 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:18.117476 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:18.117478 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:18.117479 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:18.117605 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:18.117964 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:18.117969 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:18.118187 (+ 218us) client_negotiation.cc:769] Sending connection context
0809 15:31:18.118336 (+ 149us) client_negotiation.cc:240] Negotiation successful
0809 15:31:18.118598 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":134,"threads_started":1}
I20260809 15:31:18.120854 20054 heartbeater.cc:347] Connected to a master server at 127.11.146.62:46081
I20260809 15:31:18.121021 20054 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:18.121584 20054 heartbeater.cc:511] Master 127.11.146.62:46081 requested a full tablet report, sending...
I20260809 15:31:18.123219 19833 ts_manager.cc:194] Registered new tserver with Master: a43f25bfb93f424fbea3dc4ae5276ea6 (127.11.146.1:45059)
I20260809 15:31:18.124384 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 19916
I20260809 15:31:18.124542 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance
I20260809 15:31:18.124711 19833 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.146.1@KRBTEST.COM'} at 127.11.146.1:45307
I20260809 15:31:18.124843 11848 external_mini_cluster.cc:1428] Setting key d1a49cb21e1884dca45f930aa4dcbffe
I20260809 15:31:18.132503 19890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:18.123027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:42981 (local address 127.11.146.62:46081)
0809 15:31:18.123157 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:18.123161 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:18.123347 (+ 186us) server_negotiation.cc:407] Connection header received
0809 15:31:18.123452 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:18.123455 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:18.123503 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:18.123566 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:18.124215 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.124986 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.127135 (+ 2149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.127525 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.127652 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:18.129010 (+ 1358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:18.129013 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:18.129015 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:18.129036 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:18.130526 (+ 1490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:18.131105 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:18.131108 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:18.131111 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:18.131207 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:18.131530 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:18.131532 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:18.131533 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:18.131825 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:18.131917 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:18.132279 (+ 362us) server_negotiation.cc:299] Negotiation successful
0809 15:31:18.132390 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 15:31:18.132714 20061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:18.122958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:46081 (local address 127.11.146.1:42981)
0809 15:31:18.123240 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:18.123258 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:18.123365 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:18.123716 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:18.123719 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:18.123937 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:18.124097 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:18.124106 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.125136 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.125139 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:18.127012 (+ 1873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:18.127020 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.127691 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.127694 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:18.127769 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:18.128348 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:18.128367 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:18.128852 (+ 485us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:18.130643 (+ 1791us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:18.130649 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:18.130655 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:18.130964 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:18.131306 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:18.131311 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:18.131315 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:18.131434 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:18.131946 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:18.131953 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:18.132098 (+ 145us) client_negotiation.cc:769] Sending connection context
0809 15:31:18.132233 (+ 135us) client_negotiation.cc:240] Negotiation successful
0809 15:31:18.132413 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":110,"threads_started":1}
WARNING: no policy specified for oryx/127.11.146.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.146.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.146.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.2.keytab.
Entry for principal oryx/127.11.146.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.2.keytab.
I20260809 15:31:18.155349 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.2:0
--local_ip_for_outbound_sockets=127.11.146.2
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:46081
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.2.keytab
--principal=oryx/127.11.146.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:43705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:31:18.275588 20064 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:18.275936 20064 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:18.276028 20064 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:18.280224 20064 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:18.280290 20064 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:18.280330 20064 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 15:31:18.280364 20064 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.2
I20260809 15:31:18.286109 20064 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:43705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.2.keytab
--principal=oryx/127.11.146.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.146.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.146.62:46081
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20064
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.2
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:18.287097 20064 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:18.288153 20064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:18.298529 20070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:18.298640 20072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:18.298722 20064 server_base.cc:1034] running on GCE node
W20260809 15:31:18.298990 20069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:18.299517 20064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:18.300354 20064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:18.301576 20064 hybrid_clock.cc:648] HybridClock initialized: now 1786289478301536 us; error 47 us; skew 500 ppm
Aug 09 15:31:18 dist-test-slave-1jjb krb5kdc[19784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289478, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:18.304908 20064 init.cc:377] Logged in from keytab as oryx/127.11.146.2@KRBTEST.COM (short username oryx)
I20260809 15:31:18.305801 20064 webserver.cc:460] Webserver started at http://127.11.146.2:44373/ using document root <none> and password file <none>
I20260809 15:31:18.306382 20064 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:18.306447 20064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:18.306705 20064 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:18.308889 20064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-1/data/instance:
uuid: "76f75ba098df4a76b0f8986e9533090f"
format_stamp: "Formatted at 2026-08-09 15:31:18 on dist-test-slave-1jjb"
server_key: "aa4193a353ab0343bfc21178de9c01b6"
server_key_iv: "f515c909d0beca17213246c435e034b4"
server_key_version: "encryptionkey@0"
I20260809 15:31:18.309495 20064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance:
uuid: "76f75ba098df4a76b0f8986e9533090f"
format_stamp: "Formatted at 2026-08-09 15:31:18 on dist-test-slave-1jjb"
server_key: "aa4193a353ab0343bfc21178de9c01b6"
server_key_iv: "f515c909d0beca17213246c435e034b4"
server_key_version: "encryptionkey@0"
I20260809 15:31:18.313297 20064 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 15:31:18.315613 20079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:18.316903 20064 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 15:31:18.317056 20064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-1/wal
uuid: "76f75ba098df4a76b0f8986e9533090f"
format_stamp: "Formatted at 2026-08-09 15:31:18 on dist-test-slave-1jjb"
server_key: "aa4193a353ab0343bfc21178de9c01b6"
server_key_iv: "f515c909d0beca17213246c435e034b4"
server_key_version: "encryptionkey@0"
I20260809 15:31:18.317178 20064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:18.333369 20064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:18.337141 20064 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:18.337357 20064 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:18.338826 20064 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:18.338900 20064 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:18.338980 20064 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:18.339035 20064 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 15:31:18 dist-test-slave-1jjb krb5kdc[19784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289478, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM
I20260809 15:31:18.350265 20064 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.2:35401
I20260809 15:31:18.350489 20202 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.2:35401 every 8 connection(s)
I20260809 15:31:18.351444 20064 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
I20260809 15:31:18.352481 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 20064
I20260809 15:31:18.352641 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance
I20260809 15:31:18.352921 11848 external_mini_cluster.cc:1428] Setting key 806bb9897981296995e83b52f4b62b9c
I20260809 15:31:18.354216 19890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:18.339852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:37311 (local address 127.11.146.62:46081)
0809 15:31:18.339992 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:18.339996 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:18.341084 (+ 1088us) server_negotiation.cc:407] Connection header received
0809 15:31:18.342258 (+ 1174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:18.342262 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:18.342326 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:18.342387 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:18.344132 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.345043 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.346854 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.347141 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.347263 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:18.350337 (+ 3074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:18.350343 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:18.350349 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:18.350388 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:18.351939 (+ 1551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:18.352583 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:18.352586 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:18.352588 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:18.352682 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:18.353029 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:18.353033 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:18.353035 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:18.353228 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:18.353340 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:18.353912 (+ 572us) server_negotiation.cc:299] Negotiation successful
0809 15:31:18.354041 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 15:31:18.355046 20089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:18.340434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:46081 (local address 127.11.146.2:37311)
0809 15:31:18.340919 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:18.340978 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:18.341998 (+ 1020us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:18.342820 (+ 822us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:18.342847 (+ 27us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:18.343225 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:18.343939 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:18.343959 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.345187 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.345191 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:18.346738 (+ 1547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:18.346751 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.347301 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.347306 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:18.347486 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:18.348152 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:18.348176 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:18.350139 (+ 1963us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:18.352109 (+ 1970us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:18.352115 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:18.352129 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:18.352463 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:18.352765 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:18.352769 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:18.352771 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:18.352911 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:18.353339 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:18.353346 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:18.353660 (+ 314us) client_negotiation.cc:769] Sending connection context
0809 15:31:18.353851 (+ 191us) client_negotiation.cc:240] Negotiation successful
0809 15:31:18.354171 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":137,"threads_started":1}
I20260809 15:31:18.357245 20203 heartbeater.cc:347] Connected to a master server at 127.11.146.62:46081
I20260809 15:31:18.357421 20203 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:18.357944 20203 heartbeater.cc:511] Master 127.11.146.62:46081 requested a full tablet report, sending...
I20260809 15:31:18.359056 19833 ts_manager.cc:194] Registered new tserver with Master: 76f75ba098df4a76b0f8986e9533090f (127.11.146.2:35401)
I20260809 15:31:18.359778 19833 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.146.2@KRBTEST.COM'} at 127.11.146.2:37311
WARNING: no policy specified for oryx/127.11.146.3@KRBTEST.COM; defaulting to no policy
I20260809 15:31:18.367509 20210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:18.359740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:46081 (local address 127.11.146.2:38273)
0809 15:31:18.360441 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:18.360453 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:18.360572 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:18.360801 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:18.360804 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:18.361037 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:18.361134 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:18.361140 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.361897 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.361901 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:18.362458 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:18.362466 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.362917 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.362921 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:18.363011 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:18.363565 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:18.363577 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:18.363915 (+ 338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:18.365829 (+ 1914us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:18.365834 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:18.365836 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:18.366048 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:18.366342 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:18.366346 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:18.366348 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:18.366440 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:18.366882 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:18.366889 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:18.366996 (+ 107us) client_negotiation.cc:769] Sending connection context
0809 15:31:18.367149 (+ 153us) client_negotiation.cc:240] Negotiation successful
0809 15:31:18.367305 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":627,"thread_start_us":107,"threads_started":1}
I20260809 15:31:18.367502 19890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:18.359861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:38273 (local address 127.11.146.62:46081)
0809 15:31:18.360029 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:18.360035 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:18.360533 (+ 498us) server_negotiation.cc:407] Connection header received
0809 15:31:18.360649 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:18.360653 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:18.360700 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:18.360785 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:18.361253 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.361761 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.362583 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.362800 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.362910 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:18.364057 (+ 1147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:18.364061 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:18.364064 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:18.364124 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:18.365716 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:18.366156 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:18.366159 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:18.366161 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:18.366246 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:18.366537 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:18.366541 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:18.366543 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:18.366761 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:18.366874 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:18.367210 (+ 336us) server_negotiation.cc:299] Negotiation successful
0809 15:31:18.367323 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.146.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.146.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.3.keytab.
Entry for principal oryx/127.11.146.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.3.keytab.
I20260809 15:31:18.385320 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.3:0
--local_ip_for_outbound_sockets=127.11.146.3
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:46081
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.3.keytab
--principal=oryx/127.11.146.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:43705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:31:18.503026 20212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:18.503423 20212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:18.503517 20212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:18.507961 20212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:18.508019 20212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:18.508061 20212 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 15:31:18.508152 20212 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.3
I20260809 15:31:18.513538 20212 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:43705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.3.keytab
--principal=oryx/127.11.146.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.146.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.146.62:46081
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20212
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.3
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:18.514566 20212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:18.515537 20212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 15:31:18.525875 20212 server_base.cc:1034] running on GCE node
W20260809 15:31:18.525985 20217 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:18.525985 20220 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:18.526017 20218 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:18.526553 20212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:18.527204 20212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:18.528396 20212 hybrid_clock.cc:648] HybridClock initialized: now 1786289478528373 us; error 43 us; skew 500 ppm
Aug 09 15:31:18 dist-test-slave-1jjb krb5kdc[19784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289478, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:18.543809 20212 init.cc:377] Logged in from keytab as oryx/127.11.146.3@KRBTEST.COM (short username oryx)
I20260809 15:31:18.544929 20212 webserver.cc:460] Webserver started at http://127.11.146.3:45887/ using document root <none> and password file <none>
I20260809 15:31:18.545534 20212 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:18.545632 20212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:18.545885 20212 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:18.547959 20212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-2/data/instance:
uuid: "8bac77c0c2094527998dcdeeabea2570"
format_stamp: "Formatted at 2026-08-09 15:31:18 on dist-test-slave-1jjb"
server_key: "99e19804d7ed92480ad1a8b53b3b682f"
server_key_iv: "8e50bbb6ff750633f36d73a534e78a84"
server_key_version: "encryptionkey@0"
I20260809 15:31:18.548605 20212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance:
uuid: "8bac77c0c2094527998dcdeeabea2570"
format_stamp: "Formatted at 2026-08-09 15:31:18 on dist-test-slave-1jjb"
server_key: "99e19804d7ed92480ad1a8b53b3b682f"
server_key_iv: "8e50bbb6ff750633f36d73a534e78a84"
server_key_version: "encryptionkey@0"
I20260809 15:31:18.552603 20212 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 15:31:18.555192 20227 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:18.556622 20212 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:31:18.556790 20212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-2/wal
uuid: "8bac77c0c2094527998dcdeeabea2570"
format_stamp: "Formatted at 2026-08-09 15:31:18 on dist-test-slave-1jjb"
server_key: "99e19804d7ed92480ad1a8b53b3b682f"
server_key_iv: "8e50bbb6ff750633f36d73a534e78a84"
server_key_version: "encryptionkey@0"
I20260809 15:31:18.556886 20212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:18.581954 20212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:18.585477 20212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:18.585639 20212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:18.587107 20212 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:18.587162 20212 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:18.587203 20212 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:18.587255 20212 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 15:31:18 dist-test-slave-1jjb krb5kdc[19784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289478, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM
I20260809 15:31:18.598764 20212 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.3:43141
I20260809 15:31:18.598836 20349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.3:43141 every 8 connection(s)
I20260809 15:31:18.599713 20212 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
I20260809 15:31:18.602108 19890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:18.587941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:48651 (local address 127.11.146.62:46081)
0809 15:31:18.588146 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:18.588152 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:18.589065 (+ 913us) server_negotiation.cc:407] Connection header received
0809 15:31:18.590439 (+ 1374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:18.590444 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:18.590523 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:18.590638 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:18.591997 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.592948 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.594908 (+ 1960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.595268 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.595388 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:18.598071 (+ 2683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:18.598075 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:18.598077 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:18.598102 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:18.599957 (+ 1855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:18.600651 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:18.600655 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:18.600656 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:18.600739 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:18.601075 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:18.601078 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:18.601079 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:18.601258 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:18.601335 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:18.601878 (+ 543us) server_negotiation.cc:299] Negotiation successful
0809 15:31:18.601983 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 15:31:18.603057 20236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:18.588367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:46081 (local address 127.11.146.3:48651)
0809 15:31:18.588861 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:18.588922 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:18.590128 (+ 1206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:18.590820 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:18.590827 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:18.591287 (+ 460us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:18.591818 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:18.591839 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.593129 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.593136 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:18.594756 (+ 1620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:18.594773 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.595447 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.595452 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:18.595641 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:18.596305 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:18.596321 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:18.597884 (+ 1563us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:18.600111 (+ 2227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:18.600117 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:18.600132 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:18.600526 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:18.600842 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:18.600844 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:18.600845 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:18.600981 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:18.601347 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:18.601351 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:18.601652 (+ 301us) client_negotiation.cc:769] Sending connection context
0809 15:31:18.601802 (+ 150us) client_negotiation.cc:240] Negotiation successful
0809 15:31:18.602155 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":114,"threads_started":1}
I20260809 15:31:18.603436 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 20212
I20260809 15:31:18.603600 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance
I20260809 15:31:18.603897 11848 external_mini_cluster.cc:1428] Setting key b3cbb22efdc7b86220fb829f11114205
I20260809 15:31:18.605137 20350 heartbeater.cc:347] Connected to a master server at 127.11.146.62:46081
I20260809 15:31:18.605321 20350 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:18.605947 20350 heartbeater.cc:511] Master 127.11.146.62:46081 requested a full tablet report, sending...
I20260809 15:31:18.607110 19834 ts_manager.cc:194] Registered new tserver with Master: 8bac77c0c2094527998dcdeeabea2570 (127.11.146.3:43141)
I20260809 15:31:18.607975 19834 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.146.3@KRBTEST.COM'} at 127.11.146.3:48651
I20260809 15:31:18.608201 11848 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:31:18.615113 20357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:18.607385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:46081 (local address 127.11.146.3:43215)
0809 15:31:18.607651 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:18.607665 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:18.607793 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:18.608040 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:18.608042 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:18.608302 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:18.608435 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:18.608443 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.609278 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.609280 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:18.609833 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:18.609839 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.610314 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.610318 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:18.610416 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:18.610989 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:18.611002 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:18.611354 (+ 352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:18.613599 (+ 2245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:18.613602 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:18.613604 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:18.613804 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:18.614132 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:18.614134 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:18.614135 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:18.614210 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:18.614695 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:18.614697 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:18.614776 (+ 79us) client_negotiation.cc:769] Sending connection context
0809 15:31:18.614862 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 15:31:18.614971 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":114,"threads_started":1}
I20260809 15:31:18.615278 19890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:18.607358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:43215 (local address 127.11.146.62:46081)
0809 15:31:18.607483 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:18.607489 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:18.607755 (+ 266us) server_negotiation.cc:407] Connection header received
0809 15:31:18.607890 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:18.607893 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:18.607942 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:18.608032 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:18.608570 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.609140 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.609953 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.610188 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.610297 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:18.611516 (+ 1219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:18.611522 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:18.611526 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:18.611559 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:18.613481 (+ 1922us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:18.613907 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:18.613914 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:18.613919 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:18.614025 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:18.614304 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:18.614311 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:18.614315 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:18.614584 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:18.614703 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:18.614959 (+ 256us) server_negotiation.cc:299] Negotiation successful
0809 15:31:18.615089 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
Aug 09 15:31:18 dist-test-slave-1jjb krb5kdc[19784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289478, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 15:31:18 dist-test-slave-1jjb krb5kdc[19784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:18 dist-test-slave-1jjb krb5kdc[19784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
W20260809 15:31:18.636983 19890 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:18.630267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39626 (local address 127.11.146.62:46081)
0809 15:31:18.630397 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:18.630402 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:18.630418 (+ 16us) server_negotiation.cc:407] Connection header received
0809 15:31:18.630462 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:18.630465 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:18.630505 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:18.630580 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:18.631342 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.631865 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.632882 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.633150 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.633292 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:18.636857 (+ 3565us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39626: BlockingRecv error: recv got EOF from 127.0.0.1:39626 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 09 15:31:18 dist-test-slave-1jjb krb5kdc[19784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289478, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM
I20260809 15:31:18.647500 19890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:18.638695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39640 (local address 127.11.146.62:46081)
0809 15:31:18.638864 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:18.638869 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:18.639011 (+ 142us) server_negotiation.cc:407] Connection header received
0809 15:31:18.639184 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:18.639188 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:18.639239 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:18.639358 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:18.640007 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.640601 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.641444 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.641671 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.641793 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:18.644372 (+ 2579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:18.644377 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:18.644379 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:18.644414 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:18.645682 (+ 1268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:18.646137 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:18.646141 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:18.646143 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:18.646226 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:18.646528 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:18.646532 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:18.646533 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:18.646746 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:18.646899 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:18.647159 (+ 260us) server_negotiation.cc:299] Negotiation successful
0809 15:31:18.647317 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 15:31:18.650808 19834 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39640:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:31:18.654054 19834 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:31:18.669520 20376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:18.663843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:45059 (local address 127.0.0.1:38904)
0809 15:31:18.664652 (+ 809us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:18.664666 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:18.664742 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:18.665393 (+ 651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:18.665396 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:18.665414 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:31:18.665504 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:18.665514 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.666516 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.666522 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:18.668104 (+ 1582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:18.668115 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.669192 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.669198 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:18.669284 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:18.669306 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 15:31:18.669363 (+ 57us) client_negotiation.cc:240] Negotiation successful
0809 15:31:18.669432 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":746,"mutex_wait_us":147,"thread_start_us":101,"threads_started":1}
I20260809 15:31:18.669631 20378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:18.664303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38904 (local address 127.11.146.1:45059)
0809 15:31:18.664967 (+ 664us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:18.664975 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:18.664999 (+ 24us) server_negotiation.cc:407] Connection header received
0809 15:31:18.665073 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:18.665079 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:18.665260 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:18.665405 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:31:18.665606 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.666389 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.668248 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.669064 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.669183 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:18.669340 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:18.669396 (+ 56us) server_negotiation.cc:299] Negotiation successful
0809 15:31:18.669494 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":87,"threads_started":1}
I20260809 15:31:18.669866 20374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:18.663269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39794 (local address 127.11.146.3:43141)
0809 15:31:18.663724 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:18.663744 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:18.663900 (+ 156us) server_negotiation.cc:407] Connection header received
0809 15:31:18.664274 (+ 374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:18.664281 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:18.664496 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:18.664631 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:31:18.665280 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.666530 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.668051 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.668750 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.668875 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:18.669074 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:18.669596 (+ 522us) server_negotiation.cc:299] Negotiation successful
0809 15:31:18.669715 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":114,"threads_started":1}
I20260809 15:31:18.669520 20373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:18.663103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:43141 (local address 127.0.0.1:39794)
0809 15:31:18.663762 (+ 659us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:18.663813 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:18.664053 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:18.664845 (+ 792us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:18.664850 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:18.664885 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:31:18.665146 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:18.665153 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.666695 (+ 1542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.666698 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:18.667925 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:18.667934 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.668895 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.668899 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:18.669020 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:18.669083 (+ 63us) client_negotiation.cc:769] Sending connection context
0809 15:31:18.669221 (+ 138us) client_negotiation.cc:240] Negotiation successful
0809 15:31:18.669350 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"mutex_wait_us":185,"spinlock_wait_cycles":23680,"thread_start_us":115,"threads_started":1}
I20260809 15:31:18.670802 20375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:18.663369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:35401 (local address 127.0.0.1:35370)
0809 15:31:18.663890 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:18.663906 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:18.664053 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:18.664848 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:18.664852 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:18.664887 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:31:18.665126 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:18.665133 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.666643 (+ 1510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.666646 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:18.668239 (+ 1593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:18.668247 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.669305 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.669309 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:18.669415 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:18.669451 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 15:31:18.669501 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 15:31:18.669569 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"mutex_wait_us":300,"spinlock_wait_cycles":7296,"thread_start_us":120,"threads_started":1}
I20260809 15:31:18.671480 20377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:18.663970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35370 (local address 127.11.146.2:35401)
0809 15:31:18.664350 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:18.664363 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:18.664417 (+ 54us) server_negotiation.cc:407] Connection header received
0809 15:31:18.664501 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:18.664508 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:18.664691 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:18.665276 (+ 585us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:31:18.665417 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.666530 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.668363 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.669171 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.671008 (+ 1837us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:18.671169 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:18.671220 (+ 51us) server_negotiation.cc:299] Negotiation successful
0809 15:31:18.671325 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":146,"threads_started":1}
I20260809 15:31:18.672966 19984 tablet_service.cc:1467] Processing CreateTablet for tablet 7bc0f8c75d71418c8e97aad47e203ff3 (DEFAULT_TABLE table=test-table [id=ff4f6cf248b141308ea26da61a54f623]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:31:18.673951 19984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bc0f8c75d71418c8e97aad47e203ff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:18.673662 20135 tablet_service.cc:1467] Processing CreateTablet for tablet 7bc0f8c75d71418c8e97aad47e203ff3 (DEFAULT_TABLE table=test-table [id=ff4f6cf248b141308ea26da61a54f623]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:31:18.674475 20135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bc0f8c75d71418c8e97aad47e203ff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:18.680402 20379 tablet_bootstrap.cc:492] T 7bc0f8c75d71418c8e97aad47e203ff3 P a43f25bfb93f424fbea3dc4ae5276ea6: Bootstrap starting.
I20260809 15:31:18.681632 20380 tablet_bootstrap.cc:492] T 7bc0f8c75d71418c8e97aad47e203ff3 P 76f75ba098df4a76b0f8986e9533090f: Bootstrap starting.
I20260809 15:31:18.682227 20281 tablet_service.cc:1467] Processing CreateTablet for tablet 7bc0f8c75d71418c8e97aad47e203ff3 (DEFAULT_TABLE table=test-table [id=ff4f6cf248b141308ea26da61a54f623]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:31:18.682977 20379 tablet_bootstrap.cc:654] T 7bc0f8c75d71418c8e97aad47e203ff3 P a43f25bfb93f424fbea3dc4ae5276ea6: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:18.683395 20281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bc0f8c75d71418c8e97aad47e203ff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:18.683771 20380 tablet_bootstrap.cc:654] T 7bc0f8c75d71418c8e97aad47e203ff3 P 76f75ba098df4a76b0f8986e9533090f: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:18.683930 20379 log.cc:824] T 7bc0f8c75d71418c8e97aad47e203ff3 P a43f25bfb93f424fbea3dc4ae5276ea6: Log is configured to *not* fsync() on all Append() calls
I20260809 15:31:18.684628 20380 log.cc:824] T 7bc0f8c75d71418c8e97aad47e203ff3 P 76f75ba098df4a76b0f8986e9533090f: Log is configured to *not* fsync() on all Append() calls
I20260809 15:31:18.685988 20379 tablet_bootstrap.cc:492] T 7bc0f8c75d71418c8e97aad47e203ff3 P a43f25bfb93f424fbea3dc4ae5276ea6: No bootstrap required, opened a new log
I20260809 15:31:18.686268 20379 ts_tablet_manager.cc:1397] T 7bc0f8c75d71418c8e97aad47e203ff3 P a43f25bfb93f424fbea3dc4ae5276ea6: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 15:31:18.686664 20380 tablet_bootstrap.cc:492] T 7bc0f8c75d71418c8e97aad47e203ff3 P 76f75ba098df4a76b0f8986e9533090f: No bootstrap required, opened a new log
I20260809 15:31:18.686853 20380 ts_tablet_manager.cc:1397] T 7bc0f8c75d71418c8e97aad47e203ff3 P 76f75ba098df4a76b0f8986e9533090f: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 15:31:18.689848 20379 raft_consensus.cc:348] T 7bc0f8c75d71418c8e97aad47e203ff3 P a43f25bfb93f424fbea3dc4ae5276ea6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } }
I20260809 15:31:18.690090 20379 raft_consensus.cc:374] T 7bc0f8c75d71418c8e97aad47e203ff3 P a43f25bfb93f424fbea3dc4ae5276ea6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:18.690165 20379 raft_consensus.cc:729] T 7bc0f8c75d71418c8e97aad47e203ff3 P a43f25bfb93f424fbea3dc4ae5276ea6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a43f25bfb93f424fbea3dc4ae5276ea6, State: Initialized, Role: FOLLOWER
I20260809 15:31:18.690647 20379 consensus_queue.cc:260] T 7bc0f8c75d71418c8e97aad47e203ff3 P a43f25bfb93f424fbea3dc4ae5276ea6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } }
I20260809 15:31:18.690912 20380 raft_consensus.cc:348] T 7bc0f8c75d71418c8e97aad47e203ff3 P 76f75ba098df4a76b0f8986e9533090f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } }
I20260809 15:31:18.691305 20380 raft_consensus.cc:374] T 7bc0f8c75d71418c8e97aad47e203ff3 P 76f75ba098df4a76b0f8986e9533090f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:18.691401 20380 raft_consensus.cc:729] T 7bc0f8c75d71418c8e97aad47e203ff3 P 76f75ba098df4a76b0f8986e9533090f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76f75ba098df4a76b0f8986e9533090f, State: Initialized, Role: FOLLOWER
I20260809 15:31:18.691888 20054 heartbeater.cc:503] Master 127.11.146.62:46081 was elected leader, sending a full tablet report...
I20260809 15:31:18.692111 20379 ts_tablet_manager.cc:1428] T 7bc0f8c75d71418c8e97aad47e203ff3 P a43f25bfb93f424fbea3dc4ae5276ea6: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 15:31:18.692031 20380 consensus_queue.cc:260] T 7bc0f8c75d71418c8e97aad47e203ff3 P 76f75ba098df4a76b0f8986e9533090f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } }
I20260809 15:31:18.692305 20385 tablet_bootstrap.cc:492] T 7bc0f8c75d71418c8e97aad47e203ff3 P 8bac77c0c2094527998dcdeeabea2570: Bootstrap starting.
I20260809 15:31:18.692792 20203 heartbeater.cc:503] Master 127.11.146.62:46081 was elected leader, sending a full tablet report...
I20260809 15:31:18.693044 20380 ts_tablet_manager.cc:1428] T 7bc0f8c75d71418c8e97aad47e203ff3 P 76f75ba098df4a76b0f8986e9533090f: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260809 15:31:18.694644 20385 tablet_bootstrap.cc:654] T 7bc0f8c75d71418c8e97aad47e203ff3 P 8bac77c0c2094527998dcdeeabea2570: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:18.695595 20385 log.cc:824] T 7bc0f8c75d71418c8e97aad47e203ff3 P 8bac77c0c2094527998dcdeeabea2570: Log is configured to *not* fsync() on all Append() calls
I20260809 15:31:18.697937 20385 tablet_bootstrap.cc:492] T 7bc0f8c75d71418c8e97aad47e203ff3 P 8bac77c0c2094527998dcdeeabea2570: No bootstrap required, opened a new log
I20260809 15:31:18.698148 20385 ts_tablet_manager.cc:1397] T 7bc0f8c75d71418c8e97aad47e203ff3 P 8bac77c0c2094527998dcdeeabea2570: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260809 15:31:18.701265 20385 raft_consensus.cc:348] T 7bc0f8c75d71418c8e97aad47e203ff3 P 8bac77c0c2094527998dcdeeabea2570 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } }
I20260809 15:31:18.701501 20385 raft_consensus.cc:374] T 7bc0f8c75d71418c8e97aad47e203ff3 P 8bac77c0c2094527998dcdeeabea2570 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:18.701587 20385 raft_consensus.cc:729] T 7bc0f8c75d71418c8e97aad47e203ff3 P 8bac77c0c2094527998dcdeeabea2570 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bac77c0c2094527998dcdeeabea2570, State: Initialized, Role: FOLLOWER
I20260809 15:31:18.702060 20385 consensus_queue.cc:260] T 7bc0f8c75d71418c8e97aad47e203ff3 P 8bac77c0c2094527998dcdeeabea2570 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } }
I20260809 15:31:18.702786 20350 heartbeater.cc:503] Master 127.11.146.62:46081 was elected leader, sending a full tablet report...
I20260809 15:31:18.703008 20385 ts_tablet_manager.cc:1428] T 7bc0f8c75d71418c8e97aad47e203ff3 P 8bac77c0c2094527998dcdeeabea2570: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
W20260809 15:31:18.850826 20351 tablet.cc:2369] T 7bc0f8c75d71418c8e97aad47e203ff3 P 8bac77c0c2094527998dcdeeabea2570: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 15:31:18.852797 20204 tablet.cc:2369] T 7bc0f8c75d71418c8e97aad47e203ff3 P 76f75ba098df4a76b0f8986e9533090f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 15:31:18.867709 20055 tablet.cc:2369] T 7bc0f8c75d71418c8e97aad47e203ff3 P a43f25bfb93f424fbea3dc4ae5276ea6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:31:18.905884 20386 raft_consensus.cc:482] T 7bc0f8c75d71418c8e97aad47e203ff3 P 76f75ba098df4a76b0f8986e9533090f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:31:18.906148 20386 raft_consensus.cc:504] T 7bc0f8c75d71418c8e97aad47e203ff3 P 76f75ba098df4a76b0f8986e9533090f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } }
I20260809 15:31:18.907359 20386 leader_election.cc:288] T 7bc0f8c75d71418c8e97aad47e203ff3 P 76f75ba098df4a76b0f8986e9533090f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bac77c0c2094527998dcdeeabea2570 (127.11.146.3:43141), a43f25bfb93f424fbea3dc4ae5276ea6 (127.11.146.1:45059)
I20260809 15:31:18.911638 20374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:18.907754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:36709 (local address 127.11.146.3:43141)
0809 15:31:18.907933 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:18.907939 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:18.908105 (+ 166us) server_negotiation.cc:407] Connection header received
0809 15:31:18.908359 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:18.908363 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:18.908421 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:18.908508 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:31:18.908853 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.909494 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.910637 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.911053 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.911177 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:18.911235 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:18.911419 (+ 184us) server_negotiation.cc:299] Negotiation successful
0809 15:31:18.911496 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 15:31:18.911778 20378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:18.908325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:42983 (local address 127.11.146.1:45059)
0809 15:31:18.908469 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:18.908495 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:18.908566 (+ 71us) server_negotiation.cc:407] Connection header received
0809 15:31:18.908696 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:18.908699 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:18.908748 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:18.908828 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:31:18.909125 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.909656 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.910681 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.911074 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.911207 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:18.911260 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:18.911478 (+ 218us) server_negotiation.cc:299] Negotiation successful
0809 15:31:18.911545 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 15:31:18.911794 20389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:18.907681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:43141 (local address 127.11.146.2:36709)
0809 15:31:18.907977 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:18.907991 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:18.908147 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:18.908541 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:18.908544 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:18.908572 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:31:18.908712 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:18.908718 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.909603 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.909606 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:18.910509 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:18.910519 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.911176 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.911180 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:18.911280 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:18.911307 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 15:31:18.911382 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 15:31:18.911485 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"mutex_wait_us":2,"thread_start_us":125,"threads_started":1}
I20260809 15:31:18.912202 20390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:18.908182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:45059 (local address 127.11.146.2:42983)
0809 15:31:18.908499 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:18.908512 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:18.908598 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:18.908859 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:18.908862 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:18.908881 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:31:18.908999 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:18.909005 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.909765 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.909767 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:18.910528 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:18.910537 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.911218 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.911222 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:18.911322 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:18.911339 (+ 17us) client_negotiation.cc:769] Sending connection context
0809 15:31:18.911439 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 15:31:18.911505 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"mutex_wait_us":24,"thread_start_us":78,"threads_started":1}
I20260809 15:31:18.912607 20301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bc0f8c75d71418c8e97aad47e203ff3" candidate_uuid: "76f75ba098df4a76b0f8986e9533090f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bac77c0c2094527998dcdeeabea2570" is_pre_election: true
I20260809 15:31:18.912834 20005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bc0f8c75d71418c8e97aad47e203ff3" candidate_uuid: "76f75ba098df4a76b0f8986e9533090f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" is_pre_election: true
I20260809 15:31:18.912930 20301 raft_consensus.cc:2454] T 7bc0f8c75d71418c8e97aad47e203ff3 P 8bac77c0c2094527998dcdeeabea2570 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76f75ba098df4a76b0f8986e9533090f in term 0.
I20260809 15:31:18.913158 20005 raft_consensus.cc:2454] T 7bc0f8c75d71418c8e97aad47e203ff3 P a43f25bfb93f424fbea3dc4ae5276ea6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76f75ba098df4a76b0f8986e9533090f in term 0.
I20260809 15:31:18.913540 20083 leader_election.cc:302] T 7bc0f8c75d71418c8e97aad47e203ff3 P 76f75ba098df4a76b0f8986e9533090f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76f75ba098df4a76b0f8986e9533090f, 8bac77c0c2094527998dcdeeabea2570; no voters:
I20260809 15:31:18.913892 20386 raft_consensus.cc:2781] T 7bc0f8c75d71418c8e97aad47e203ff3 P 76f75ba098df4a76b0f8986e9533090f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:31:18.913975 20386 raft_consensus.cc:482] T 7bc0f8c75d71418c8e97aad47e203ff3 P 76f75ba098df4a76b0f8986e9533090f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:31:18.914005 20386 raft_consensus.cc:3037] T 7bc0f8c75d71418c8e97aad47e203ff3 P 76f75ba098df4a76b0f8986e9533090f [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:18.915259 20386 raft_consensus.cc:504] T 7bc0f8c75d71418c8e97aad47e203ff3 P 76f75ba098df4a76b0f8986e9533090f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } }
I20260809 15:31:18.915756 20386 leader_election.cc:288] T 7bc0f8c75d71418c8e97aad47e203ff3 P 76f75ba098df4a76b0f8986e9533090f [CANDIDATE]: Term 1 election: Requested vote from peers 8bac77c0c2094527998dcdeeabea2570 (127.11.146.3:43141), a43f25bfb93f424fbea3dc4ae5276ea6 (127.11.146.1:45059)
I20260809 15:31:18.916165 20301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bc0f8c75d71418c8e97aad47e203ff3" candidate_uuid: "76f75ba098df4a76b0f8986e9533090f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bac77c0c2094527998dcdeeabea2570"
I20260809 15:31:18.916317 20005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bc0f8c75d71418c8e97aad47e203ff3" candidate_uuid: "76f75ba098df4a76b0f8986e9533090f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6"
I20260809 15:31:18.916323 20301 raft_consensus.cc:3037] T 7bc0f8c75d71418c8e97aad47e203ff3 P 8bac77c0c2094527998dcdeeabea2570 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:18.916492 20005 raft_consensus.cc:3037] T 7bc0f8c75d71418c8e97aad47e203ff3 P a43f25bfb93f424fbea3dc4ae5276ea6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:18.917574 20005 raft_consensus.cc:2454] T 7bc0f8c75d71418c8e97aad47e203ff3 P a43f25bfb93f424fbea3dc4ae5276ea6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76f75ba098df4a76b0f8986e9533090f in term 1.
I20260809 15:31:18.917879 20083 leader_election.cc:302] T 7bc0f8c75d71418c8e97aad47e203ff3 P 76f75ba098df4a76b0f8986e9533090f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76f75ba098df4a76b0f8986e9533090f, a43f25bfb93f424fbea3dc4ae5276ea6; no voters:
I20260809 15:31:18.918056 20386 raft_consensus.cc:2781] T 7bc0f8c75d71418c8e97aad47e203ff3 P 76f75ba098df4a76b0f8986e9533090f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:31:18.918042 20301 raft_consensus.cc:2454] T 7bc0f8c75d71418c8e97aad47e203ff3 P 8bac77c0c2094527998dcdeeabea2570 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76f75ba098df4a76b0f8986e9533090f in term 1.
I20260809 15:31:18.918256 20386 raft_consensus.cc:686] T 7bc0f8c75d71418c8e97aad47e203ff3 P 76f75ba098df4a76b0f8986e9533090f [term 1 LEADER]: Becoming Leader. State: Replica: 76f75ba098df4a76b0f8986e9533090f, State: Running, Role: LEADER
I20260809 15:31:18.918639 20386 consensus_queue.cc:237] T 7bc0f8c75d71418c8e97aad47e203ff3 P 76f75ba098df4a76b0f8986e9533090f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } }
I20260809 15:31:18.922168 19834 catalog_manager.cc:5495] T 7bc0f8c75d71418c8e97aad47e203ff3 P 76f75ba098df4a76b0f8986e9533090f reported cstate change: term changed from 0 to 1, leader changed from <none> to 76f75ba098df4a76b0f8986e9533090f (127.11.146.2). New cstate: current_term: 1 leader_uuid: "76f75ba098df4a76b0f8986e9533090f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } health_report { overall_health: UNKNOWN } } }
I20260809 15:31:18.964695 20377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:18.960322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35372 (local address 127.11.146.2:35401)
0809 15:31:18.960521 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:18.960530 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:18.960551 (+ 21us) server_negotiation.cc:407] Connection header received
0809 15:31:18.960805 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:18.960808 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:18.960875 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:18.961008 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:31:18.961328 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.961901 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.962893 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:18.963143 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:18.963280 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:18.963633 (+ 353us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:31:18.964184 (+ 551us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:31:18.964323 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:18.964447 (+ 124us) server_negotiation.cc:299] Negotiation successful
0809 15:31:18.964516 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 15:31:18.970853 20301 raft_consensus.cc:1261] T 7bc0f8c75d71418c8e97aad47e203ff3 P 8bac77c0c2094527998dcdeeabea2570 [term 1 FOLLOWER]: Refusing update from remote peer 76f75ba098df4a76b0f8986e9533090f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:31:18.970860 20005 raft_consensus.cc:1261] T 7bc0f8c75d71418c8e97aad47e203ff3 P a43f25bfb93f424fbea3dc4ae5276ea6 [term 1 FOLLOWER]: Refusing update from remote peer 76f75ba098df4a76b0f8986e9533090f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:31:18.971590 20386 consensus_queue.cc:1035] T 7bc0f8c75d71418c8e97aad47e203ff3 P 76f75ba098df4a76b0f8986e9533090f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:31:18.971843 20391 consensus_queue.cc:1035] T 7bc0f8c75d71418c8e97aad47e203ff3 P 76f75ba098df4a76b0f8986e9533090f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:31:18.982167 20395 mvcc.cc:205] Tried to move back new op lower bound from 7316641705856626688 to 7316641705653501952. Current Snapshot: MvccSnapshot[applied={T|T < 7316641705856626688}]
I20260809 15:31:18.988518 19833 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39640:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:31:18.988685 19833 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39640:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:31:18.991180 19833 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5d0ac665726e49ddbd5d4da103685916: Sending DeleteTablet for 3 replicas of tablet 7bc0f8c75d71418c8e97aad47e203ff3
I20260809 15:31:18.992043 20281 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bc0f8c75d71418c8e97aad47e203ff3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:31:18 UTC) from {username='oryx', principal='oryx/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:39794
I20260809 15:31:18.992228 19984 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bc0f8c75d71418c8e97aad47e203ff3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:31:18 UTC) from {username='oryx', principal='oryx/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:38904
I20260809 15:31:18.992624 20135 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bc0f8c75d71418c8e97aad47e203ff3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:31:18 UTC) from {username='oryx', principal='oryx/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:35370
I20260809 15:31:18.992741 20405 tablet_replica.cc:330] T 7bc0f8c75d71418c8e97aad47e203ff3 P 8bac77c0c2094527998dcdeeabea2570: stopping tablet replica
I20260809 15:31:18.993093 20405 raft_consensus.cc:2229] T 7bc0f8c75d71418c8e97aad47e203ff3 P 8bac77c0c2094527998dcdeeabea2570 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:31:18.993108 20407 tablet_replica.cc:330] T 7bc0f8c75d71418c8e97aad47e203ff3 P 76f75ba098df4a76b0f8986e9533090f: stopping tablet replica
I20260809 15:31:18.993364 20407 raft_consensus.cc:2229] T 7bc0f8c75d71418c8e97aad47e203ff3 P 76f75ba098df4a76b0f8986e9533090f [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:31:18.993558 20405 raft_consensus.cc:2258] T 7bc0f8c75d71418c8e97aad47e203ff3 P 8bac77c0c2094527998dcdeeabea2570 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:31:18.993772 20407 raft_consensus.cc:2258] T 7bc0f8c75d71418c8e97aad47e203ff3 P 76f75ba098df4a76b0f8986e9533090f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:31:18.993839 19833 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39640:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:31:18.994251 19833 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:31:18.995253 20405 ts_tablet_manager.cc:1905] T 7bc0f8c75d71418c8e97aad47e203ff3 P 8bac77c0c2094527998dcdeeabea2570: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:31:18.996107 20407 ts_tablet_manager.cc:1905] T 7bc0f8c75d71418c8e97aad47e203ff3 P 76f75ba098df4a76b0f8986e9533090f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:31:18.999145 19984 tablet_service.cc:1467] Processing CreateTablet for tablet d0b52574c7e74dc6a75cc3b8285a0c2b (DEFAULT_TABLE table=test-table [id=e3a2a381969847ba986004728e4f5442]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:31:18.999455 19984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0b52574c7e74dc6a75cc3b8285a0c2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:18.999819 20407 ts_tablet_manager.cc:1918] T 7bc0f8c75d71418c8e97aad47e203ff3 P 76f75ba098df4a76b0f8986e9533090f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:31:18.999933 20407 log.cc:1196] T 7bc0f8c75d71418c8e97aad47e203ff3 P 76f75ba098df4a76b0f8986e9533090f: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-1/wal/wals/7bc0f8c75d71418c8e97aad47e203ff3
I20260809 15:31:18.999887 20135 tablet_service.cc:1467] Processing CreateTablet for tablet d0b52574c7e74dc6a75cc3b8285a0c2b (DEFAULT_TABLE table=test-table [id=e3a2a381969847ba986004728e4f5442]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:31:19.000173 20135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0b52574c7e74dc6a75cc3b8285a0c2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:19.000296 20407 ts_tablet_manager.cc:1939] T 7bc0f8c75d71418c8e97aad47e203ff3 P 76f75ba098df4a76b0f8986e9533090f: Deleting consensus metadata
I20260809 15:31:19.001555 20406 tablet_replica.cc:330] T 7bc0f8c75d71418c8e97aad47e203ff3 P a43f25bfb93f424fbea3dc4ae5276ea6: stopping tablet replica
I20260809 15:31:19.001981 20406 raft_consensus.cc:2229] T 7bc0f8c75d71418c8e97aad47e203ff3 P a43f25bfb93f424fbea3dc4ae5276ea6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:31:19.002271 20406 raft_consensus.cc:2258] T 7bc0f8c75d71418c8e97aad47e203ff3 P a43f25bfb93f424fbea3dc4ae5276ea6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:31:19.002422 20379 tablet_bootstrap.cc:492] T d0b52574c7e74dc6a75cc3b8285a0c2b P a43f25bfb93f424fbea3dc4ae5276ea6: Bootstrap starting.
I20260809 15:31:19.002432 20380 tablet_bootstrap.cc:492] T d0b52574c7e74dc6a75cc3b8285a0c2b P 76f75ba098df4a76b0f8986e9533090f: Bootstrap starting.
I20260809 15:31:19.003377 20380 tablet_bootstrap.cc:654] T d0b52574c7e74dc6a75cc3b8285a0c2b P 76f75ba098df4a76b0f8986e9533090f: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:19.003422 20379 tablet_bootstrap.cc:654] T d0b52574c7e74dc6a75cc3b8285a0c2b P a43f25bfb93f424fbea3dc4ae5276ea6: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:19.003826 20406 ts_tablet_manager.cc:1905] T 7bc0f8c75d71418c8e97aad47e203ff3 P a43f25bfb93f424fbea3dc4ae5276ea6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:31:19.004390 19817 catalog_manager.cc:4841] TS 76f75ba098df4a76b0f8986e9533090f (127.11.146.2:35401): tablet 7bc0f8c75d71418c8e97aad47e203ff3 (table test-table [id=ff4f6cf248b141308ea26da61a54f623]) successfully deleted
I20260809 15:31:19.004988 20380 tablet_bootstrap.cc:492] T d0b52574c7e74dc6a75cc3b8285a0c2b P 76f75ba098df4a76b0f8986e9533090f: No bootstrap required, opened a new log
I20260809 15:31:19.005075 20380 ts_tablet_manager.cc:1397] T d0b52574c7e74dc6a75cc3b8285a0c2b P 76f75ba098df4a76b0f8986e9533090f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 15:31:19.005483 20281 tablet_service.cc:1467] Processing CreateTablet for tablet d0b52574c7e74dc6a75cc3b8285a0c2b (DEFAULT_TABLE table=test-table [id=e3a2a381969847ba986004728e4f5442]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:31:19.005609 20380 raft_consensus.cc:348] T d0b52574c7e74dc6a75cc3b8285a0c2b P 76f75ba098df4a76b0f8986e9533090f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:19.005717 20380 raft_consensus.cc:374] T d0b52574c7e74dc6a75cc3b8285a0c2b P 76f75ba098df4a76b0f8986e9533090f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:19.005749 20380 raft_consensus.cc:729] T d0b52574c7e74dc6a75cc3b8285a0c2b P 76f75ba098df4a76b0f8986e9533090f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76f75ba098df4a76b0f8986e9533090f, State: Initialized, Role: FOLLOWER
I20260809 15:31:19.005752 20281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0b52574c7e74dc6a75cc3b8285a0c2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:19.005882 20380 consensus_queue.cc:260] T d0b52574c7e74dc6a75cc3b8285a0c2b P 76f75ba098df4a76b0f8986e9533090f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:19.006143 20380 ts_tablet_manager.cc:1428] T d0b52574c7e74dc6a75cc3b8285a0c2b P 76f75ba098df4a76b0f8986e9533090f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 15:31:19.007586 20379 tablet_bootstrap.cc:492] T d0b52574c7e74dc6a75cc3b8285a0c2b P a43f25bfb93f424fbea3dc4ae5276ea6: No bootstrap required, opened a new log
I20260809 15:31:19.007671 20379 ts_tablet_manager.cc:1397] T d0b52574c7e74dc6a75cc3b8285a0c2b P a43f25bfb93f424fbea3dc4ae5276ea6: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260809 15:31:19.008136 20379 raft_consensus.cc:348] T d0b52574c7e74dc6a75cc3b8285a0c2b P a43f25bfb93f424fbea3dc4ae5276ea6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:19.008265 20379 raft_consensus.cc:374] T d0b52574c7e74dc6a75cc3b8285a0c2b P a43f25bfb93f424fbea3dc4ae5276ea6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:19.008303 20379 raft_consensus.cc:729] T d0b52574c7e74dc6a75cc3b8285a0c2b P a43f25bfb93f424fbea3dc4ae5276ea6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a43f25bfb93f424fbea3dc4ae5276ea6, State: Initialized, Role: FOLLOWER
I20260809 15:31:19.008435 20379 consensus_queue.cc:260] T d0b52574c7e74dc6a75cc3b8285a0c2b P a43f25bfb93f424fbea3dc4ae5276ea6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:19.008706 20379 ts_tablet_manager.cc:1428] T d0b52574c7e74dc6a75cc3b8285a0c2b P a43f25bfb93f424fbea3dc4ae5276ea6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 15:31:19.008936 20385 tablet_bootstrap.cc:492] T d0b52574c7e74dc6a75cc3b8285a0c2b P 8bac77c0c2094527998dcdeeabea2570: Bootstrap starting.
I20260809 15:31:19.009758 20406 ts_tablet_manager.cc:1918] T 7bc0f8c75d71418c8e97aad47e203ff3 P a43f25bfb93f424fbea3dc4ae5276ea6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:31:19.009842 20406 log.cc:1196] T 7bc0f8c75d71418c8e97aad47e203ff3 P a43f25bfb93f424fbea3dc4ae5276ea6: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-0/wal/wals/7bc0f8c75d71418c8e97aad47e203ff3
I20260809 15:31:19.010025 20385 tablet_bootstrap.cc:654] T d0b52574c7e74dc6a75cc3b8285a0c2b P 8bac77c0c2094527998dcdeeabea2570: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:19.010181 20406 ts_tablet_manager.cc:1939] T 7bc0f8c75d71418c8e97aad47e203ff3 P a43f25bfb93f424fbea3dc4ae5276ea6: Deleting consensus metadata
I20260809 15:31:19.010939 20405 ts_tablet_manager.cc:1918] T 7bc0f8c75d71418c8e97aad47e203ff3 P 8bac77c0c2094527998dcdeeabea2570: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:31:19.011027 20405 log.cc:1196] T 7bc0f8c75d71418c8e97aad47e203ff3 P 8bac77c0c2094527998dcdeeabea2570: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-2/wal/wals/7bc0f8c75d71418c8e97aad47e203ff3
I20260809 15:31:19.011337 20405 ts_tablet_manager.cc:1939] T 7bc0f8c75d71418c8e97aad47e203ff3 P 8bac77c0c2094527998dcdeeabea2570: Deleting consensus metadata
I20260809 15:31:19.011826 19820 catalog_manager.cc:4841] TS a43f25bfb93f424fbea3dc4ae5276ea6 (127.11.146.1:45059): tablet 7bc0f8c75d71418c8e97aad47e203ff3 (table test-table [id=ff4f6cf248b141308ea26da61a54f623]) successfully deleted
I20260809 15:31:19.012478 20385 tablet_bootstrap.cc:492] T d0b52574c7e74dc6a75cc3b8285a0c2b P 8bac77c0c2094527998dcdeeabea2570: No bootstrap required, opened a new log
I20260809 15:31:19.012686 20385 ts_tablet_manager.cc:1397] T d0b52574c7e74dc6a75cc3b8285a0c2b P 8bac77c0c2094527998dcdeeabea2570: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260809 15:31:19.013078 20385 raft_consensus.cc:348] T d0b52574c7e74dc6a75cc3b8285a0c2b P 8bac77c0c2094527998dcdeeabea2570 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:19.013170 20385 raft_consensus.cc:374] T d0b52574c7e74dc6a75cc3b8285a0c2b P 8bac77c0c2094527998dcdeeabea2570 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:19.013218 20385 raft_consensus.cc:729] T d0b52574c7e74dc6a75cc3b8285a0c2b P 8bac77c0c2094527998dcdeeabea2570 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bac77c0c2094527998dcdeeabea2570, State: Initialized, Role: FOLLOWER
I20260809 15:31:19.013350 20385 consensus_queue.cc:260] T d0b52574c7e74dc6a75cc3b8285a0c2b P 8bac77c0c2094527998dcdeeabea2570 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:19.013630 20385 ts_tablet_manager.cc:1428] T d0b52574c7e74dc6a75cc3b8285a0c2b P 8bac77c0c2094527998dcdeeabea2570: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 15:31:19.014014 19820 catalog_manager.cc:4841] TS 8bac77c0c2094527998dcdeeabea2570 (127.11.146.3:43141): tablet 7bc0f8c75d71418c8e97aad47e203ff3 (table test-table [id=ff4f6cf248b141308ea26da61a54f623]) successfully deleted
I20260809 15:31:19.424110 20388 raft_consensus.cc:482] T d0b52574c7e74dc6a75cc3b8285a0c2b P 8bac77c0c2094527998dcdeeabea2570 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:31:19.424314 20388 raft_consensus.cc:504] T d0b52574c7e74dc6a75cc3b8285a0c2b P 8bac77c0c2094527998dcdeeabea2570 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:19.425957 20388 leader_election.cc:288] T d0b52574c7e74dc6a75cc3b8285a0c2b P 8bac77c0c2094527998dcdeeabea2570 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a43f25bfb93f424fbea3dc4ae5276ea6 (127.11.146.1:45059), 76f75ba098df4a76b0f8986e9533090f (127.11.146.2:35401)
I20260809 15:31:19.431099 20377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:19.426437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:34697 (local address 127.11.146.2:35401)
0809 15:31:19.426603 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:19.426610 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:19.427001 (+ 391us) server_negotiation.cc:407] Connection header received
0809 15:31:19.427202 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:19.427205 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:19.427252 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:19.427292 (+ 40us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:31:19.427805 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:19.428892 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:19.430105 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:19.430523 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:19.430656 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:19.430717 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:19.430896 (+ 179us) server_negotiation.cc:299] Negotiation successful
0809 15:31:19.430972 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 15:31:19.431118 20413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:19.426261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:35401 (local address 127.11.146.3:34697)
0809 15:31:19.426888 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:19.426906 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:19.427042 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:19.427441 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:19.427444 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:19.427491 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:31:19.427631 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:19.427639 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:19.429034 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:19.429037 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:19.429988 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:19.429996 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:19.430656 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:19.430660 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:19.430752 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:19.430778 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 15:31:19.430879 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 15:31:19.430958 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"mutex_wait_us":2,"spinlock_wait_cycles":5504,"thread_start_us":104,"threads_started":1}
I20260809 15:31:19.431761 20412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:19.426429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:45523 (local address 127.11.146.1:45059)
0809 15:31:19.426722 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:19.426727 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:19.427057 (+ 330us) server_negotiation.cc:407] Connection header received
0809 15:31:19.427198 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:19.427203 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:19.427276 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:19.427410 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:31:19.427800 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:19.428410 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:19.429782 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:19.430621 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:19.430776 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:19.430856 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:19.431269 (+ 413us) server_negotiation.cc:299] Negotiation successful
0809 15:31:19.431377 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":86,"threads_started":1}
I20260809 15:31:19.432018 20155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0b52574c7e74dc6a75cc3b8285a0c2b" candidate_uuid: "8bac77c0c2094527998dcdeeabea2570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f75ba098df4a76b0f8986e9533090f" is_pre_election: true
I20260809 15:31:19.432317 20411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:19.426261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:45059 (local address 127.11.146.3:45523)
0809 15:31:19.426987 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:19.427000 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:19.427078 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:19.427439 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:19.427442 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:19.427490 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:31:19.427653 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:19.427660 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:19.428529 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:19.428533 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:19.429632 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:19.429643 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:19.430932 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:19.430939 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:19.431086 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:19.431125 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 15:31:19.431954 (+ 829us) client_negotiation.cc:240] Negotiation successful
0809 15:31:19.432067 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":660,"mutex_wait_us":368,"spinlock_wait_cycles":35968,"thread_start_us":62,"threads_started":1}
I20260809 15:31:19.432457 20155 raft_consensus.cc:2454] T d0b52574c7e74dc6a75cc3b8285a0c2b P 76f75ba098df4a76b0f8986e9533090f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bac77c0c2094527998dcdeeabea2570 in term 0.
I20260809 15:31:19.432832 20005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0b52574c7e74dc6a75cc3b8285a0c2b" candidate_uuid: "8bac77c0c2094527998dcdeeabea2570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" is_pre_election: true
I20260809 15:31:19.432998 20005 raft_consensus.cc:2454] T d0b52574c7e74dc6a75cc3b8285a0c2b P a43f25bfb93f424fbea3dc4ae5276ea6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bac77c0c2094527998dcdeeabea2570 in term 0.
I20260809 15:31:19.433043 20228 leader_election.cc:302] T d0b52574c7e74dc6a75cc3b8285a0c2b P 8bac77c0c2094527998dcdeeabea2570 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76f75ba098df4a76b0f8986e9533090f, 8bac77c0c2094527998dcdeeabea2570; no voters:
I20260809 15:31:19.433372 20388 raft_consensus.cc:2781] T d0b52574c7e74dc6a75cc3b8285a0c2b P 8bac77c0c2094527998dcdeeabea2570 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:31:19.433452 20388 raft_consensus.cc:482] T d0b52574c7e74dc6a75cc3b8285a0c2b P 8bac77c0c2094527998dcdeeabea2570 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:31:19.433504 20388 raft_consensus.cc:3037] T d0b52574c7e74dc6a75cc3b8285a0c2b P 8bac77c0c2094527998dcdeeabea2570 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:19.434688 20388 raft_consensus.cc:504] T d0b52574c7e74dc6a75cc3b8285a0c2b P 8bac77c0c2094527998dcdeeabea2570 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:19.435133 20388 leader_election.cc:288] T d0b52574c7e74dc6a75cc3b8285a0c2b P 8bac77c0c2094527998dcdeeabea2570 [CANDIDATE]: Term 1 election: Requested vote from peers a43f25bfb93f424fbea3dc4ae5276ea6 (127.11.146.1:45059), 76f75ba098df4a76b0f8986e9533090f (127.11.146.2:35401)
I20260809 15:31:19.435469 20005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0b52574c7e74dc6a75cc3b8285a0c2b" candidate_uuid: "8bac77c0c2094527998dcdeeabea2570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6"
I20260809 15:31:19.435527 20155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0b52574c7e74dc6a75cc3b8285a0c2b" candidate_uuid: "8bac77c0c2094527998dcdeeabea2570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f75ba098df4a76b0f8986e9533090f"
I20260809 15:31:19.435762 20005 raft_consensus.cc:3037] T d0b52574c7e74dc6a75cc3b8285a0c2b P a43f25bfb93f424fbea3dc4ae5276ea6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:19.435832 20155 raft_consensus.cc:3037] T d0b52574c7e74dc6a75cc3b8285a0c2b P 76f75ba098df4a76b0f8986e9533090f [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:19.436956 20155 raft_consensus.cc:2454] T d0b52574c7e74dc6a75cc3b8285a0c2b P 76f75ba098df4a76b0f8986e9533090f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bac77c0c2094527998dcdeeabea2570 in term 1.
I20260809 15:31:19.437266 20228 leader_election.cc:302] T d0b52574c7e74dc6a75cc3b8285a0c2b P 8bac77c0c2094527998dcdeeabea2570 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76f75ba098df4a76b0f8986e9533090f, 8bac77c0c2094527998dcdeeabea2570; no voters:
I20260809 15:31:19.437475 20388 raft_consensus.cc:2781] T d0b52574c7e74dc6a75cc3b8285a0c2b P 8bac77c0c2094527998dcdeeabea2570 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:31:19.437690 20388 raft_consensus.cc:686] T d0b52574c7e74dc6a75cc3b8285a0c2b P 8bac77c0c2094527998dcdeeabea2570 [term 1 LEADER]: Becoming Leader. State: Replica: 8bac77c0c2094527998dcdeeabea2570, State: Running, Role: LEADER
I20260809 15:31:19.437698 20005 raft_consensus.cc:2454] T d0b52574c7e74dc6a75cc3b8285a0c2b P a43f25bfb93f424fbea3dc4ae5276ea6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bac77c0c2094527998dcdeeabea2570 in term 1.
I20260809 15:31:19.438339 20388 consensus_queue.cc:237] T d0b52574c7e74dc6a75cc3b8285a0c2b P 8bac77c0c2094527998dcdeeabea2570 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:19.440992 19834 catalog_manager.cc:5495] T d0b52574c7e74dc6a75cc3b8285a0c2b P 8bac77c0c2094527998dcdeeabea2570 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8bac77c0c2094527998dcdeeabea2570 (127.11.146.3). New cstate: current_term: 1 leader_uuid: "8bac77c0c2094527998dcdeeabea2570" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } health_report { overall_health: HEALTHY } } }
Aug 09 15:31:19 dist-test-slave-1jjb krb5kdc[19784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289477, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.62@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM
I20260809 15:31:19.498061 20422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:19.486114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39656 (local address 127.11.146.62:46081)
0809 15:31:19.486366 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:19.486383 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:19.486550 (+ 167us) server_negotiation.cc:407] Connection header received
0809 15:31:19.486731 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:19.486734 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:19.486781 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:19.486869 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:19.487923 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:19.488585 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:19.490038 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:19.490270 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:19.490361 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:19.493687 (+ 3326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:19.493690 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:19.493692 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:19.493716 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:19.495340 (+ 1624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:19.496213 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:19.496218 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:19.496221 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:19.496324 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:19.496707 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:19.496710 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:19.496711 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:19.496922 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:19.497034 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:19.497598 (+ 564us) server_negotiation.cc:299] Negotiation successful
0809 15:31:19.497875 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":128,"server-negotiator.queue_time_us":160,"thread_start_us":69,"threads_started":1}
I20260809 15:31:19.498145 20421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:19.486006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:46081 (local address 127.0.0.1:39656)
0809 15:31:19.486403 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:19.486432 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:19.486592 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:19.486928 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:19.486933 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:19.487579 (+ 646us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:19.487746 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:19.487757 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:19.488711 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:19.488717 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:19.489870 (+ 1153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:19.489886 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:19.490434 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:19.490440 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:19.490566 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:19.491227 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:19.491247 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:19.493507 (+ 2260us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:19.495473 (+ 1966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:19.495487 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:19.495498 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:19.495999 (+ 501us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:19.496466 (+ 467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:19.496472 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:19.496477 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:19.496596 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:19.497146 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:19.497158 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:19.497347 (+ 189us) client_negotiation.cc:769] Sending connection context
0809 15:31:19.497519 (+ 172us) client_negotiation.cc:240] Negotiation successful
0809 15:31:19.497759 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":114,"threads_started":1}
I20260809 15:31:19.503283 19834 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:39656:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 15:31:19.504400 19834 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:31:19.510262 19984 tablet_service.cc:1467] Processing CreateTablet for tablet 5e489eee5594452180820ad21c1cdc40 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b0dd7d470ddd4cd181869920bf7e4235]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 15:31:19.510262 20135 tablet_service.cc:1467] Processing CreateTablet for tablet 5e489eee5594452180820ad21c1cdc40 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b0dd7d470ddd4cd181869920bf7e4235]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 15:31:19.510685 19984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e489eee5594452180820ad21c1cdc40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:19.510685 20135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e489eee5594452180820ad21c1cdc40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:19.510607 20281 tablet_service.cc:1467] Processing CreateTablet for tablet 5e489eee5594452180820ad21c1cdc40 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b0dd7d470ddd4cd181869920bf7e4235]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 15:31:19.511041 20281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e489eee5594452180820ad21c1cdc40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:19.514045 20423 tablet_bootstrap.cc:492] T 5e489eee5594452180820ad21c1cdc40 P 76f75ba098df4a76b0f8986e9533090f: Bootstrap starting.
I20260809 15:31:19.515098 20425 tablet_bootstrap.cc:492] T 5e489eee5594452180820ad21c1cdc40 P 8bac77c0c2094527998dcdeeabea2570: Bootstrap starting.
I20260809 15:31:19.515194 20423 tablet_bootstrap.cc:654] T 5e489eee5594452180820ad21c1cdc40 P 76f75ba098df4a76b0f8986e9533090f: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:19.515502 20424 tablet_bootstrap.cc:492] T 5e489eee5594452180820ad21c1cdc40 P a43f25bfb93f424fbea3dc4ae5276ea6: Bootstrap starting.
I20260809 15:31:19.516616 20425 tablet_bootstrap.cc:654] T 5e489eee5594452180820ad21c1cdc40 P 8bac77c0c2094527998dcdeeabea2570: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:19.517210 20424 tablet_bootstrap.cc:654] T 5e489eee5594452180820ad21c1cdc40 P a43f25bfb93f424fbea3dc4ae5276ea6: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:19.518160 20425 tablet_bootstrap.cc:492] T 5e489eee5594452180820ad21c1cdc40 P 8bac77c0c2094527998dcdeeabea2570: No bootstrap required, opened a new log
I20260809 15:31:19.518285 20425 ts_tablet_manager.cc:1397] T 5e489eee5594452180820ad21c1cdc40 P 8bac77c0c2094527998dcdeeabea2570: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 15:31:19.518608 20424 tablet_bootstrap.cc:492] T 5e489eee5594452180820ad21c1cdc40 P a43f25bfb93f424fbea3dc4ae5276ea6: No bootstrap required, opened a new log
I20260809 15:31:19.518725 20424 ts_tablet_manager.cc:1397] T 5e489eee5594452180820ad21c1cdc40 P a43f25bfb93f424fbea3dc4ae5276ea6: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 15:31:19.518731 20425 raft_consensus.cc:348] T 5e489eee5594452180820ad21c1cdc40 P 8bac77c0c2094527998dcdeeabea2570 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:19.518864 20425 raft_consensus.cc:374] T 5e489eee5594452180820ad21c1cdc40 P 8bac77c0c2094527998dcdeeabea2570 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:19.518937 20425 raft_consensus.cc:729] T 5e489eee5594452180820ad21c1cdc40 P 8bac77c0c2094527998dcdeeabea2570 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bac77c0c2094527998dcdeeabea2570, State: Initialized, Role: FOLLOWER
I20260809 15:31:19.519093 20425 consensus_queue.cc:260] T 5e489eee5594452180820ad21c1cdc40 P 8bac77c0c2094527998dcdeeabea2570 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:19.519284 20424 raft_consensus.cc:348] T 5e489eee5594452180820ad21c1cdc40 P a43f25bfb93f424fbea3dc4ae5276ea6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:19.519344 20388 tablet_replica.cc:439] T 5e489eee5594452180820ad21c1cdc40 P 8bac77c0c2094527998dcdeeabea2570: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } } }
I20260809 15:31:19.519428 20424 raft_consensus.cc:374] T 5e489eee5594452180820ad21c1cdc40 P a43f25bfb93f424fbea3dc4ae5276ea6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:19.519469 20388 tablet_replica.cc:442] T 5e489eee5594452180820ad21c1cdc40 P 8bac77c0c2094527998dcdeeabea2570: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:31:19.519471 20424 raft_consensus.cc:729] T 5e489eee5594452180820ad21c1cdc40 P a43f25bfb93f424fbea3dc4ae5276ea6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a43f25bfb93f424fbea3dc4ae5276ea6, State: Initialized, Role: FOLLOWER
I20260809 15:31:19.519713 20425 ts_tablet_manager.cc:1428] T 5e489eee5594452180820ad21c1cdc40 P 8bac77c0c2094527998dcdeeabea2570: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260809 15:31:19.519636 20424 consensus_queue.cc:260] T 5e489eee5594452180820ad21c1cdc40 P a43f25bfb93f424fbea3dc4ae5276ea6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:19.520148 20424 ts_tablet_manager.cc:1428] T 5e489eee5594452180820ad21c1cdc40 P a43f25bfb93f424fbea3dc4ae5276ea6: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260809 15:31:19.520102 20429 tablet_replica.cc:439] T 5e489eee5594452180820ad21c1cdc40 P a43f25bfb93f424fbea3dc4ae5276ea6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } } }
I20260809 15:31:19.520251 20429 tablet_replica.cc:442] T 5e489eee5594452180820ad21c1cdc40 P a43f25bfb93f424fbea3dc4ae5276ea6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:31:19.523079 20423 tablet_bootstrap.cc:492] T 5e489eee5594452180820ad21c1cdc40 P 76f75ba098df4a76b0f8986e9533090f: No bootstrap required, opened a new log
I20260809 15:31:19.523195 20423 ts_tablet_manager.cc:1397] T 5e489eee5594452180820ad21c1cdc40 P 76f75ba098df4a76b0f8986e9533090f: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20260809 15:31:19.523743 20423 raft_consensus.cc:348] T 5e489eee5594452180820ad21c1cdc40 P 76f75ba098df4a76b0f8986e9533090f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:19.523895 20423 raft_consensus.cc:374] T 5e489eee5594452180820ad21c1cdc40 P 76f75ba098df4a76b0f8986e9533090f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:19.523947 20423 raft_consensus.cc:729] T 5e489eee5594452180820ad21c1cdc40 P 76f75ba098df4a76b0f8986e9533090f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76f75ba098df4a76b0f8986e9533090f, State: Initialized, Role: FOLLOWER
I20260809 15:31:19.524142 20423 consensus_queue.cc:260] T 5e489eee5594452180820ad21c1cdc40 P 76f75ba098df4a76b0f8986e9533090f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:19.524616 20423 ts_tablet_manager.cc:1428] T 5e489eee5594452180820ad21c1cdc40 P 76f75ba098df4a76b0f8986e9533090f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 15:31:19.524593 20430 tablet_replica.cc:439] T 5e489eee5594452180820ad21c1cdc40 P 76f75ba098df4a76b0f8986e9533090f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } } }
I20260809 15:31:19.524986 20430 tablet_replica.cc:442] T 5e489eee5594452180820ad21c1cdc40 P 76f75ba098df4a76b0f8986e9533090f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:31:19.599812 20388 raft_consensus.cc:482] T 5e489eee5594452180820ad21c1cdc40 P 8bac77c0c2094527998dcdeeabea2570 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:31:19.599988 20388 raft_consensus.cc:504] T 5e489eee5594452180820ad21c1cdc40 P 8bac77c0c2094527998dcdeeabea2570 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:19.600545 20388 leader_election.cc:288] T 5e489eee5594452180820ad21c1cdc40 P 8bac77c0c2094527998dcdeeabea2570 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a43f25bfb93f424fbea3dc4ae5276ea6 (127.11.146.1:45059), 76f75ba098df4a76b0f8986e9533090f (127.11.146.2:35401)
I20260809 15:31:19.601039 20005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e489eee5594452180820ad21c1cdc40" candidate_uuid: "8bac77c0c2094527998dcdeeabea2570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" is_pre_election: true
I20260809 15:31:19.601069 20155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e489eee5594452180820ad21c1cdc40" candidate_uuid: "8bac77c0c2094527998dcdeeabea2570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f75ba098df4a76b0f8986e9533090f" is_pre_election: true
I20260809 15:31:19.601209 20005 raft_consensus.cc:2454] T 5e489eee5594452180820ad21c1cdc40 P a43f25bfb93f424fbea3dc4ae5276ea6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bac77c0c2094527998dcdeeabea2570 in term 0.
I20260809 15:31:19.601256 20155 raft_consensus.cc:2454] T 5e489eee5594452180820ad21c1cdc40 P 76f75ba098df4a76b0f8986e9533090f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bac77c0c2094527998dcdeeabea2570 in term 0.
I20260809 15:31:19.601559 20231 leader_election.cc:302] T 5e489eee5594452180820ad21c1cdc40 P 8bac77c0c2094527998dcdeeabea2570 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bac77c0c2094527998dcdeeabea2570, a43f25bfb93f424fbea3dc4ae5276ea6; no voters:
I20260809 15:31:19.601775 20388 raft_consensus.cc:2781] T 5e489eee5594452180820ad21c1cdc40 P 8bac77c0c2094527998dcdeeabea2570 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:31:19.601884 20388 raft_consensus.cc:482] T 5e489eee5594452180820ad21c1cdc40 P 8bac77c0c2094527998dcdeeabea2570 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:31:19.601940 20388 raft_consensus.cc:3037] T 5e489eee5594452180820ad21c1cdc40 P 8bac77c0c2094527998dcdeeabea2570 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:19.603152 20388 raft_consensus.cc:504] T 5e489eee5594452180820ad21c1cdc40 P 8bac77c0c2094527998dcdeeabea2570 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:19.603550 20388 leader_election.cc:288] T 5e489eee5594452180820ad21c1cdc40 P 8bac77c0c2094527998dcdeeabea2570 [CANDIDATE]: Term 1 election: Requested vote from peers a43f25bfb93f424fbea3dc4ae5276ea6 (127.11.146.1:45059), 76f75ba098df4a76b0f8986e9533090f (127.11.146.2:35401)
I20260809 15:31:19.603999 20005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e489eee5594452180820ad21c1cdc40" candidate_uuid: "8bac77c0c2094527998dcdeeabea2570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6"
I20260809 15:31:19.603989 20155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e489eee5594452180820ad21c1cdc40" candidate_uuid: "8bac77c0c2094527998dcdeeabea2570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f75ba098df4a76b0f8986e9533090f"
I20260809 15:31:19.604156 20005 raft_consensus.cc:3037] T 5e489eee5594452180820ad21c1cdc40 P a43f25bfb93f424fbea3dc4ae5276ea6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:19.604161 20155 raft_consensus.cc:3037] T 5e489eee5594452180820ad21c1cdc40 P 76f75ba098df4a76b0f8986e9533090f [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:19.605165 20005 raft_consensus.cc:2454] T 5e489eee5594452180820ad21c1cdc40 P a43f25bfb93f424fbea3dc4ae5276ea6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bac77c0c2094527998dcdeeabea2570 in term 1.
I20260809 15:31:19.605489 20231 leader_election.cc:302] T 5e489eee5594452180820ad21c1cdc40 P 8bac77c0c2094527998dcdeeabea2570 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bac77c0c2094527998dcdeeabea2570, a43f25bfb93f424fbea3dc4ae5276ea6; no voters:
I20260809 15:31:19.605537 20155 raft_consensus.cc:2454] T 5e489eee5594452180820ad21c1cdc40 P 76f75ba098df4a76b0f8986e9533090f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bac77c0c2094527998dcdeeabea2570 in term 1.
I20260809 15:31:19.605692 20388 raft_consensus.cc:2781] T 5e489eee5594452180820ad21c1cdc40 P 8bac77c0c2094527998dcdeeabea2570 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:31:19.605792 20388 raft_consensus.cc:686] T 5e489eee5594452180820ad21c1cdc40 P 8bac77c0c2094527998dcdeeabea2570 [term 1 LEADER]: Becoming Leader. State: Replica: 8bac77c0c2094527998dcdeeabea2570, State: Running, Role: LEADER
I20260809 15:31:19.605947 20388 consensus_queue.cc:237] T 5e489eee5594452180820ad21c1cdc40 P 8bac77c0c2094527998dcdeeabea2570 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:19.606900 20414 tablet_replica.cc:439] T 5e489eee5594452180820ad21c1cdc40 P 8bac77c0c2094527998dcdeeabea2570: TxnStatusTablet state changed. Reason: New leader 8bac77c0c2094527998dcdeeabea2570. Latest consensus state: current_term: 1 leader_uuid: "8bac77c0c2094527998dcdeeabea2570" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } } }
I20260809 15:31:19.607021 20414 tablet_replica.cc:442] T 5e489eee5594452180820ad21c1cdc40 P 8bac77c0c2094527998dcdeeabea2570: This TxnStatusTablet replica's current role is: LEADER
I20260809 15:31:19.607373 20433 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 15:31:19.607558 20433 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 15:31:19.608052 19834 catalog_manager.cc:5495] T 5e489eee5594452180820ad21c1cdc40 P 8bac77c0c2094527998dcdeeabea2570 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8bac77c0c2094527998dcdeeabea2570 (127.11.146.3). New cstate: current_term: 1 leader_uuid: "8bac77c0c2094527998dcdeeabea2570" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } health_report { overall_health: HEALTHY } } }
I20260809 15:31:19.625502 20421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:19.619230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:43141 (local address 127.0.0.1:39802)
0809 15:31:19.619572 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:19.619588 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:19.619692 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:19.620342 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:19.620345 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:19.620355 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 15:31:19.620499 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:19.620506 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:19.621643 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:19.621646 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:19.622965 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:19.622986 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:19.623610 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:19.623614 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:19.623708 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:19.623773 (+ 65us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 15:31:19.625118 (+ 1345us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 15:31:19.625140 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 15:31:19.625234 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 15:31:19.625334 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226}
I20260809 15:31:19.626149 20437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:19.619551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39802 (local address 127.11.146.3:43141)
0809 15:31:19.619986 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:19.619995 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:19.620010 (+ 15us) server_negotiation.cc:407] Connection header received
0809 15:31:19.620122 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:19.620125 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:19.620189 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:19.620294 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:31:19.620633 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:19.621520 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:19.623139 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:19.623478 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:19.623599 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:19.624191 (+ 592us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:31:19.624893 (+ 702us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:31:19.625041 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:19.625304 (+ 263us) server_negotiation.cc:299] Negotiation successful
0809 15:31:19.625365 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":112,"threads_started":1}
I20260809 15:31:19.630300 20005 raft_consensus.cc:1261] T 5e489eee5594452180820ad21c1cdc40 P a43f25bfb93f424fbea3dc4ae5276ea6 [term 1 FOLLOWER]: Refusing update from remote peer 8bac77c0c2094527998dcdeeabea2570: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:31:19.630656 20155 raft_consensus.cc:1261] T 5e489eee5594452180820ad21c1cdc40 P 76f75ba098df4a76b0f8986e9533090f [term 1 FOLLOWER]: Refusing update from remote peer 8bac77c0c2094527998dcdeeabea2570: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:31:19.630878 20414 consensus_queue.cc:1035] T 5e489eee5594452180820ad21c1cdc40 P 8bac77c0c2094527998dcdeeabea2570 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:31:19.631693 20388 consensus_queue.cc:1035] T 5e489eee5594452180820ad21c1cdc40 P 8bac77c0c2094527998dcdeeabea2570 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:31:19.634186 20429 tablet_replica.cc:439] T 5e489eee5594452180820ad21c1cdc40 P a43f25bfb93f424fbea3dc4ae5276ea6: TxnStatusTablet state changed. Reason: New leader 8bac77c0c2094527998dcdeeabea2570. Latest consensus state: current_term: 1 leader_uuid: "8bac77c0c2094527998dcdeeabea2570" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } } }
I20260809 15:31:19.634354 20429 tablet_replica.cc:442] T 5e489eee5594452180820ad21c1cdc40 P a43f25bfb93f424fbea3dc4ae5276ea6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:31:19.636703 20430 tablet_replica.cc:439] T 5e489eee5594452180820ad21c1cdc40 P 76f75ba098df4a76b0f8986e9533090f: TxnStatusTablet state changed. Reason: New leader 8bac77c0c2094527998dcdeeabea2570. Latest consensus state: current_term: 1 leader_uuid: "8bac77c0c2094527998dcdeeabea2570" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } } }
I20260809 15:31:19.636879 20430 tablet_replica.cc:442] T 5e489eee5594452180820ad21c1cdc40 P 76f75ba098df4a76b0f8986e9533090f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:31:19.637636 20414 tablet_replica.cc:439] T 5e489eee5594452180820ad21c1cdc40 P 8bac77c0c2094527998dcdeeabea2570: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8bac77c0c2094527998dcdeeabea2570" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } } }
I20260809 15:31:19.637774 20414 tablet_replica.cc:442] T 5e489eee5594452180820ad21c1cdc40 P 8bac77c0c2094527998dcdeeabea2570: This TxnStatusTablet replica's current role is: LEADER
I20260809 15:31:19.637914 20438 mvcc.cc:205] Tried to move back new op lower bound from 7316641708558606336 to 7316641708468174848. Current Snapshot: MvccSnapshot[applied={T|T < 7316641708558606336}]
I20260809 15:31:19.639261 20388 tablet_replica.cc:439] T 5e489eee5594452180820ad21c1cdc40 P 8bac77c0c2094527998dcdeeabea2570: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8bac77c0c2094527998dcdeeabea2570" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } } }
I20260809 15:31:19.639379 20388 tablet_replica.cc:442] T 5e489eee5594452180820ad21c1cdc40 P 8bac77c0c2094527998dcdeeabea2570: This TxnStatusTablet replica's current role is: LEADER
I20260809 15:31:19.640821 20429 tablet_replica.cc:439] T 5e489eee5594452180820ad21c1cdc40 P a43f25bfb93f424fbea3dc4ae5276ea6: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8bac77c0c2094527998dcdeeabea2570" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } } }
I20260809 15:31:19.640957 20429 tablet_replica.cc:442] T 5e489eee5594452180820ad21c1cdc40 P a43f25bfb93f424fbea3dc4ae5276ea6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:31:19.642822 20430 tablet_replica.cc:439] T 5e489eee5594452180820ad21c1cdc40 P 76f75ba098df4a76b0f8986e9533090f: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8bac77c0c2094527998dcdeeabea2570" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } } }
I20260809 15:31:19.642959 20430 tablet_replica.cc:442] T 5e489eee5594452180820ad21c1cdc40 P 76f75ba098df4a76b0f8986e9533090f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 15:31:19.648841 20437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:19.644365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39808 (local address 127.11.146.3:43141)
0809 15:31:19.644484 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:19.644492 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:19.644693 (+ 201us) server_negotiation.cc:407] Connection header received
0809 15:31:19.644800 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:19.644803 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:19.644847 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:19.644917 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:31:19.645339 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:19.645963 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:19.647487 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:19.647761 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:19.647874 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:19.648266 (+ 392us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:31:19.648361 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:31:19.648440 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:19.648569 (+ 129us) server_negotiation.cc:299] Negotiation successful
0809 15:31:19.648670 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 15:31:19.665988 20437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:19.661084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:37179 (local address 127.11.146.3:43141)
0809 15:31:19.661218 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:19.661222 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:19.661631 (+ 409us) server_negotiation.cc:407] Connection header received
0809 15:31:19.661810 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:19.661813 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:19.661867 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:19.661958 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:31:19.662252 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:19.663091 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:19.664643 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:19.664997 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:19.665104 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:19.665452 (+ 348us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:31:19.665537 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:31:19.665611 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:19.665775 (+ 164us) server_negotiation.cc:299] Negotiation successful
0809 15:31:19.665826 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 15:31:19.665997 20451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:19.661063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:43141 (local address 127.11.146.3:37179)
0809 15:31:19.661483 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:19.661498 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:19.661710 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:19.662006 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:19.662009 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:19.662039 (+ 30us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 15:31:19.662146 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:19.662151 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:19.663221 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:19.663224 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:19.664504 (+ 1280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:19.664517 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:19.665141 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:19.665144 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:19.665230 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:19.665281 (+ 51us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 15:31:19.665659 (+ 378us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 15:31:19.665666 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 15:31:19.665735 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 15:31:19.665802 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":179,"threads_started":1}
I20260809 15:31:19.674182 20155 raft_consensus.cc:1261] T d0b52574c7e74dc6a75cc3b8285a0c2b P 76f75ba098df4a76b0f8986e9533090f [term 1 FOLLOWER]: Refusing update from remote peer 8bac77c0c2094527998dcdeeabea2570: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:31:19.674248 20005 raft_consensus.cc:1261] T d0b52574c7e74dc6a75cc3b8285a0c2b P a43f25bfb93f424fbea3dc4ae5276ea6 [term 1 FOLLOWER]: Refusing update from remote peer 8bac77c0c2094527998dcdeeabea2570: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:31:19.674683 20452 consensus_queue.cc:1035] T d0b52574c7e74dc6a75cc3b8285a0c2b P 8bac77c0c2094527998dcdeeabea2570 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:31:19.674906 20414 consensus_queue.cc:1035] T d0b52574c7e74dc6a75cc3b8285a0c2b P 8bac77c0c2094527998dcdeeabea2570 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:31:19.723907 19832 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39640:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:31:19.724141 19832 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39640:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:31:19.726730 19832 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5d0ac665726e49ddbd5d4da103685916: Sending DeleteTablet for 3 replicas of tablet d0b52574c7e74dc6a75cc3b8285a0c2b
I20260809 15:31:19.727644 19984 tablet_service.cc:1514] Processing DeleteTablet for tablet d0b52574c7e74dc6a75cc3b8285a0c2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:31:19 UTC) from {username='oryx', principal='oryx/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:38904
I20260809 15:31:19.727844 20281 tablet_service.cc:1514] Processing DeleteTablet for tablet d0b52574c7e74dc6a75cc3b8285a0c2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:31:19 UTC) from {username='oryx', principal='oryx/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:39794
I20260809 15:31:19.728026 20135 tablet_service.cc:1514] Processing DeleteTablet for tablet d0b52574c7e74dc6a75cc3b8285a0c2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:31:19 UTC) from {username='oryx', principal='oryx/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:35370
I20260809 15:31:19.728201 20456 tablet_replica.cc:330] T d0b52574c7e74dc6a75cc3b8285a0c2b P a43f25bfb93f424fbea3dc4ae5276ea6: stopping tablet replica
I20260809 15:31:19.728402 20456 raft_consensus.cc:2229] T d0b52574c7e74dc6a75cc3b8285a0c2b P a43f25bfb93f424fbea3dc4ae5276ea6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:31:19.728464 20458 tablet_replica.cc:330] T d0b52574c7e74dc6a75cc3b8285a0c2b P 76f75ba098df4a76b0f8986e9533090f: stopping tablet replica
I20260809 15:31:19.728559 20456 raft_consensus.cc:2258] T d0b52574c7e74dc6a75cc3b8285a0c2b P a43f25bfb93f424fbea3dc4ae5276ea6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:31:19.728664 20458 raft_consensus.cc:2229] T d0b52574c7e74dc6a75cc3b8285a0c2b P 76f75ba098df4a76b0f8986e9533090f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:31:19.729156 20458 raft_consensus.cc:2258] T d0b52574c7e74dc6a75cc3b8285a0c2b P 76f75ba098df4a76b0f8986e9533090f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:31:19.729496 20456 ts_tablet_manager.cc:1905] T d0b52574c7e74dc6a75cc3b8285a0c2b P a43f25bfb93f424fbea3dc4ae5276ea6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:31:19.730036 20458 ts_tablet_manager.cc:1905] T d0b52574c7e74dc6a75cc3b8285a0c2b P 76f75ba098df4a76b0f8986e9533090f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:31:19.734095 20456 ts_tablet_manager.cc:1918] T d0b52574c7e74dc6a75cc3b8285a0c2b P a43f25bfb93f424fbea3dc4ae5276ea6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 15:31:19.734303 20456 log.cc:1196] T d0b52574c7e74dc6a75cc3b8285a0c2b P a43f25bfb93f424fbea3dc4ae5276ea6: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-0/wal/wals/d0b52574c7e74dc6a75cc3b8285a0c2b
I20260809 15:31:19.734597 20458 ts_tablet_manager.cc:1918] T d0b52574c7e74dc6a75cc3b8285a0c2b P 76f75ba098df4a76b0f8986e9533090f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 15:31:19.734701 20456 ts_tablet_manager.cc:1939] T d0b52574c7e74dc6a75cc3b8285a0c2b P a43f25bfb93f424fbea3dc4ae5276ea6: Deleting consensus metadata
I20260809 15:31:19.734795 20458 log.cc:1196] T d0b52574c7e74dc6a75cc3b8285a0c2b P 76f75ba098df4a76b0f8986e9533090f: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-1/wal/wals/d0b52574c7e74dc6a75cc3b8285a0c2b
I20260809 15:31:19.735162 20458 ts_tablet_manager.cc:1939] T d0b52574c7e74dc6a75cc3b8285a0c2b P 76f75ba098df4a76b0f8986e9533090f: Deleting consensus metadata
I20260809 15:31:19.735965 19820 catalog_manager.cc:4841] TS a43f25bfb93f424fbea3dc4ae5276ea6 (127.11.146.1:45059): tablet d0b52574c7e74dc6a75cc3b8285a0c2b (table test-table [id=e3a2a381969847ba986004728e4f5442]) successfully deleted
I20260809 15:31:19.736315 19817 catalog_manager.cc:4841] TS 76f75ba098df4a76b0f8986e9533090f (127.11.146.2:35401): tablet d0b52574c7e74dc6a75cc3b8285a0c2b (table test-table [id=e3a2a381969847ba986004728e4f5442]) successfully deleted
I20260809 15:31:19.739796 20457 tablet_replica.cc:330] T d0b52574c7e74dc6a75cc3b8285a0c2b P 8bac77c0c2094527998dcdeeabea2570: stopping tablet replica
I20260809 15:31:19.739949 20457 raft_consensus.cc:2229] T d0b52574c7e74dc6a75cc3b8285a0c2b P 8bac77c0c2094527998dcdeeabea2570 [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:31:19.740345 20457 raft_consensus.cc:2258] T d0b52574c7e74dc6a75cc3b8285a0c2b P 8bac77c0c2094527998dcdeeabea2570 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:31:19.741120 20457 ts_tablet_manager.cc:1905] T d0b52574c7e74dc6a75cc3b8285a0c2b P 8bac77c0c2094527998dcdeeabea2570: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:31:19.744288 20457 ts_tablet_manager.cc:1918] T d0b52574c7e74dc6a75cc3b8285a0c2b P 8bac77c0c2094527998dcdeeabea2570: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 15:31:19.744380 20457 log.cc:1196] T d0b52574c7e74dc6a75cc3b8285a0c2b P 8bac77c0c2094527998dcdeeabea2570: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-2/wal/wals/d0b52574c7e74dc6a75cc3b8285a0c2b
I20260809 15:31:19.744689 20457 ts_tablet_manager.cc:1939] T d0b52574c7e74dc6a75cc3b8285a0c2b P 8bac77c0c2094527998dcdeeabea2570: Deleting consensus metadata
I20260809 15:31:19.745563 19820 catalog_manager.cc:4841] TS 8bac77c0c2094527998dcdeeabea2570 (127.11.146.3:43141): tablet d0b52574c7e74dc6a75cc3b8285a0c2b (table test-table [id=e3a2a381969847ba986004728e4f5442]) successfully deleted
Aug 09 15:31:19 dist-test-slave-1jjb krb5kdc[19784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289479, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 15:31:19 dist-test-slave-1jjb krb5kdc[19784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:19 dist-test-slave-1jjb krb5kdc[19784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
W20260809 15:31:19.764938 20422 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:19.757384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39672 (local address 127.11.146.62:46081)
0809 15:31:19.757556 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:19.757561 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:19.757736 (+ 175us) server_negotiation.cc:407] Connection header received
0809 15:31:19.758081 (+ 345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:19.758085 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:19.758134 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:19.758229 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:19.759075 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:19.759616 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:19.760937 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:19.761184 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:19.761299 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:19.764804 (+ 3505us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39672: BlockingRecv error: recv got EOF from 127.0.0.1:39672 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 09 15:31:19 dist-test-slave-1jjb krb5kdc[19784](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289479, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM
I20260809 15:31:19.776186 20422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:19.766731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39684 (local address 127.11.146.62:46081)
0809 15:31:19.766860 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:19.766865 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:19.767006 (+ 141us) server_negotiation.cc:407] Connection header received
0809 15:31:19.767157 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:19.767160 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:19.767210 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:19.767299 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:19.767922 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:19.768543 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:19.769353 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:19.769585 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:19.769695 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:19.772423 (+ 2728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:19.772426 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:19.772428 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:19.772454 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:19.774147 (+ 1693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:19.774677 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:19.774680 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:19.774681 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:19.774770 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:19.775085 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:19.775088 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:19.775089 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:19.775269 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:19.775371 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:19.775857 (+ 486us) server_negotiation.cc:299] Negotiation successful
0809 15:31:19.775978 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 15:31:19.779268 19832 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39684:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:31:19.779836 19832 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:31:19.785554 20135 tablet_service.cc:1467] Processing CreateTablet for tablet a223245c4aa54a89a28589f1c586cd9b (DEFAULT_TABLE table=test-table [id=bcf14a428cef47c287853b7fbaa7d84c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:31:19.785554 19984 tablet_service.cc:1467] Processing CreateTablet for tablet a223245c4aa54a89a28589f1c586cd9b (DEFAULT_TABLE table=test-table [id=bcf14a428cef47c287853b7fbaa7d84c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:31:19.785925 20135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a223245c4aa54a89a28589f1c586cd9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:19.785921 19984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a223245c4aa54a89a28589f1c586cd9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:19.787853 20423 tablet_bootstrap.cc:492] T a223245c4aa54a89a28589f1c586cd9b P 76f75ba098df4a76b0f8986e9533090f: Bootstrap starting.
I20260809 15:31:19.788537 20281 tablet_service.cc:1467] Processing CreateTablet for tablet a223245c4aa54a89a28589f1c586cd9b (DEFAULT_TABLE table=test-table [id=bcf14a428cef47c287853b7fbaa7d84c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:31:19.788805 20423 tablet_bootstrap.cc:654] T a223245c4aa54a89a28589f1c586cd9b P 76f75ba098df4a76b0f8986e9533090f: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:19.788816 20281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a223245c4aa54a89a28589f1c586cd9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:19.789811 20423 tablet_bootstrap.cc:492] T a223245c4aa54a89a28589f1c586cd9b P 76f75ba098df4a76b0f8986e9533090f: No bootstrap required, opened a new log
I20260809 15:31:19.789917 20423 ts_tablet_manager.cc:1397] T a223245c4aa54a89a28589f1c586cd9b P 76f75ba098df4a76b0f8986e9533090f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 15:31:19.790261 20423 raft_consensus.cc:348] T a223245c4aa54a89a28589f1c586cd9b P 76f75ba098df4a76b0f8986e9533090f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:19.790392 20423 raft_consensus.cc:374] T a223245c4aa54a89a28589f1c586cd9b P 76f75ba098df4a76b0f8986e9533090f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:19.790427 20423 raft_consensus.cc:729] T a223245c4aa54a89a28589f1c586cd9b P 76f75ba098df4a76b0f8986e9533090f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76f75ba098df4a76b0f8986e9533090f, State: Initialized, Role: FOLLOWER
I20260809 15:31:19.790580 20423 consensus_queue.cc:260] T a223245c4aa54a89a28589f1c586cd9b P 76f75ba098df4a76b0f8986e9533090f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:19.790863 20423 ts_tablet_manager.cc:1428] T a223245c4aa54a89a28589f1c586cd9b P 76f75ba098df4a76b0f8986e9533090f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 15:31:19.791137 20425 tablet_bootstrap.cc:492] T a223245c4aa54a89a28589f1c586cd9b P 8bac77c0c2094527998dcdeeabea2570: Bootstrap starting.
I20260809 15:31:19.792443 20425 tablet_bootstrap.cc:654] T a223245c4aa54a89a28589f1c586cd9b P 8bac77c0c2094527998dcdeeabea2570: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:19.793200 20424 tablet_bootstrap.cc:492] T a223245c4aa54a89a28589f1c586cd9b P a43f25bfb93f424fbea3dc4ae5276ea6: Bootstrap starting.
I20260809 15:31:19.794335 20424 tablet_bootstrap.cc:654] T a223245c4aa54a89a28589f1c586cd9b P a43f25bfb93f424fbea3dc4ae5276ea6: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:19.796056 20424 tablet_bootstrap.cc:492] T a223245c4aa54a89a28589f1c586cd9b P a43f25bfb93f424fbea3dc4ae5276ea6: No bootstrap required, opened a new log
I20260809 15:31:19.796171 20425 tablet_bootstrap.cc:492] T a223245c4aa54a89a28589f1c586cd9b P 8bac77c0c2094527998dcdeeabea2570: No bootstrap required, opened a new log
I20260809 15:31:19.796188 20424 ts_tablet_manager.cc:1397] T a223245c4aa54a89a28589f1c586cd9b P a43f25bfb93f424fbea3dc4ae5276ea6: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20260809 15:31:19.796267 20425 ts_tablet_manager.cc:1397] T a223245c4aa54a89a28589f1c586cd9b P 8bac77c0c2094527998dcdeeabea2570: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 15:31:19.796728 20424 raft_consensus.cc:348] T a223245c4aa54a89a28589f1c586cd9b P a43f25bfb93f424fbea3dc4ae5276ea6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:19.796882 20424 raft_consensus.cc:374] T a223245c4aa54a89a28589f1c586cd9b P a43f25bfb93f424fbea3dc4ae5276ea6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:19.796936 20424 raft_consensus.cc:729] T a223245c4aa54a89a28589f1c586cd9b P a43f25bfb93f424fbea3dc4ae5276ea6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a43f25bfb93f424fbea3dc4ae5276ea6, State: Initialized, Role: FOLLOWER
I20260809 15:31:19.797111 20424 consensus_queue.cc:260] T a223245c4aa54a89a28589f1c586cd9b P a43f25bfb93f424fbea3dc4ae5276ea6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:19.797134 20425 raft_consensus.cc:348] T a223245c4aa54a89a28589f1c586cd9b P 8bac77c0c2094527998dcdeeabea2570 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:19.797232 20425 raft_consensus.cc:374] T a223245c4aa54a89a28589f1c586cd9b P 8bac77c0c2094527998dcdeeabea2570 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:19.797271 20425 raft_consensus.cc:729] T a223245c4aa54a89a28589f1c586cd9b P 8bac77c0c2094527998dcdeeabea2570 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bac77c0c2094527998dcdeeabea2570, State: Initialized, Role: FOLLOWER
I20260809 15:31:19.797420 20424 ts_tablet_manager.cc:1428] T a223245c4aa54a89a28589f1c586cd9b P a43f25bfb93f424fbea3dc4ae5276ea6: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 15:31:19.797384 20425 consensus_queue.cc:260] T a223245c4aa54a89a28589f1c586cd9b P 8bac77c0c2094527998dcdeeabea2570 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:19.797663 20425 ts_tablet_manager.cc:1428] T a223245c4aa54a89a28589f1c586cd9b P 8bac77c0c2094527998dcdeeabea2570: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 15:31:19.973265 20414 raft_consensus.cc:482] T a223245c4aa54a89a28589f1c586cd9b P 8bac77c0c2094527998dcdeeabea2570 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:31:19.973452 20414 raft_consensus.cc:504] T a223245c4aa54a89a28589f1c586cd9b P 8bac77c0c2094527998dcdeeabea2570 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:19.974076 20414 leader_election.cc:288] T a223245c4aa54a89a28589f1c586cd9b P 8bac77c0c2094527998dcdeeabea2570 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a43f25bfb93f424fbea3dc4ae5276ea6 (127.11.146.1:45059), 76f75ba098df4a76b0f8986e9533090f (127.11.146.2:35401)
I20260809 15:31:19.974625 20154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a223245c4aa54a89a28589f1c586cd9b" candidate_uuid: "8bac77c0c2094527998dcdeeabea2570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f75ba098df4a76b0f8986e9533090f" is_pre_election: true
I20260809 15:31:19.974624 20005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a223245c4aa54a89a28589f1c586cd9b" candidate_uuid: "8bac77c0c2094527998dcdeeabea2570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" is_pre_election: true
I20260809 15:31:19.974797 20154 raft_consensus.cc:2454] T a223245c4aa54a89a28589f1c586cd9b P 76f75ba098df4a76b0f8986e9533090f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bac77c0c2094527998dcdeeabea2570 in term 0.
I20260809 15:31:19.974804 20005 raft_consensus.cc:2454] T a223245c4aa54a89a28589f1c586cd9b P a43f25bfb93f424fbea3dc4ae5276ea6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bac77c0c2094527998dcdeeabea2570 in term 0.
I20260809 15:31:19.975129 20228 leader_election.cc:302] T a223245c4aa54a89a28589f1c586cd9b P 8bac77c0c2094527998dcdeeabea2570 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76f75ba098df4a76b0f8986e9533090f, 8bac77c0c2094527998dcdeeabea2570; no voters:
I20260809 15:31:19.975350 20414 raft_consensus.cc:2781] T a223245c4aa54a89a28589f1c586cd9b P 8bac77c0c2094527998dcdeeabea2570 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:31:19.975415 20414 raft_consensus.cc:482] T a223245c4aa54a89a28589f1c586cd9b P 8bac77c0c2094527998dcdeeabea2570 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:31:19.975462 20414 raft_consensus.cc:3037] T a223245c4aa54a89a28589f1c586cd9b P 8bac77c0c2094527998dcdeeabea2570 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:19.976972 20414 raft_consensus.cc:504] T a223245c4aa54a89a28589f1c586cd9b P 8bac77c0c2094527998dcdeeabea2570 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:19.977330 20414 leader_election.cc:288] T a223245c4aa54a89a28589f1c586cd9b P 8bac77c0c2094527998dcdeeabea2570 [CANDIDATE]: Term 1 election: Requested vote from peers a43f25bfb93f424fbea3dc4ae5276ea6 (127.11.146.1:45059), 76f75ba098df4a76b0f8986e9533090f (127.11.146.2:35401)
I20260809 15:31:19.977726 20005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a223245c4aa54a89a28589f1c586cd9b" candidate_uuid: "8bac77c0c2094527998dcdeeabea2570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6"
I20260809 15:31:19.977727 20154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a223245c4aa54a89a28589f1c586cd9b" candidate_uuid: "8bac77c0c2094527998dcdeeabea2570" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f75ba098df4a76b0f8986e9533090f"
I20260809 15:31:19.977900 20154 raft_consensus.cc:3037] T a223245c4aa54a89a28589f1c586cd9b P 76f75ba098df4a76b0f8986e9533090f [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:19.977895 20005 raft_consensus.cc:3037] T a223245c4aa54a89a28589f1c586cd9b P a43f25bfb93f424fbea3dc4ae5276ea6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:19.978899 20154 raft_consensus.cc:2454] T a223245c4aa54a89a28589f1c586cd9b P 76f75ba098df4a76b0f8986e9533090f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bac77c0c2094527998dcdeeabea2570 in term 1.
I20260809 15:31:19.979101 20005 raft_consensus.cc:2454] T a223245c4aa54a89a28589f1c586cd9b P a43f25bfb93f424fbea3dc4ae5276ea6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bac77c0c2094527998dcdeeabea2570 in term 1.
I20260809 15:31:19.979236 20228 leader_election.cc:302] T a223245c4aa54a89a28589f1c586cd9b P 8bac77c0c2094527998dcdeeabea2570 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76f75ba098df4a76b0f8986e9533090f, 8bac77c0c2094527998dcdeeabea2570; no voters:
I20260809 15:31:19.979420 20414 raft_consensus.cc:2781] T a223245c4aa54a89a28589f1c586cd9b P 8bac77c0c2094527998dcdeeabea2570 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:31:19.979509 20414 raft_consensus.cc:686] T a223245c4aa54a89a28589f1c586cd9b P 8bac77c0c2094527998dcdeeabea2570 [term 1 LEADER]: Becoming Leader. State: Replica: 8bac77c0c2094527998dcdeeabea2570, State: Running, Role: LEADER
I20260809 15:31:19.979655 20414 consensus_queue.cc:237] T a223245c4aa54a89a28589f1c586cd9b P 8bac77c0c2094527998dcdeeabea2570 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:19.981247 19834 catalog_manager.cc:5495] T a223245c4aa54a89a28589f1c586cd9b P 8bac77c0c2094527998dcdeeabea2570 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8bac77c0c2094527998dcdeeabea2570 (127.11.146.3). New cstate: current_term: 1 leader_uuid: "8bac77c0c2094527998dcdeeabea2570" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } health_report { overall_health: HEALTHY } } }
I20260809 15:31:20.033272 20437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:20.029877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39810 (local address 127.11.146.3:43141)
0809 15:31:20.030068 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:20.030074 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:20.030089 (+ 15us) server_negotiation.cc:407] Connection header received
0809 15:31:20.030147 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:20.030150 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:20.030192 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:20.030275 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:31:20.030550 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:20.031067 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:20.032136 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:20.032364 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:20.032482 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:20.032758 (+ 276us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:31:20.032831 (+ 73us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:31:20.032945 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:20.033071 (+ 126us) server_negotiation.cc:299] Negotiation successful
0809 15:31:20.033125 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260809 15:31:20.035426 20154 raft_consensus.cc:1261] T a223245c4aa54a89a28589f1c586cd9b P 76f75ba098df4a76b0f8986e9533090f [term 1 FOLLOWER]: Refusing update from remote peer 8bac77c0c2094527998dcdeeabea2570: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:31:20.035425 20005 raft_consensus.cc:1261] T a223245c4aa54a89a28589f1c586cd9b P a43f25bfb93f424fbea3dc4ae5276ea6 [term 1 FOLLOWER]: Refusing update from remote peer 8bac77c0c2094527998dcdeeabea2570: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:31:20.036091 20414 consensus_queue.cc:1035] T a223245c4aa54a89a28589f1c586cd9b P 8bac77c0c2094527998dcdeeabea2570 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:31:20.036235 20388 consensus_queue.cc:1035] T a223245c4aa54a89a28589f1c586cd9b P 8bac77c0c2094527998dcdeeabea2570 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:31:20.043298 19832 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:31:20.043511 19832 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:31:20.045692 19832 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5d0ac665726e49ddbd5d4da103685916: Sending DeleteTablet for 3 replicas of tablet a223245c4aa54a89a28589f1c586cd9b
I20260809 15:31:20.046224 19984 tablet_service.cc:1514] Processing DeleteTablet for tablet a223245c4aa54a89a28589f1c586cd9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:31:20 UTC) from {username='oryx', principal='oryx/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:38904
I20260809 15:31:20.046311 20281 tablet_service.cc:1514] Processing DeleteTablet for tablet a223245c4aa54a89a28589f1c586cd9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:31:20 UTC) from {username='oryx', principal='oryx/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:39794
I20260809 15:31:20.046432 20135 tablet_service.cc:1514] Processing DeleteTablet for tablet a223245c4aa54a89a28589f1c586cd9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:31:20 UTC) from {username='oryx', principal='oryx/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:35370
I20260809 15:31:20.046499 20457 tablet_replica.cc:330] T a223245c4aa54a89a28589f1c586cd9b P 8bac77c0c2094527998dcdeeabea2570: stopping tablet replica
I20260809 15:31:20.046617 20457 raft_consensus.cc:2229] T a223245c4aa54a89a28589f1c586cd9b P 8bac77c0c2094527998dcdeeabea2570 [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:31:20.046646 20456 tablet_replica.cc:330] T a223245c4aa54a89a28589f1c586cd9b P a43f25bfb93f424fbea3dc4ae5276ea6: stopping tablet replica
I20260809 15:31:20.046790 20456 raft_consensus.cc:2229] T a223245c4aa54a89a28589f1c586cd9b P a43f25bfb93f424fbea3dc4ae5276ea6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:31:20.046824 20457 raft_consensus.cc:2258] T a223245c4aa54a89a28589f1c586cd9b P 8bac77c0c2094527998dcdeeabea2570 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:31:20.046931 20456 raft_consensus.cc:2258] T a223245c4aa54a89a28589f1c586cd9b P a43f25bfb93f424fbea3dc4ae5276ea6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:31:20.047099 20458 tablet_replica.cc:330] T a223245c4aa54a89a28589f1c586cd9b P 76f75ba098df4a76b0f8986e9533090f: stopping tablet replica
I20260809 15:31:20.047109 19832 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39684:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 15:31:20.047206 20458 raft_consensus.cc:2229] T a223245c4aa54a89a28589f1c586cd9b P 76f75ba098df4a76b0f8986e9533090f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:31:20.047319 20458 raft_consensus.cc:2258] T a223245c4aa54a89a28589f1c586cd9b P 76f75ba098df4a76b0f8986e9533090f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260809 15:31:20.047514 19832 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:31:20.047567 20457 ts_tablet_manager.cc:1905] T a223245c4aa54a89a28589f1c586cd9b P 8bac77c0c2094527998dcdeeabea2570: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:31:20.047567 20456 ts_tablet_manager.cc:1905] T a223245c4aa54a89a28589f1c586cd9b P a43f25bfb93f424fbea3dc4ae5276ea6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:31:20.048032 20458 ts_tablet_manager.cc:1905] T a223245c4aa54a89a28589f1c586cd9b P 76f75ba098df4a76b0f8986e9533090f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:31:20.050134 20456 ts_tablet_manager.cc:1918] T a223245c4aa54a89a28589f1c586cd9b P a43f25bfb93f424fbea3dc4ae5276ea6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:31:20.050221 20456 log.cc:1196] T a223245c4aa54a89a28589f1c586cd9b P a43f25bfb93f424fbea3dc4ae5276ea6: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-0/wal/wals/a223245c4aa54a89a28589f1c586cd9b
I20260809 15:31:20.050420 20458 ts_tablet_manager.cc:1918] T a223245c4aa54a89a28589f1c586cd9b P 76f75ba098df4a76b0f8986e9533090f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:31:20.050496 20456 ts_tablet_manager.cc:1939] T a223245c4aa54a89a28589f1c586cd9b P a43f25bfb93f424fbea3dc4ae5276ea6: Deleting consensus metadata
I20260809 15:31:20.050522 20458 log.cc:1196] T a223245c4aa54a89a28589f1c586cd9b P 76f75ba098df4a76b0f8986e9533090f: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-1/wal/wals/a223245c4aa54a89a28589f1c586cd9b
I20260809 15:31:20.050799 20458 ts_tablet_manager.cc:1939] T a223245c4aa54a89a28589f1c586cd9b P 76f75ba098df4a76b0f8986e9533090f: Deleting consensus metadata
I20260809 15:31:20.051385 20457 ts_tablet_manager.cc:1918] T a223245c4aa54a89a28589f1c586cd9b P 8bac77c0c2094527998dcdeeabea2570: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:31:20.051448 20457 log.cc:1196] T a223245c4aa54a89a28589f1c586cd9b P 8bac77c0c2094527998dcdeeabea2570: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-2/wal/wals/a223245c4aa54a89a28589f1c586cd9b
I20260809 15:31:20.051749 20457 ts_tablet_manager.cc:1939] T a223245c4aa54a89a28589f1c586cd9b P 8bac77c0c2094527998dcdeeabea2570: Deleting consensus metadata
I20260809 15:31:20.051723 19817 catalog_manager.cc:4841] TS 76f75ba098df4a76b0f8986e9533090f (127.11.146.2:35401): tablet a223245c4aa54a89a28589f1c586cd9b (table test-table [id=bcf14a428cef47c287853b7fbaa7d84c]) successfully deleted
I20260809 15:31:20.051919 19820 catalog_manager.cc:4841] TS a43f25bfb93f424fbea3dc4ae5276ea6 (127.11.146.1:45059): tablet a223245c4aa54a89a28589f1c586cd9b (table test-table [id=bcf14a428cef47c287853b7fbaa7d84c]) successfully deleted
I20260809 15:31:20.052623 19820 catalog_manager.cc:4841] TS 8bac77c0c2094527998dcdeeabea2570 (127.11.146.3:43141): tablet a223245c4aa54a89a28589f1c586cd9b (table test-table [id=bcf14a428cef47c287853b7fbaa7d84c]) successfully deleted
I20260809 15:31:20.055100 19984 tablet_service.cc:1467] Processing CreateTablet for tablet a65c9c44a48c4b998d4726e3a480cb4e (DEFAULT_TABLE table=test-table [id=de01074c656a4c58bd6d015e07278b83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:31:20.055181 20135 tablet_service.cc:1467] Processing CreateTablet for tablet a65c9c44a48c4b998d4726e3a480cb4e (DEFAULT_TABLE table=test-table [id=de01074c656a4c58bd6d015e07278b83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:31:20.055397 19984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a65c9c44a48c4b998d4726e3a480cb4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:20.055408 20135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a65c9c44a48c4b998d4726e3a480cb4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:20.056479 20281 tablet_service.cc:1467] Processing CreateTablet for tablet a65c9c44a48c4b998d4726e3a480cb4e (DEFAULT_TABLE table=test-table [id=de01074c656a4c58bd6d015e07278b83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:31:20.056787 20281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a65c9c44a48c4b998d4726e3a480cb4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:20.057852 20423 tablet_bootstrap.cc:492] T a65c9c44a48c4b998d4726e3a480cb4e P 76f75ba098df4a76b0f8986e9533090f: Bootstrap starting.
I20260809 15:31:20.059355 20423 tablet_bootstrap.cc:654] T a65c9c44a48c4b998d4726e3a480cb4e P 76f75ba098df4a76b0f8986e9533090f: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:20.059391 20425 tablet_bootstrap.cc:492] T a65c9c44a48c4b998d4726e3a480cb4e P 8bac77c0c2094527998dcdeeabea2570: Bootstrap starting.
I20260809 15:31:20.059981 20424 tablet_bootstrap.cc:492] T a65c9c44a48c4b998d4726e3a480cb4e P a43f25bfb93f424fbea3dc4ae5276ea6: Bootstrap starting.
I20260809 15:31:20.060346 20425 tablet_bootstrap.cc:654] T a65c9c44a48c4b998d4726e3a480cb4e P 8bac77c0c2094527998dcdeeabea2570: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:20.060683 20423 tablet_bootstrap.cc:492] T a65c9c44a48c4b998d4726e3a480cb4e P 76f75ba098df4a76b0f8986e9533090f: No bootstrap required, opened a new log
I20260809 15:31:20.060793 20423 ts_tablet_manager.cc:1397] T a65c9c44a48c4b998d4726e3a480cb4e P 76f75ba098df4a76b0f8986e9533090f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 15:31:20.061195 20423 raft_consensus.cc:348] T a65c9c44a48c4b998d4726e3a480cb4e P 76f75ba098df4a76b0f8986e9533090f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:20.061302 20424 tablet_bootstrap.cc:654] T a65c9c44a48c4b998d4726e3a480cb4e P a43f25bfb93f424fbea3dc4ae5276ea6: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:20.061321 20423 raft_consensus.cc:374] T a65c9c44a48c4b998d4726e3a480cb4e P 76f75ba098df4a76b0f8986e9533090f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:20.061363 20423 raft_consensus.cc:729] T a65c9c44a48c4b998d4726e3a480cb4e P 76f75ba098df4a76b0f8986e9533090f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76f75ba098df4a76b0f8986e9533090f, State: Initialized, Role: FOLLOWER
I20260809 15:31:20.061518 20423 consensus_queue.cc:260] T a65c9c44a48c4b998d4726e3a480cb4e P 76f75ba098df4a76b0f8986e9533090f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:20.062619 20424 tablet_bootstrap.cc:492] T a65c9c44a48c4b998d4726e3a480cb4e P a43f25bfb93f424fbea3dc4ae5276ea6: No bootstrap required, opened a new log
I20260809 15:31:20.062709 20424 ts_tablet_manager.cc:1397] T a65c9c44a48c4b998d4726e3a480cb4e P a43f25bfb93f424fbea3dc4ae5276ea6: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260809 15:31:20.062709 20423 ts_tablet_manager.cc:1428] T a65c9c44a48c4b998d4726e3a480cb4e P 76f75ba098df4a76b0f8986e9533090f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 15:31:20.063191 20424 raft_consensus.cc:348] T a65c9c44a48c4b998d4726e3a480cb4e P a43f25bfb93f424fbea3dc4ae5276ea6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:20.063321 20424 raft_consensus.cc:374] T a65c9c44a48c4b998d4726e3a480cb4e P a43f25bfb93f424fbea3dc4ae5276ea6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:20.063362 20424 raft_consensus.cc:729] T a65c9c44a48c4b998d4726e3a480cb4e P a43f25bfb93f424fbea3dc4ae5276ea6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a43f25bfb93f424fbea3dc4ae5276ea6, State: Initialized, Role: FOLLOWER
I20260809 15:31:20.063521 20424 consensus_queue.cc:260] T a65c9c44a48c4b998d4726e3a480cb4e P a43f25bfb93f424fbea3dc4ae5276ea6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:20.063841 20425 tablet_bootstrap.cc:492] T a65c9c44a48c4b998d4726e3a480cb4e P 8bac77c0c2094527998dcdeeabea2570: No bootstrap required, opened a new log
I20260809 15:31:20.063916 20424 ts_tablet_manager.cc:1428] T a65c9c44a48c4b998d4726e3a480cb4e P a43f25bfb93f424fbea3dc4ae5276ea6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 15:31:20.063938 20425 ts_tablet_manager.cc:1397] T a65c9c44a48c4b998d4726e3a480cb4e P 8bac77c0c2094527998dcdeeabea2570: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260809 15:31:20.064396 20425 raft_consensus.cc:348] T a65c9c44a48c4b998d4726e3a480cb4e P 8bac77c0c2094527998dcdeeabea2570 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:20.064517 20425 raft_consensus.cc:374] T a65c9c44a48c4b998d4726e3a480cb4e P 8bac77c0c2094527998dcdeeabea2570 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:20.064559 20425 raft_consensus.cc:729] T a65c9c44a48c4b998d4726e3a480cb4e P 8bac77c0c2094527998dcdeeabea2570 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bac77c0c2094527998dcdeeabea2570, State: Initialized, Role: FOLLOWER
I20260809 15:31:20.064695 20425 consensus_queue.cc:260] T a65c9c44a48c4b998d4726e3a480cb4e P 8bac77c0c2094527998dcdeeabea2570 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:20.065874 20425 ts_tablet_manager.cc:1428] T a65c9c44a48c4b998d4726e3a480cb4e P 8bac77c0c2094527998dcdeeabea2570: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260809 15:31:20.164268 20429 raft_consensus.cc:482] T a65c9c44a48c4b998d4726e3a480cb4e P a43f25bfb93f424fbea3dc4ae5276ea6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:31:20.164435 20429 raft_consensus.cc:504] T a65c9c44a48c4b998d4726e3a480cb4e P a43f25bfb93f424fbea3dc4ae5276ea6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:20.165855 20429 leader_election.cc:288] T a65c9c44a48c4b998d4726e3a480cb4e P a43f25bfb93f424fbea3dc4ae5276ea6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76f75ba098df4a76b0f8986e9533090f (127.11.146.2:35401), 8bac77c0c2094527998dcdeeabea2570 (127.11.146.3:43141)
I20260809 15:31:20.170251 20437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:20.166475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:53725 (local address 127.11.146.3:43141)
0809 15:31:20.166613 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:20.166616 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:20.166828 (+ 212us) server_negotiation.cc:407] Connection header received
0809 15:31:20.166990 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:20.166993 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:20.167051 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:20.167129 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:31:20.167397 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:20.167942 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:20.169215 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:20.169595 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:20.169724 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:20.169779 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:20.170046 (+ 267us) server_negotiation.cc:299] Negotiation successful
0809 15:31:20.170115 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 15:31:20.170274 20484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:20.166069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:35401 (local address 127.11.146.1:49961)
0809 15:31:20.166329 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:20.166346 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:20.166454 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:20.166768 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:20.166771 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:20.166788 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:31:20.166973 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:20.166980 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:20.167932 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:20.167936 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:20.168928 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:20.168938 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:20.169753 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:20.169757 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:20.169899 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:20.169928 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 15:31:20.170039 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 15:31:20.170115 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":70,"spinlock_wait_cycles":1792,"thread_start_us":90,"threads_started":1}
I20260809 15:31:20.170292 20486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:20.166194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:49961 (local address 127.11.146.2:35401)
0809 15:31:20.166488 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:20.166496 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:20.166517 (+ 21us) server_negotiation.cc:407] Connection header received
0809 15:31:20.166582 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:20.166585 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:20.166638 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:20.166740 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:31:20.167095 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:20.167819 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:20.169087 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:20.169597 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:20.169748 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:20.169812 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:20.170077 (+ 265us) server_negotiation.cc:299] Negotiation successful
0809 15:31:20.170156 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":91,"threads_started":1}
I20260809 15:31:20.170306 20485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:20.166144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:43141 (local address 127.11.146.1:53725)
0809 15:31:20.166732 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:20.166748 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:20.166884 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:20.167165 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:20.167167 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:20.167188 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:31:20.167276 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:20.167291 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:20.168122 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:20.168126 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:20.169084 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:20.169097 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:20.169725 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:20.169729 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:20.169900 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:20.169930 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 15:31:20.169998 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 15:31:20.170109 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"mutex_wait_us":49,"spinlock_wait_cycles":40576,"thread_start_us":66,"threads_started":1}
I20260809 15:31:20.171066 20154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a65c9c44a48c4b998d4726e3a480cb4e" candidate_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f75ba098df4a76b0f8986e9533090f" is_pre_election: true
I20260809 15:31:20.171197 20301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a65c9c44a48c4b998d4726e3a480cb4e" candidate_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bac77c0c2094527998dcdeeabea2570" is_pre_election: true
I20260809 15:31:20.171239 20154 raft_consensus.cc:2454] T a65c9c44a48c4b998d4726e3a480cb4e P 76f75ba098df4a76b0f8986e9533090f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a43f25bfb93f424fbea3dc4ae5276ea6 in term 0.
I20260809 15:31:20.171367 20301 raft_consensus.cc:2454] T a65c9c44a48c4b998d4726e3a480cb4e P 8bac77c0c2094527998dcdeeabea2570 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a43f25bfb93f424fbea3dc4ae5276ea6 in term 0.
I20260809 15:31:20.171774 19934 leader_election.cc:302] T a65c9c44a48c4b998d4726e3a480cb4e P a43f25bfb93f424fbea3dc4ae5276ea6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76f75ba098df4a76b0f8986e9533090f, a43f25bfb93f424fbea3dc4ae5276ea6; no voters:
I20260809 15:31:20.172042 20429 raft_consensus.cc:2781] T a65c9c44a48c4b998d4726e3a480cb4e P a43f25bfb93f424fbea3dc4ae5276ea6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:31:20.172137 20429 raft_consensus.cc:482] T a65c9c44a48c4b998d4726e3a480cb4e P a43f25bfb93f424fbea3dc4ae5276ea6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:31:20.172183 20429 raft_consensus.cc:3037] T a65c9c44a48c4b998d4726e3a480cb4e P a43f25bfb93f424fbea3dc4ae5276ea6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:20.173166 20429 raft_consensus.cc:504] T a65c9c44a48c4b998d4726e3a480cb4e P a43f25bfb93f424fbea3dc4ae5276ea6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:20.173506 20429 leader_election.cc:288] T a65c9c44a48c4b998d4726e3a480cb4e P a43f25bfb93f424fbea3dc4ae5276ea6 [CANDIDATE]: Term 1 election: Requested vote from peers 76f75ba098df4a76b0f8986e9533090f (127.11.146.2:35401), 8bac77c0c2094527998dcdeeabea2570 (127.11.146.3:43141)
I20260809 15:31:20.173858 20301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a65c9c44a48c4b998d4726e3a480cb4e" candidate_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bac77c0c2094527998dcdeeabea2570"
I20260809 15:31:20.173858 20154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a65c9c44a48c4b998d4726e3a480cb4e" candidate_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f75ba098df4a76b0f8986e9533090f"
I20260809 15:31:20.173982 20154 raft_consensus.cc:3037] T a65c9c44a48c4b998d4726e3a480cb4e P 76f75ba098df4a76b0f8986e9533090f [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:20.173990 20301 raft_consensus.cc:3037] T a65c9c44a48c4b998d4726e3a480cb4e P 8bac77c0c2094527998dcdeeabea2570 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:20.174829 20154 raft_consensus.cc:2454] T a65c9c44a48c4b998d4726e3a480cb4e P 76f75ba098df4a76b0f8986e9533090f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a43f25bfb93f424fbea3dc4ae5276ea6 in term 1.
I20260809 15:31:20.174963 20301 raft_consensus.cc:2454] T a65c9c44a48c4b998d4726e3a480cb4e P 8bac77c0c2094527998dcdeeabea2570 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a43f25bfb93f424fbea3dc4ae5276ea6 in term 1.
I20260809 15:31:20.175173 19934 leader_election.cc:302] T a65c9c44a48c4b998d4726e3a480cb4e P a43f25bfb93f424fbea3dc4ae5276ea6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76f75ba098df4a76b0f8986e9533090f, a43f25bfb93f424fbea3dc4ae5276ea6; no voters:
I20260809 15:31:20.175386 20429 raft_consensus.cc:2781] T a65c9c44a48c4b998d4726e3a480cb4e P a43f25bfb93f424fbea3dc4ae5276ea6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:31:20.175771 20429 raft_consensus.cc:686] T a65c9c44a48c4b998d4726e3a480cb4e P a43f25bfb93f424fbea3dc4ae5276ea6 [term 1 LEADER]: Becoming Leader. State: Replica: a43f25bfb93f424fbea3dc4ae5276ea6, State: Running, Role: LEADER
I20260809 15:31:20.176070 20429 consensus_queue.cc:237] T a65c9c44a48c4b998d4726e3a480cb4e P a43f25bfb93f424fbea3dc4ae5276ea6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } }
I20260809 15:31:20.178813 19833 catalog_manager.cc:5495] T a65c9c44a48c4b998d4726e3a480cb4e P a43f25bfb93f424fbea3dc4ae5276ea6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a43f25bfb93f424fbea3dc4ae5276ea6 (127.11.146.1). New cstate: current_term: 1 leader_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a43f25bfb93f424fbea3dc4ae5276ea6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 } health_report { overall_health: UNKNOWN } } }
I20260809 15:31:20.201696 20489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:20.197442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38914 (local address 127.11.146.1:45059)
0809 15:31:20.197745 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:20.197752 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:20.197766 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:31:20.197864 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:20.197867 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:20.197924 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:20.198045 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:31:20.198290 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:20.198881 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:20.199781 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:20.200041 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:20.200238 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:20.200594 (+ 356us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:31:20.201126 (+ 532us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:31:20.201225 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:20.201396 (+ 171us) server_negotiation.cc:299] Negotiation successful
0809 15:31:20.201448 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":104,"threads_started":1}
I20260809 15:31:20.213557 20437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:20.210116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:46265 (local address 127.11.146.3:43141)
0809 15:31:20.210253 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:20.210256 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:20.210269 (+ 13us) server_negotiation.cc:407] Connection header received
0809 15:31:20.210314 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:20.210316 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:20.210357 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:20.210446 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:31:20.210782 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:20.211275 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:20.212439 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:20.212669 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:20.212754 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:20.213118 (+ 364us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:31:20.213188 (+ 70us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:31:20.213249 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:20.213387 (+ 138us) server_negotiation.cc:299] Negotiation successful
0809 15:31:20.213434 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 15:31:20.213575 20492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:20.209802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:43141 (local address 127.11.146.1:46265)
0809 15:31:20.210133 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:20.210146 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:20.210228 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:20.210510 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:20.210513 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:20.210522 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 15:31:20.210641 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:20.210647 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:20.211394 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:20.211397 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:20.212304 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:20.212315 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:20.212810 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:20.212813 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:20.212904 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:20.212955 (+ 51us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 15:31:20.213275 (+ 320us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 15:31:20.213288 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 15:31:20.213345 (+ 57us) client_negotiation.cc:240] Negotiation successful
0809 15:31:20.213417 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":89,"threads_started":1}
I20260809 15:31:20.219919 20154 raft_consensus.cc:1261] T a65c9c44a48c4b998d4726e3a480cb4e P 76f75ba098df4a76b0f8986e9533090f [term 1 FOLLOWER]: Refusing update from remote peer a43f25bfb93f424fbea3dc4ae5276ea6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:31:20.219950 20301 raft_consensus.cc:1261] T a65c9c44a48c4b998d4726e3a480cb4e P 8bac77c0c2094527998dcdeeabea2570 [term 1 FOLLOWER]: Refusing update from remote peer a43f25bfb93f424fbea3dc4ae5276ea6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:31:20.220534 20487 consensus_queue.cc:1035] T a65c9c44a48c4b998d4726e3a480cb4e P a43f25bfb93f424fbea3dc4ae5276ea6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76f75ba098df4a76b0f8986e9533090f" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:31:20.220714 20429 consensus_queue.cc:1035] T a65c9c44a48c4b998d4726e3a480cb4e P a43f25bfb93f424fbea3dc4ae5276ea6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bac77c0c2094527998dcdeeabea2570" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:31:20.224975 20441 mvcc.cc:205] Tried to move back new op lower bound from 7316641710976348160 to 7316641710804148224. Current Snapshot: MvccSnapshot[applied={T|T < 7316641710976348160}]
I20260809 15:31:20.240725 20489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:20.236840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:46123 (local address 127.11.146.1:45059)
0809 15:31:20.237076 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:20.237081 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:20.237148 (+ 67us) server_negotiation.cc:407] Connection header received
0809 15:31:20.237325 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:20.237330 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:20.237382 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:20.237458 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:31:20.237762 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:20.238282 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:20.239328 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:20.239739 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:20.239872 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:20.240182 (+ 310us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:31:20.240279 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:31:20.240410 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:20.240506 (+ 96us) server_negotiation.cc:299] Negotiation successful
0809 15:31:20.240564 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144}
I20260809 15:31:20.240733 20496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:20.236803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:45059 (local address 127.11.146.3:46123)
0809 15:31:20.237071 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:20.237089 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:20.237196 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:20.237506 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:20.237509 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:20.237532 (+ 23us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 15:31:20.237661 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:20.237675 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:20.238394 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:20.238397 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:20.239092 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:20.239101 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:20.239872 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:20.239877 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:20.239973 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:20.240014 (+ 41us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 15:31:20.240405 (+ 391us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 15:31:20.240413 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 15:31:20.240496 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 15:31:20.240595 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":88,"threads_started":1}
I20260809 15:31:20.265350 19833 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:31:20.265508 19833 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:31:20.268131 19833 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5d0ac665726e49ddbd5d4da103685916: Sending DeleteTablet for 3 replicas of tablet a65c9c44a48c4b998d4726e3a480cb4e
I20260809 15:31:20.268913 20135 tablet_service.cc:1514] Processing DeleteTablet for tablet a65c9c44a48c4b998d4726e3a480cb4e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:31:20 UTC) from {username='oryx', principal='oryx/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:35370
I20260809 15:31:20.268913 20281 tablet_service.cc:1514] Processing DeleteTablet for tablet a65c9c44a48c4b998d4726e3a480cb4e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:31:20 UTC) from {username='oryx', principal='oryx/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:39794
I20260809 15:31:20.268989 19984 tablet_service.cc:1514] Processing DeleteTablet for tablet a65c9c44a48c4b998d4726e3a480cb4e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:31:20 UTC) from {username='oryx', principal='oryx/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:38904
I20260809 15:31:20.269133 20458 tablet_replica.cc:330] T a65c9c44a48c4b998d4726e3a480cb4e P 76f75ba098df4a76b0f8986e9533090f: stopping tablet replica
I20260809 15:31:20.269133 20457 tablet_replica.cc:330] T a65c9c44a48c4b998d4726e3a480cb4e P 8bac77c0c2094527998dcdeeabea2570: stopping tablet replica
I20260809 15:31:20.269215 20456 tablet_replica.cc:330] T a65c9c44a48c4b998d4726e3a480cb4e P a43f25bfb93f424fbea3dc4ae5276ea6: stopping tablet replica
I20260809 15:31:20.269260 20457 raft_consensus.cc:2229] T a65c9c44a48c4b998d4726e3a480cb4e P 8bac77c0c2094527998dcdeeabea2570 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:31:20.269258 20458 raft_consensus.cc:2229] T a65c9c44a48c4b998d4726e3a480cb4e P 76f75ba098df4a76b0f8986e9533090f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:31:20.269351 20456 raft_consensus.cc:2229] T a65c9c44a48c4b998d4726e3a480cb4e P a43f25bfb93f424fbea3dc4ae5276ea6 [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:31:20.269387 20457 raft_consensus.cc:2258] T a65c9c44a48c4b998d4726e3a480cb4e P 8bac77c0c2094527998dcdeeabea2570 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:31:20.269387 20458 raft_consensus.cc:2258] T a65c9c44a48c4b998d4726e3a480cb4e P 76f75ba098df4a76b0f8986e9533090f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:31:20.269701 20456 raft_consensus.cc:2258] T a65c9c44a48c4b998d4726e3a480cb4e P a43f25bfb93f424fbea3dc4ae5276ea6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:31:20.270406 20458 ts_tablet_manager.cc:1905] T a65c9c44a48c4b998d4726e3a480cb4e P 76f75ba098df4a76b0f8986e9533090f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:31:20.270622 20457 ts_tablet_manager.cc:1905] T a65c9c44a48c4b998d4726e3a480cb4e P 8bac77c0c2094527998dcdeeabea2570: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:31:20.273017 20458 ts_tablet_manager.cc:1918] T a65c9c44a48c4b998d4726e3a480cb4e P 76f75ba098df4a76b0f8986e9533090f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 15:31:20.273116 20458 log.cc:1196] T a65c9c44a48c4b998d4726e3a480cb4e P 76f75ba098df4a76b0f8986e9533090f: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-1/wal/wals/a65c9c44a48c4b998d4726e3a480cb4e
I20260809 15:31:20.273363 20458 ts_tablet_manager.cc:1939] T a65c9c44a48c4b998d4726e3a480cb4e P 76f75ba098df4a76b0f8986e9533090f: Deleting consensus metadata
I20260809 15:31:20.273618 20457 ts_tablet_manager.cc:1918] T a65c9c44a48c4b998d4726e3a480cb4e P 8bac77c0c2094527998dcdeeabea2570: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 15:31:20.273721 20457 log.cc:1196] T a65c9c44a48c4b998d4726e3a480cb4e P 8bac77c0c2094527998dcdeeabea2570: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786289437399694-11848-0/minicluster-data/ts-2/wal/wals/a65c9c44a48c4b998d4726e3a480cb4e
I20260809 15:31:20.274055 20457 ts_tablet_manager.cc:1939] T a65c9c44a48c4b998d4726e3a480cb4e P 8bac77c0c2094527998dcdeeabea2570: Deleting consensus metadata
I20260809 15:31:20.274151 19817 catalog_manager.cc:4841] TS 76f75ba098df4a76b0f8986e9533090f (127.11.146.2:35401): tablet a65c9c44a48c4b998d4726e3a480cb4e (table test-table [id=de01074c656a4c58bd6d015e07278b83]) successfully deleted
I20260809 15:31:20.274817 19820 catalog_manager.cc:4841] TS 8bac77c0c2094527998dcdeeabea2570 (127.11.146.3:43141): tablet a65c9c44a48c4b998d4726e3a480cb4e (table test-table [id=de01074c656a4c58bd6d015e07278b83]) successfully deleted
I20260809 15:31:20.275244 20456 ts_tablet_manager.cc:1905] T a65c9c44a48c4b998d4726e3a480cb4e P a43f25bfb93f424fbea3dc4ae5276ea6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:31:20.277021 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 19916
I20260809 15:31:20.288429 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 20064
W20260809 15:31:20.288357 19820 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.146.1:45059 (error 108)
I20260809 15:31:20.291707 20502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:20.290975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:45059 (local address 127.0.0.1:38916)
0809 15:31:20.291510 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:20.291589 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.1:45059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":64,"threads_started":1}
W20260809 15:31:20.291879 19820 catalog_manager.cc:4584] TS a43f25bfb93f424fbea3dc4ae5276ea6 (127.11.146.1:45059): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a65c9c44a48c4b998d4726e3a480cb4e: Network error: Client connection negotiation failed: client connection to 127.11.146.1:45059: connect: Connection refused (error 111)
I20260809 15:31:20.298477 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 20212
I20260809 15:31:20.309836 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 19797
2026-08-09T15:31:20Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3914 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:31:20 dist-test-slave-1jjb krb5kdc[20505](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:31:20 dist-test-slave-1jjb krb5kdc[20505](info): set up 2 sockets
Aug 09 15:31:20 dist-test-slave-1jjb krb5kdc[20505](info): commencing operation
krb5kdc: starting...
W20260809 15:31:21.440002 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.102s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:31:21 dist-test-slave-1jjb krb5kdc[20505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289481, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:31:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:31:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.146.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
I20260809 15:31:21.579464 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:45091
--webserver_interface=127.11.146.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:37667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:45091
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:31:21.698331 20519 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:21.698629 20519 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:21.698701 20519 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:21.703118 20519 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:31:21.703217 20519 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:21.703258 20519 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:21.703313 20519 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:31:21.703351 20519 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:31:21.708799 20519 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:37667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:45091
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:45091
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20519
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:21.709903 20519 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:21.710950 20519 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:21.719969 20524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:21.719988 20525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:21.720116 20519 server_base.cc:1034] running on GCE node
W20260809 15:31:21.720134 20527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:21.720742 20519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:21.721834 20519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:21.722996 20519 hybrid_clock.cc:648] HybridClock initialized: now 1786289481722947 us; error 61 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-09T15:31:21Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1412 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:31:21 dist-test-slave-1jjb krb5kdc[20532](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:31:21 dist-test-slave-1jjb krb5kdc[20532](info): set up 2 sockets
Aug 09 15:31:21 dist-test-slave-1jjb krb5kdc[20532](info): commencing operation
krb5kdc: starting...
W20260809 15:31:22.833251 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.082s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:31:22 dist-test-slave-1jjb krb5kdc[20532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289482, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:31:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:31:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.146.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
I20260809 15:31:22.967856 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:39563
--webserver_interface=127.11.146.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:40603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:39563
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:31:23.080193 20545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:23.080463 20545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:23.080535 20545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:23.084398 20545 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:31:23.084476 20545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:23.084515 20545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:23.084579 20545 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:31:23.084620 20545 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:31:23.089596 20545 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:40603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:39563
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:39563
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20545
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:23.090531 20545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:23.091455 20545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:23.099738 20554 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:23.099750 20556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:23.099748 20553 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:23.100091 20545 server_base.cc:1034] running on GCE node
I20260809 15:31:23.100670 20545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:23.101688 20545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:23.102855 20545 hybrid_clock.cc:648] HybridClock initialized: now 1786289483102842 us; error 24 us; skew 500 ppm
Aug 09 15:31:23 dist-test-slave-1jjb krb5kdc[20532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289483, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:23.105643 20545 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:31:23.106519 20545 webserver.cc:460] Webserver started at http://127.11.146.62:37875/ using document root <none> and password file <none>
I20260809 15:31:23.107072 20545 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:23.107136 20545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:23.107349 20545 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:23.109908 20545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "426481bce3714d8187a5fa081c50ebde"
format_stamp: "Formatted at 2026-08-09 15:31:23 on dist-test-slave-1jjb"
server_key: "ebbcd325bb7d0bc9b4ebd37ce2ef7687"
server_key_iv: "66878fdd83f5930ebe98382a1460fab3"
server_key_version: "encryptionkey@0"
I20260809 15:31:23.110486 20545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "426481bce3714d8187a5fa081c50ebde"
format_stamp: "Formatted at 2026-08-09 15:31:23 on dist-test-slave-1jjb"
server_key: "ebbcd325bb7d0bc9b4ebd37ce2ef7687"
server_key_iv: "66878fdd83f5930ebe98382a1460fab3"
server_key_version: "encryptionkey@0"
I20260809 15:31:23.114195 20545 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 15:31:23.116781 20563 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:23.118104 20545 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:31:23.118247 20545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "426481bce3714d8187a5fa081c50ebde"
format_stamp: "Formatted at 2026-08-09 15:31:23 on dist-test-slave-1jjb"
server_key: "ebbcd325bb7d0bc9b4ebd37ce2ef7687"
server_key_iv: "66878fdd83f5930ebe98382a1460fab3"
server_key_version: "encryptionkey@0"
I20260809 15:31:23.118366 20545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:23.139389 20545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:23.142405 20545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:23.142606 20545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:23.149883 20545 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:39563
I20260809 15:31:23.149909 20621 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:39563 every 8 connection(s)
I20260809 15:31:23.150831 20545 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:31:23.153605 20622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:23.154881 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 20545
I20260809 15:31:23.155019 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:31:23.155319 11848 external_mini_cluster.cc:1428] Setting key c196f90f915721e39ec1f956c8c55cad
I20260809 15:31:23.159739 20622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde: Bootstrap starting.
I20260809 15:31:23.161994 20622 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:23.162876 20622 log.cc:824] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde: Log is configured to *not* fsync() on all Append() calls
Aug 09 15:31:23 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289482, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:31:23.164987 20622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde: No bootstrap required, opened a new log
I20260809 15:31:23.168905 20622 raft_consensus.cc:348] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "426481bce3714d8187a5fa081c50ebde" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 39563 } }
I20260809 15:31:23.169162 20622 raft_consensus.cc:374] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:23.169234 20622 raft_consensus.cc:729] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 426481bce3714d8187a5fa081c50ebde, State: Initialized, Role: FOLLOWER
I20260809 15:31:23.169570 20625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:23.156888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57690 (local address 127.11.146.62:39563)
0809 15:31:23.157344 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:23.157359 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:23.157395 (+ 36us) server_negotiation.cc:407] Connection header received
0809 15:31:23.158012 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:23.158028 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:23.158339 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:23.158674 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:23.159471 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:23.160590 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:23.161451 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:23.161918 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:23.162095 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:23.164736 (+ 2641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:23.164741 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:23.164755 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:23.164781 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:23.166459 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:23.166907 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:23.166913 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:23.166917 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:23.167033 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:23.167319 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:23.167322 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:23.167324 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:23.167718 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:23.167944 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:23.168331 (+ 387us) server_negotiation.cc:299] Negotiation successful
0809 15:31:23.168652 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":132,"threads_started":1}
I20260809 15:31:23.169726 20622 consensus_queue.cc:260] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "426481bce3714d8187a5fa081c50ebde" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 39563 } }
I20260809 15:31:23.169876 20622 raft_consensus.cc:388] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:31:23.169932 20622 raft_consensus.cc:482] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:31:23.169996 20622 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:23.170914 20622 raft_consensus.cc:504] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "426481bce3714d8187a5fa081c50ebde" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 39563 } }
I20260809 15:31:23.171248 20622 leader_election.cc:302] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 426481bce3714d8187a5fa081c50ebde; no voters:
I20260809 15:31:23.171594 20622 leader_election.cc:288] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:31:23.171667 20627 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:31:23.171875 20627 raft_consensus.cc:686] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [term 1 LEADER]: Becoming Leader. State: Replica: 426481bce3714d8187a5fa081c50ebde, State: Running, Role: LEADER
I20260809 15:31:23.172197 20627 consensus_queue.cc:237] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "426481bce3714d8187a5fa081c50ebde" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 39563 } }
I20260809 15:31:23.172924 20622 sys_catalog.cc:564] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:31:23.173970 20630 sys_catalog.cc:455] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "426481bce3714d8187a5fa081c50ebde" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "426481bce3714d8187a5fa081c50ebde" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 39563 } } }
I20260809 15:31:23.174100 20630 sys_catalog.cc:458] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:23.174455 20628 sys_catalog.cc:455] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [sys.catalog]: SysCatalogTable state changed. Reason: New leader 426481bce3714d8187a5fa081c50ebde. Latest consensus state: current_term: 1 leader_uuid: "426481bce3714d8187a5fa081c50ebde" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "426481bce3714d8187a5fa081c50ebde" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 39563 } } }
I20260809 15:31:23.174569 20637 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:31:23.175182 20628 sys_catalog.cc:458] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:23.178081 20637 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:31:23.183251 20637 catalog_manager.cc:1347] Generated new cluster ID: 20127ed6b4904a26bdfe3868dbf9112a
I20260809 15:31:23.183320 20637 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:31:23.190547 20637 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:31:23.191854 20637 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:31:23.196944 20637 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde: Generated new TSK 0
I20260809 15:31:23.197676 20637 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.146.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
I20260809 15:31:23.232046 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.1:0
--local_ip_for_outbound_sockets=127.11.146.1
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:39563
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:40603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:31:23.350016 20649 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:23.350302 20649 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:23.350396 20649 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:23.354650 20649 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:23.354746 20649 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:23.354839 20649 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.1
I20260809 15:31:23.360054 20649 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:40603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:39563
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20649
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.1
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:23.361541 20649 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:23.362685 20649 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:23.372566 20654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:23.372633 20657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:23.372579 20655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:23.372898 20649 server_base.cc:1034] running on GCE node
I20260809 15:31:23.373349 20649 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:23.374048 20649 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:23.375239 20649 hybrid_clock.cc:648] HybridClock initialized: now 1786289483375216 us; error 33 us; skew 500 ppm
Aug 09 15:31:23 dist-test-slave-1jjb krb5kdc[20532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289483, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:23.378307 20649 init.cc:377] Logged in from keytab as kudu/127.11.146.1@KRBTEST.COM (short username kudu)
I20260809 15:31:23.379221 20649 webserver.cc:460] Webserver started at http://127.11.146.1:38475/ using document root <none> and password file <none>
I20260809 15:31:23.379813 20649 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:23.379908 20649 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:23.380215 20649 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:23.382323 20649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-0/data/instance:
uuid: "0a5bdc3525414f14aa4986ba9f804193"
format_stamp: "Formatted at 2026-08-09 15:31:23 on dist-test-slave-1jjb"
server_key: "a7326979973ddb18a3fc9bba479a14cf"
server_key_iv: "f8d54802fe77ccf30c44b6b0f4712348"
server_key_version: "encryptionkey@0"
I20260809 15:31:23.382917 20649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance:
uuid: "0a5bdc3525414f14aa4986ba9f804193"
format_stamp: "Formatted at 2026-08-09 15:31:23 on dist-test-slave-1jjb"
server_key: "a7326979973ddb18a3fc9bba479a14cf"
server_key_iv: "f8d54802fe77ccf30c44b6b0f4712348"
server_key_version: "encryptionkey@0"
I20260809 15:31:23.386844 20649 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 15:31:23.389752 20665 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:23.391049 20649 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 15:31:23.391209 20649 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-0/wal
uuid: "0a5bdc3525414f14aa4986ba9f804193"
format_stamp: "Formatted at 2026-08-09 15:31:23 on dist-test-slave-1jjb"
server_key: "a7326979973ddb18a3fc9bba479a14cf"
server_key_iv: "f8d54802fe77ccf30c44b6b0f4712348"
server_key_version: "encryptionkey@0"
I20260809 15:31:23.391333 20649 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:23.406627 20649 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:23.410365 20649 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:23.410642 20649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:23.411280 20649 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:31:23.412401 20649 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:23.412489 20649 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:23.412568 20649 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:23.412624 20649 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:23.422263 20649 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.1:33973
I20260809 15:31:23.422307 20787 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.1:33973 every 8 connection(s)
I20260809 15:31:23.423359 20649 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
I20260809 15:31:23.430382 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 20649
I20260809 15:31:23.430542 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance
I20260809 15:31:23.430847 11848 external_mini_cluster.cc:1428] Setting key 8d184353bd17f13289d6b1906db03ee5
Aug 09 15:31:23 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289483, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:31:23.439010 20625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:23.425349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:57175 (local address 127.11.146.62:39563)
0809 15:31:23.425497 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:23.425503 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:23.426743 (+ 1240us) server_negotiation.cc:407] Connection header received
0809 15:31:23.427712 (+ 969us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:23.427715 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:23.427763 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:23.427851 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:23.429182 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:23.429775 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:23.431206 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:23.431730 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:23.431859 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:23.434563 (+ 2704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:23.434566 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:23.434571 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:23.434606 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:23.436408 (+ 1802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:23.437114 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:23.437117 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:23.437119 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:23.437208 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:23.437652 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:23.437655 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:23.437656 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:23.437866 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:23.437957 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:23.438747 (+ 790us) server_negotiation.cc:299] Negotiation successful
0809 15:31:23.438883 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 15:31:23.440609 20790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:23.425819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.1:57175)
0809 15:31:23.426575 (+ 756us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:23.426619 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:23.427423 (+ 804us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:23.428041 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:23.428047 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:23.428482 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:23.428984 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:23.428998 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:23.429941 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:23.429944 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:23.431078 (+ 1134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:23.431088 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:23.431925 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:23.431930 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:23.432194 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:23.432852 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:23.432869 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:23.434382 (+ 1513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:23.436546 (+ 2164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:23.436555 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:23.436576 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:23.436979 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:23.437314 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:23.437320 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:23.437325 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:23.437524 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:23.438000 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:23.438009 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:23.438421 (+ 412us) client_negotiation.cc:769] Sending connection context
0809 15:31:23.438690 (+ 269us) client_negotiation.cc:240] Negotiation successful
0809 15:31:23.439115 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":114,"threads_started":1}
I20260809 15:31:23.442126 20788 heartbeater.cc:347] Connected to a master server at 127.11.146.62:39563
I20260809 15:31:23.442415 20788 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:23.442960 20788 heartbeater.cc:511] Master 127.11.146.62:39563 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.146.2@KRBTEST.COM; defaulting to no policy
I20260809 15:31:23.444690 20582 ts_manager.cc:194] Registered new tserver with Master: 0a5bdc3525414f14aa4986ba9f804193 (127.11.146.1:33973)
I20260809 15:31:23.445847 20582 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.1@KRBTEST.COM'} at 127.11.146.1:57175
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
I20260809 15:31:23.464810 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.2:0
--local_ip_for_outbound_sockets=127.11.146.2
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:39563
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:40603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:31:23.588121 20793 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:23.588443 20793 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:23.588488 20793 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:23.592880 20793 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:23.592952 20793 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:23.593056 20793 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.2
I20260809 15:31:23.598896 20793 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:40603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:39563
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20793
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.2
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:23.600063 20793 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:23.601173 20793 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:23.611636 20801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:23.611721 20798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:23.611867 20799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:23.611868 20793 server_base.cc:1034] running on GCE node
I20260809 15:31:23.612453 20793 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:23.613157 20793 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:23.614367 20793 hybrid_clock.cc:648] HybridClock initialized: now 1786289483614343 us; error 30 us; skew 500 ppm
Aug 09 15:31:23 dist-test-slave-1jjb krb5kdc[20532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289483, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:23.622493 20793 init.cc:377] Logged in from keytab as kudu/127.11.146.2@KRBTEST.COM (short username kudu)
I20260809 15:31:23.623685 20793 webserver.cc:460] Webserver started at http://127.11.146.2:37735/ using document root <none> and password file <none>
I20260809 15:31:23.624402 20793 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:23.624477 20793 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:23.624842 20793 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:23.627105 20793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-1/data/instance:
uuid: "e3e7de415b034ddb9f1fce1150ca697b"
format_stamp: "Formatted at 2026-08-09 15:31:23 on dist-test-slave-1jjb"
server_key: "c13aa878528909578e0670aba4ce938c"
server_key_iv: "12dd6fcedee9c3299d38d339d254a27b"
server_key_version: "encryptionkey@0"
I20260809 15:31:23.627995 20793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance:
uuid: "e3e7de415b034ddb9f1fce1150ca697b"
format_stamp: "Formatted at 2026-08-09 15:31:23 on dist-test-slave-1jjb"
server_key: "c13aa878528909578e0670aba4ce938c"
server_key_iv: "12dd6fcedee9c3299d38d339d254a27b"
server_key_version: "encryptionkey@0"
I20260809 15:31:23.632531 20793 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 15:31:23.635349 20810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:23.637034 20793 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:31:23.637171 20793 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-1/wal
uuid: "e3e7de415b034ddb9f1fce1150ca697b"
format_stamp: "Formatted at 2026-08-09 15:31:23 on dist-test-slave-1jjb"
server_key: "c13aa878528909578e0670aba4ce938c"
server_key_iv: "12dd6fcedee9c3299d38d339d254a27b"
server_key_version: "encryptionkey@0"
I20260809 15:31:23.637293 20793 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:23.665920 20793 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:23.669746 20793 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:23.669981 20793 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:23.670657 20793 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:31:23.671547 20793 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:23.671607 20793 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:23.671651 20793 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:23.671666 20793 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:23.683182 20793 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.2:43285
I20260809 15:31:23.683205 20929 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.2:43285 every 8 connection(s)
I20260809 15:31:23.684384 20793 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
I20260809 15:31:23.694382 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 20793
I20260809 15:31:23.694545 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance
Aug 09 15:31:23 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289483, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:31:23.694913 11848 external_mini_cluster.cc:1428] Setting key eb10825278a3237da42c5a818ee4b9a6
I20260809 15:31:23.700726 20625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:23.686503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:40391 (local address 127.11.146.62:39563)
0809 15:31:23.686675 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:23.686680 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:23.687934 (+ 1254us) server_negotiation.cc:407] Connection header received
0809 15:31:23.688832 (+ 898us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:23.688835 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:23.688886 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:23.688979 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:23.690238 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:23.690780 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:23.692338 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:23.692595 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:23.692696 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:23.695681 (+ 2985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:23.695685 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:23.695688 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:23.695721 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:23.698058 (+ 2337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:23.698651 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:23.698658 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:23.698664 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:23.698769 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:23.699177 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:23.699184 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:23.699189 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:23.699500 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:23.699597 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:23.700494 (+ 897us) server_negotiation.cc:299] Negotiation successful
0809 15:31:23.700607 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 15:31:23.701997 20932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:23.686970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.2:40391)
0809 15:31:23.687698 (+ 728us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:23.687740 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:23.688591 (+ 851us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:23.689184 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:23.689191 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:23.689566 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:23.690070 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:23.690086 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:23.690949 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:23.690952 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:23.692052 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:23.692062 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:23.692741 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:23.692744 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:23.692893 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:23.693522 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:23.693539 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:23.695348 (+ 1809us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:23.698198 (+ 2850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:23.698203 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:23.698216 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:23.698542 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:23.698902 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:23.698905 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:23.698906 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:23.699067 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:23.699753 (+ 686us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:23.699761 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:23.700180 (+ 419us) client_negotiation.cc:769] Sending connection context
0809 15:31:23.700425 (+ 245us) client_negotiation.cc:240] Negotiation successful
0809 15:31:23.700844 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":118,"threads_started":1}
I20260809 15:31:23.703274 20930 heartbeater.cc:347] Connected to a master server at 127.11.146.62:39563
I20260809 15:31:23.703538 20930 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:23.704161 20930 heartbeater.cc:511] Master 127.11.146.62:39563 requested a full tablet report, sending...
I20260809 15:31:23.705300 20582 ts_manager.cc:194] Registered new tserver with Master: e3e7de415b034ddb9f1fce1150ca697b (127.11.146.2:43285)
I20260809 15:31:23.705890 20582 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.2@KRBTEST.COM'} at 127.11.146.2:40391
WARNING: no policy specified for kudu/127.11.146.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
I20260809 15:31:23.728586 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.3:0
--local_ip_for_outbound_sockets=127.11.146.3
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:39563
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:40603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:31:23.847105 20935 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:23.847434 20935 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:23.847515 20935 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:23.851758 20935 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:23.851854 20935 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:23.851948 20935 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.3
I20260809 15:31:23.857309 20935 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:40603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:39563
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20935
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.3
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:23.858425 20935 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:23.859483 20935 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:23.868919 20944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:23.868934 20942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:23.868983 20935 server_base.cc:1034] running on GCE node
W20260809 15:31:23.868930 20941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:23.869613 20935 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:23.870190 20935 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:23.871347 20935 hybrid_clock.cc:648] HybridClock initialized: now 1786289483871316 us; error 41 us; skew 500 ppm
Aug 09 15:31:23 dist-test-slave-1jjb krb5kdc[20532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289483, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:23.874496 20935 init.cc:377] Logged in from keytab as kudu/127.11.146.3@KRBTEST.COM (short username kudu)
I20260809 15:31:23.875357 20935 webserver.cc:460] Webserver started at http://127.11.146.3:43475/ using document root <none> and password file <none>
I20260809 15:31:23.875903 20935 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:23.875965 20935 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:23.876199 20935 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:23.878183 20935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-2/data/instance:
uuid: "11a06f8cb12546d19b8142015e097628"
format_stamp: "Formatted at 2026-08-09 15:31:23 on dist-test-slave-1jjb"
server_key: "45b53fcba187c6e2a4220eb5a4b11a48"
server_key_iv: "35312f3b6c00f14a84e6c29b3c4ded43"
server_key_version: "encryptionkey@0"
I20260809 15:31:23.878723 20935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance:
uuid: "11a06f8cb12546d19b8142015e097628"
format_stamp: "Formatted at 2026-08-09 15:31:23 on dist-test-slave-1jjb"
server_key: "45b53fcba187c6e2a4220eb5a4b11a48"
server_key_iv: "35312f3b6c00f14a84e6c29b3c4ded43"
server_key_version: "encryptionkey@0"
I20260809 15:31:23.882534 20935 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 15:31:23.885108 20952 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:23.886384 20935 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 15:31:23.886536 20935 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-2/wal
uuid: "11a06f8cb12546d19b8142015e097628"
format_stamp: "Formatted at 2026-08-09 15:31:23 on dist-test-slave-1jjb"
server_key: "45b53fcba187c6e2a4220eb5a4b11a48"
server_key_iv: "35312f3b6c00f14a84e6c29b3c4ded43"
server_key_version: "encryptionkey@0"
I20260809 15:31:23.886649 20935 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:23.914016 20935 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:23.917570 20935 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:23.917802 20935 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:23.918437 20935 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:31:23.919304 20935 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:23.919394 20935 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:23.919495 20935 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:23.919548 20935 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:23.929422 20935 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.3:33891
I20260809 15:31:23.929462 21070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.3:33891 every 8 connection(s)
I20260809 15:31:23.930320 20935 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
I20260809 15:31:23.936592 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 20935
I20260809 15:31:23.936746 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance
I20260809 15:31:23.937037 11848 external_mini_cluster.cc:1428] Setting key 6f9f15e18badecc88e08249f8e9b3062
Aug 09 15:31:23 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289483, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:31:23.944576 20625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:23.932222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:39455 (local address 127.11.146.62:39563)
0809 15:31:23.932391 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:23.932396 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:23.933533 (+ 1137us) server_negotiation.cc:407] Connection header received
0809 15:31:23.934356 (+ 823us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:23.934359 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:23.934410 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:23.934487 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:23.935679 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:23.936302 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:23.937692 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:23.938010 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:23.938122 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:23.940940 (+ 2818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:23.940943 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:23.940946 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:23.940973 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:23.942439 (+ 1466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:23.942959 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:23.942962 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:23.942964 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:23.943048 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:23.943394 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:23.943398 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:23.943400 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:23.943600 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:23.943717 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:23.944267 (+ 550us) server_negotiation.cc:299] Negotiation successful
0809 15:31:23.944391 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 15:31:23.945369 21073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:23.932656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.3:39455)
0809 15:31:23.933389 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:23.933431 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:23.934171 (+ 740us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:23.934617 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:23.934624 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:23.934957 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:23.935517 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:23.935533 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:23.936478 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:23.936481 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:23.937551 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:23.937562 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:23.938185 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:23.938190 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:23.938381 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:23.939110 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:23.939127 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:23.940749 (+ 1622us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:23.942569 (+ 1820us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:23.942576 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:23.942590 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:23.942851 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:23.943145 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:23.943148 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:23.943151 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:23.943295 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:23.943717 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:23.943724 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:23.943980 (+ 256us) client_negotiation.cc:769] Sending connection context
0809 15:31:23.944223 (+ 243us) client_negotiation.cc:240] Negotiation successful
0809 15:31:23.944553 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":101,"threads_started":1}
I20260809 15:31:23.946507 21071 heartbeater.cc:347] Connected to a master server at 127.11.146.62:39563
I20260809 15:31:23.946722 21071 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:23.947185 21071 heartbeater.cc:511] Master 127.11.146.62:39563 requested a full tablet report, sending...
I20260809 15:31:23.948243 20582 ts_manager.cc:194] Registered new tserver with Master: 11a06f8cb12546d19b8142015e097628 (127.11.146.3:33891)
I20260809 15:31:23.948781 20582 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.3@KRBTEST.COM'} at 127.11.146.3:39455
I20260809 15:31:23.951114 11848 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.11.146.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.146.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.146.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.1.keytab.
Entry for principal oryx/127.11.146.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.1.keytab.
WARNING: no policy specified for oryx/127.11.146.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.146.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.146.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.2.keytab.
Entry for principal oryx/127.11.146.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.2.keytab.
WARNING: no policy specified for oryx/127.11.146.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.146.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.146.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.3.keytab.
Entry for principal oryx/127.11.146.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.3.keytab.
I20260809 15:31:24.035177 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 20649
I20260809 15:31:24.045755 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 20793
I20260809 15:31:24.052894 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 20935
I20260809 15:31:24.060261 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 20545
I20260809 15:31:24.068131 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:39563
--webserver_interface=127.11.146.62
--webserver_port=37875
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:40603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:39563
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:31:24.186909 21080 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:24.187232 21080 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:24.187315 21080 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:24.191989 21080 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:31:24.192071 21080 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:24.192126 21080 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:24.192168 21080 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:31:24.192203 21080 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:31:24.198040 21080 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:40603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:39563
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:39563
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=37875
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21080
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:24.199231 21080 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:24.200556 21080 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:24.209199 21085 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:24.209230 21088 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:24.209235 21086 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:24.209594 21080 server_base.cc:1034] running on GCE node
I20260809 15:31:24.210186 21080 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:24.211258 21080 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:24.212438 21080 hybrid_clock.cc:648] HybridClock initialized: now 1786289484212416 us; error 34 us; skew 500 ppm
Aug 09 15:31:24 dist-test-slave-1jjb krb5kdc[20532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289484, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:24.215206 21080 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:31:24.216025 21080 webserver.cc:460] Webserver started at http://127.11.146.62:37875/ using document root <none> and password file <none>
I20260809 15:31:24.216629 21080 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:24.216704 21080 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:24.220772 21080 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 15:31:24.222892 21096 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:24.224298 21080 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:31:24.224452 21080 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "426481bce3714d8187a5fa081c50ebde"
format_stamp: "Formatted at 2026-08-09 15:31:23 on dist-test-slave-1jjb"
server_key: "ebbcd325bb7d0bc9b4ebd37ce2ef7687"
server_key_iv: "66878fdd83f5930ebe98382a1460fab3"
server_key_version: "encryptionkey@0"
I20260809 15:31:24.225000 21080 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:24.258003 21080 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:24.261557 21080 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:24.261794 21080 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:24.269688 21080 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:39563
I20260809 15:31:24.269706 21150 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:39563 every 8 connection(s)
I20260809 15:31:24.270812 21080 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:31:24.275389 21151 sys_catalog.cc:263] Verifying existing consensus state
I20260809 15:31:24.275610 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 21080
I20260809 15:31:24.276150 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.1:33973
--local_ip_for_outbound_sockets=127.11.146.1
--tserver_master_addrs=127.11.146.62:39563
--webserver_port=38475
--webserver_interface=127.11.146.1
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:40603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.146.1
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.1.keytab with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:31:24.277264 21151 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde: Bootstrap starting.
I20260809 15:31:24.294512 21151 log.cc:824] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde: Log is configured to *not* fsync() on all Append() calls
I20260809 15:31:24.301489 21151 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 15:31:24.301872 21151 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde: Bootstrap complete.
I20260809 15:31:24.306438 21151 raft_consensus.cc:348] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "426481bce3714d8187a5fa081c50ebde" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 39563 } }
I20260809 15:31:24.306892 21151 raft_consensus.cc:729] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 426481bce3714d8187a5fa081c50ebde, State: Initialized, Role: FOLLOWER
I20260809 15:31:24.307436 21151 consensus_queue.cc:260] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "426481bce3714d8187a5fa081c50ebde" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 39563 } }
I20260809 15:31:24.307608 21151 raft_consensus.cc:388] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:31:24.307695 21151 raft_consensus.cc:482] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:31:24.307809 21151 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [term 1 FOLLOWER]: Advancing to term 2
I20260809 15:31:24.309844 21151 raft_consensus.cc:504] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "426481bce3714d8187a5fa081c50ebde" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 39563 } }
I20260809 15:31:24.310192 21151 leader_election.cc:302] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 426481bce3714d8187a5fa081c50ebde; no voters:
I20260809 15:31:24.310515 21151 leader_election.cc:288] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 15:31:24.310678 21156 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [term 2 FOLLOWER]: Leader election won for term 2
I20260809 15:31:24.310920 21156 raft_consensus.cc:686] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [term 2 LEADER]: Becoming Leader. State: Replica: 426481bce3714d8187a5fa081c50ebde, State: Running, Role: LEADER
I20260809 15:31:24.311312 21156 consensus_queue.cc:237] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "426481bce3714d8187a5fa081c50ebde" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 39563 } }
I20260809 15:31:24.311877 21151 sys_catalog.cc:564] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:31:24.312814 21157 sys_catalog.cc:455] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "426481bce3714d8187a5fa081c50ebde" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "426481bce3714d8187a5fa081c50ebde" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 39563 } } }
I20260809 15:31:24.312940 21157 sys_catalog.cc:458] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:24.313658 21165 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:31:24.313895 21158 sys_catalog.cc:455] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [sys.catalog]: SysCatalogTable state changed. Reason: New leader 426481bce3714d8187a5fa081c50ebde. Latest consensus state: current_term: 2 leader_uuid: "426481bce3714d8187a5fa081c50ebde" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "426481bce3714d8187a5fa081c50ebde" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 39563 } } }
I20260809 15:31:24.314077 21158 sys_catalog.cc:458] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:24.317121 21165 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:31:24.317771 21165 catalog_manager.cc:1259] Loaded cluster ID: 20127ed6b4904a26bdfe3868dbf9112a
I20260809 15:31:24.317833 21165 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:31:24.320245 21165 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:31:24.320909 21165 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 426481bce3714d8187a5fa081c50ebde: Loaded TSK: 0
I20260809 15:31:24.322213 21165 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 15:31:24.397908 21153 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:24.398217 21153 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:24.398307 21153 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:24.402498 21153 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:24.402594 21153 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:24.402693 21153 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.1
I20260809 15:31:24.408155 21153 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:40603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.1.keytab
--principal=oryx/127.11.146.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.1:33973
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.146.1
--webserver_port=38475
--tserver_master_addrs=127.11.146.62:39563
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21153
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.1
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:24.409263 21153 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:24.410331 21153 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:24.421521 21179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:24.421643 21153 server_base.cc:1034] running on GCE node
W20260809 15:31:24.421526 21182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:24.421552 21178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:24.422272 21153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:24.423034 21153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:24.424180 21153 hybrid_clock.cc:648] HybridClock initialized: now 1786289484424154 us; error 36 us; skew 500 ppm
Aug 09 15:31:24 dist-test-slave-1jjb krb5kdc[20532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289484, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:24.426997 21153 init.cc:377] Logged in from keytab as oryx/127.11.146.1@KRBTEST.COM (short username oryx)
I20260809 15:31:24.428157 21153 webserver.cc:460] Webserver started at http://127.11.146.1:38475/ using document root <none> and password file <none>
I20260809 15:31:24.428846 21153 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:24.428927 21153 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:24.433151 21153 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:31:24.435621 21189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:24.436987 21153 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:31:24.437134 21153 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-0/wal
uuid: "0a5bdc3525414f14aa4986ba9f804193"
format_stamp: "Formatted at 2026-08-09 15:31:23 on dist-test-slave-1jjb"
server_key: "a7326979973ddb18a3fc9bba479a14cf"
server_key_iv: "f8d54802fe77ccf30c44b6b0f4712348"
server_key_version: "encryptionkey@0"
I20260809 15:31:24.437685 21153 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:24.447578 21153 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:24.450730 21153 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:24.450945 21153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:24.451534 21153 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:31:24.452482 21153 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:24.452553 21153 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:24.452627 21153 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:24.452678 21153 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:24.464113 21153 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.1:33973
I20260809 15:31:24.464910 21308 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.1:33973 every 8 connection(s)
I20260809 15:31:24.465569 21153 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
I20260809 15:31:24.474607 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 21153
I20260809 15:31:24.475085 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.2:43285
--local_ip_for_outbound_sockets=127.11.146.2
--tserver_master_addrs=127.11.146.62:39563
--webserver_port=37735
--webserver_interface=127.11.146.2
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:40603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.146.2
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.2.keytab with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 15:31:24 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:24 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:24.480329 21311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:24.468422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.1:50687)
0809 15:31:24.469200 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:24.469256 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:24.470436 (+ 1180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:24.471567 (+ 1131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:24.471662 (+ 95us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:24.472194 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:24.472667 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:24.472681 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.473982 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.473986 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:24.474968 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:24.474978 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.475861 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.475865 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:24.476050 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:24.476750 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:24.476768 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:24.479297 (+ 2529us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":138,"threads_started":1}
W20260809 15:31:24.480322 21312 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:24.468583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:50687 (local address 127.11.146.62:39563)
0809 15:31:24.469145 (+ 562us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:24.469165 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:24.469385 (+ 220us) server_negotiation.cc:407] Connection header received
0809 15:31:24.470855 (+ 1470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:24.470866 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:24.471156 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:24.471480 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:24.472840 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.473836 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.475093 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.475690 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.475874 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:24.479532 (+ 3658us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.1:50687: BlockingRecv error: recv got EOF from 127.11.146.1:50687 (error 108)
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":102,"threads_started":1}
W20260809 15:31:24.481000 21309 heartbeater.cc:644] Failed to heartbeat to 127.11.146.62:39563 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.146.62:39563: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Aug 09 15:31:24 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:24 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:24.486960 21311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:24.481593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.1:43685)
0809 15:31:24.481706 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:24.481724 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:24.481809 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:24.482088 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:24.482091 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:24.482247 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:24.482335 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:24.482340 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.483078 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.483083 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:24.483619 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:24.483627 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.484126 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.484130 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:24.484231 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:24.484834 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:24.484845 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:24.486801 (+ 1956us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":34}
W20260809 15:31:24.487031 21312 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:24.481664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:43685 (local address 127.11.146.62:39563)
0809 15:31:24.481781 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:24.481785 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:24.481798 (+ 13us) server_negotiation.cc:407] Connection header received
0809 15:31:24.481921 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:24.481924 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:24.481985 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:24.482071 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:24.482447 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.482967 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.483750 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.483991 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.484124 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:24.486922 (+ 2798us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.1:43685: BlockingRecv error: recv got EOF from 127.11.146.1:43685 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 09 15:31:24 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:24 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:24.493279 21311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:24.487775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.1:34627)
0809 15:31:24.487934 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:24.487947 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:24.488024 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:24.488290 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:24.488293 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:24.488453 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:24.488543 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:24.488549 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.489231 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.489234 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:24.490165 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:24.490175 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.490670 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.490674 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:24.490758 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:24.491210 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:24.491225 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:24.493152 (+ 1927us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":96}
W20260809 15:31:24.493489 21309 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 15:31:24.493641 21312 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:24.487869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:34627 (local address 127.11.146.62:39563)
0809 15:31:24.487988 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:24.487991 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:24.488003 (+ 12us) server_negotiation.cc:407] Connection header received
0809 15:31:24.488145 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:24.488147 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:24.488185 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:24.488251 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:24.488649 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.489132 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.490322 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.490563 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.490644 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:24.493274 (+ 2630us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.1:34627: BlockingRecv error: recv got EOF from 127.11.146.1:34627 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260809 15:31:24.594983 21313 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:24.595263 21313 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:24.595309 21313 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:24.599536 21313 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:24.599608 21313 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:24.599701 21313 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.2
I20260809 15:31:24.605259 21313 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:40603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.2.keytab
--principal=oryx/127.11.146.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.2:43285
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.146.2
--webserver_port=37735
--tserver_master_addrs=127.11.146.62:39563
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21313
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.2
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:24.606822 21313 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:24.607981 21313 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:24.618934 21322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:24.618934 21324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:24.618957 21321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:24.619223 21313 server_base.cc:1034] running on GCE node
I20260809 15:31:24.619740 21313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:24.620498 21313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:24.621665 21313 hybrid_clock.cc:648] HybridClock initialized: now 1786289484621650 us; error 30 us; skew 500 ppm
Aug 09 15:31:24 dist-test-slave-1jjb krb5kdc[20532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289484, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:24.624763 21313 init.cc:377] Logged in from keytab as oryx/127.11.146.2@KRBTEST.COM (short username oryx)
I20260809 15:31:24.625658 21313 webserver.cc:460] Webserver started at http://127.11.146.2:37735/ using document root <none> and password file <none>
I20260809 15:31:24.626242 21313 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:24.626349 21313 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:24.630666 21313 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260809 15:31:24.633332 21332 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:24.634800 21313 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:31:24.634940 21313 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-1/wal
uuid: "e3e7de415b034ddb9f1fce1150ca697b"
format_stamp: "Formatted at 2026-08-09 15:31:23 on dist-test-slave-1jjb"
server_key: "c13aa878528909578e0670aba4ce938c"
server_key_iv: "12dd6fcedee9c3299d38d339d254a27b"
server_key_version: "encryptionkey@0"
I20260809 15:31:24.635524 21313 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:24.651286 21313 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:24.655136 21313 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:24.655395 21313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:24.656309 21313 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:31:24.657284 21313 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:24.657362 21313 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:24.657445 21313 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:24.657495 21313 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:24.668051 21313 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.2:43285
I20260809 15:31:24.668143 21453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.2:43285 every 8 connection(s)
I20260809 15:31:24.669312 21313 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
I20260809 15:31:24.673828 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 21313
I20260809 15:31:24.674405 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.3:33891
--local_ip_for_outbound_sockets=127.11.146.3
--tserver_master_addrs=127.11.146.62:39563
--webserver_port=43475
--webserver_interface=127.11.146.3
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:40603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.146.3
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.3.keytab with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 15:31:24 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:24 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
W20260809 15:31:24.683139 21312 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:24.671356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:49701 (local address 127.11.146.62:39563)
0809 15:31:24.671507 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:24.671511 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:24.672991 (+ 1480us) server_negotiation.cc:407] Connection header received
0809 15:31:24.674159 (+ 1168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:24.674162 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:24.674221 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:24.674302 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:24.676001 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.676614 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.678396 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.678620 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.678705 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:24.683026 (+ 4321us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.2:49701: BlockingRecv error: recv got EOF from 127.11.146.2:49701 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 15:31:24.684300 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:24.671892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.2:49701)
0809 15:31:24.672822 (+ 930us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:24.672862 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:24.673854 (+ 992us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:24.674535 (+ 681us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:24.674548 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:24.675077 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:24.675818 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:24.675841 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.676752 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.676758 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:24.678258 (+ 1500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:24.678273 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.678788 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.678795 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:24.679046 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:24.679748 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:24.679774 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:24.682803 (+ 3029us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":735,"thread_start_us":310,"threads_started":1}
W20260809 15:31:24.684849 21455 heartbeater.cc:644] Failed to heartbeat to 127.11.146.62:39563 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.146.62:39563: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Aug 09 15:31:24 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:24 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:24.692457 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:24.685318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.2:35791)
0809 15:31:24.685557 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:24.685571 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:24.685644 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:24.685937 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:24.685940 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:24.686105 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:24.686226 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:24.686232 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.687420 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.687426 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:24.688720 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:24.688731 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.689366 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.689377 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:24.689473 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:24.690067 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:24.690082 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:24.692316 (+ 2234us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136}
W20260809 15:31:24.692852 21312 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:24.685446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:35791 (local address 127.11.146.62:39563)
0809 15:31:24.685618 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:24.685624 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:24.685647 (+ 23us) server_negotiation.cc:407] Connection header received
0809 15:31:24.685726 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:24.685729 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:24.685791 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:24.685906 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:24.686349 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.687241 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.688859 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.689227 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.689339 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:24.692494 (+ 3155us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.2:35791: BlockingRecv error: recv got EOF from 127.11.146.2:35791 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 09 15:31:24 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:24 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:24.699189 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:24.693067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.2:41843)
0809 15:31:24.693199 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:24.693214 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:24.693295 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:24.693514 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:24.693517 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:24.693684 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:24.693776 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:24.693784 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.694627 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.694631 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:24.695548 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:24.695686 (+ 138us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.696359 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.696363 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:24.696456 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:24.696960 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:24.696975 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:24.699049 (+ 2074us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":52}
W20260809 15:31:24.699472 21455 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 15:31:24.699606 21312 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:24.693195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:41843 (local address 127.11.146.62:39563)
0809 15:31:24.693322 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:24.693325 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:24.693337 (+ 12us) server_negotiation.cc:407] Connection header received
0809 15:31:24.693372 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:24.693374 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:24.693410 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:24.693495 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:24.693916 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.694499 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.695822 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.696236 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.696346 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:24.699215 (+ 2869us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.2:41843: BlockingRecv error: recv got EOF from 127.11.146.2:41843 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260809 15:31:24.802173 21458 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:24.802449 21458 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:24.802495 21458 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:24.807813 21458 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:24.807883 21458 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:24.807945 21458 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.3
I20260809 15:31:24.813704 21458 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:40603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/krb5kdc/oryx_127.11.146.3.keytab
--principal=oryx/127.11.146.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.3:33891
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.146.3
--webserver_port=43475
--tserver_master_addrs=127.11.146.62:39563
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21458
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.3
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:24.814993 21458 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:24.816000 21458 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:24.826599 21465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:24.826598 21467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:24.826597 21463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:24.826920 21458 server_base.cc:1034] running on GCE node
I20260809 15:31:24.827446 21458 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:24.828207 21458 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:24.829416 21458 hybrid_clock.cc:648] HybridClock initialized: now 1786289484829379 us; error 50 us; skew 500 ppm
Aug 09 15:31:24 dist-test-slave-1jjb krb5kdc[20532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289484, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.146.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:24.832624 21458 init.cc:377] Logged in from keytab as oryx/127.11.146.3@KRBTEST.COM (short username oryx)
I20260809 15:31:24.833645 21458 webserver.cc:460] Webserver started at http://127.11.146.3:43475/ using document root <none> and password file <none>
I20260809 15:31:24.834322 21458 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:24.834451 21458 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:24.838963 21458 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.000s
I20260809 15:31:24.841517 21475 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:24.842963 21458 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 15:31:24.843098 21458 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-2/wal
uuid: "11a06f8cb12546d19b8142015e097628"
format_stamp: "Formatted at 2026-08-09 15:31:23 on dist-test-slave-1jjb"
server_key: "45b53fcba187c6e2a4220eb5a4b11a48"
server_key_iv: "35312f3b6c00f14a84e6c29b3c4ded43"
server_key_version: "encryptionkey@0"
I20260809 15:31:24.843662 21458 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:24.864775 21458 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:24.868007 21458 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:24.868256 21458 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:24.868892 21458 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:31:24.869774 21458 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:24.869853 21458 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:24.869926 21458 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:24.869977 21458 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:24.880478 21458 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.3:33891
I20260809 15:31:24.880506 21595 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.3:33891 every 8 connection(s)
I20260809 15:31:24.881601 21458 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
I20260809 15:31:24.883814 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 21458
Aug 09 15:31:24 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:24 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:24.897212 21599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:24.885232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57702 (local address 127.11.146.62:39563)
0809 15:31:24.885515 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:24.885522 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:24.885543 (+ 21us) server_negotiation.cc:407] Connection header received
0809 15:31:24.885605 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:24.885611 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:24.885680 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:24.885817 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:24.886729 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.887562 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.888673 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.888985 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.889127 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:24.891168 (+ 2041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:24.891174 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:24.891188 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:24.891219 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:24.893369 (+ 2150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:24.894417 (+ 1048us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:24.894430 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:24.894444 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:24.894758 (+ 314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:24.895299 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:24.895302 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:24.895304 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:24.896193 (+ 889us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:24.896413 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:24.896759 (+ 346us) server_negotiation.cc:299] Negotiation successful
0809 15:31:24.897014 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":111,"threads_started":1}
W20260809 15:31:24.897648 21312 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:24.884653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:58889 (local address 127.11.146.62:39563)
0809 15:31:24.884811 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:24.884816 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:24.886223 (+ 1407us) server_negotiation.cc:407] Connection header received
0809 15:31:24.887332 (+ 1109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:24.887334 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:24.887382 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:24.887444 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:24.888802 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.889386 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.891310 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.891679 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.891774 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:24.897559 (+ 5785us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.3:58889: BlockingRecv error: recv got EOF from 127.11.146.3:58889 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 15:31:24.898450 21600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:24.885189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.3:58889)
0809 15:31:24.886065 (+ 876us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:24.886115 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:24.887104 (+ 989us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:24.887638 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:24.887649 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:24.888044 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:24.888639 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:24.888661 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.889546 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.889549 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:24.891184 (+ 1635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:24.891195 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.892026 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.892038 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:24.892457 (+ 419us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:24.893263 (+ 806us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:24.893284 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:24.897444 (+ 4160us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":636,"thread_start_us":172,"threads_started":1}
W20260809 15:31:24.898988 21596 heartbeater.cc:644] Failed to heartbeat to 127.11.146.62:39563 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.146.62:39563: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Aug 09 15:31:24 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:24 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:24.905452 21600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:24.899515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.3:39475)
0809 15:31:24.899832 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:24.899847 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:24.899934 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:24.900226 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:24.900230 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:24.900432 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:24.900560 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:24.900567 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.901410 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.901416 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:24.902026 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:24.902035 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.902534 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.902538 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:24.902645 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:24.903187 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:24.903200 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:24.905291 (+ 2091us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":233}
W20260809 15:31:24.905563 21312 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:24.899576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:39475 (local address 127.11.146.62:39563)
0809 15:31:24.899690 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:24.899693 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:24.899899 (+ 206us) server_negotiation.cc:407] Connection header received
0809 15:31:24.900014 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:24.900016 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:24.900063 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:24.900176 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:24.900746 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.901288 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.902168 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.902405 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.902529 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:24.905418 (+ 2889us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.3:39475: BlockingRecv error: recv got EOF from 127.11.146.3:39475 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 09 15:31:24 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:24 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:24.911589 21600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:24.906112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.3:51693)
0809 15:31:24.906265 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:24.906280 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:24.906368 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:24.906654 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:24.906656 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:24.906786 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:24.906872 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:24.906876 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.907768 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.907771 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:24.908390 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:24.908401 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.908905 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.908908 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:24.908977 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:24.909543 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:24.909557 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:24.911418 (+ 1861us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":73}
W20260809 15:31:24.911635 21312 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:24.906243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:51693 (local address 127.11.146.62:39563)
0809 15:31:24.906454 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:24.906458 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:24.906472 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:31:24.906508 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:24.906510 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:24.906547 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:24.906625 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:24.906981 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.907518 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.908521 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:24.908739 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:24.908824 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:24.911534 (+ 2710us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.3:51693: BlockingRecv error: recv got EOF from 127.11.146.3:51693 (error 108)
Metrics: {"server-negotiator.queue_time_us":125}
W20260809 15:31:24.911933 21596 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 09 15:31:25 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:25 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:25.499712 21601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:25.494147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.1:45313)
0809 15:31:25.494419 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:25.494433 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:25.494521 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:25.494744 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:25.494746 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:25.494923 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:25.495052 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:25.495057 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:25.495913 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:25.495916 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:25.496588 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:25.496600 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:25.497039 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:25.497041 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:25.497115 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:25.497716 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:25.497729 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:25.499591 (+ 1862us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":97,"threads_started":1}
W20260809 15:31:25.499975 21602 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:25.494207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:45313 (local address 127.11.146.62:39563)
0809 15:31:25.494465 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:25.494468 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:25.494482 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:31:25.494608 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:25.494610 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:25.494655 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:25.494734 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:25.495151 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:25.495789 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:25.496701 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:25.496922 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:25.497008 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:25.499827 (+ 2819us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.1:45313: BlockingRecv error: recv got EOF from 127.11.146.1:45313 (error 108)
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":113,"threads_started":1}
Aug 09 15:31:25 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:25 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:25.705685 21603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:25.700209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.2:54523)
0809 15:31:25.700533 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:25.700548 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:25.700649 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:25.700975 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:25.700978 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:25.701167 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:25.701271 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:25.701276 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:25.702024 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:25.702027 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:25.702592 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:25.702599 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:25.703034 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:25.703037 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:25.703096 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:25.703691 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:25.703705 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:25.705554 (+ 1849us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":90,"threads_started":1}
W20260809 15:31:25.705916 21602 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:25.700397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:54523 (local address 127.11.146.62:39563)
0809 15:31:25.700578 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:25.700582 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:25.700599 (+ 17us) server_negotiation.cc:407] Connection header received
0809 15:31:25.700774 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:25.700776 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:25.700828 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:25.700901 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:25.701383 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:25.701925 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:25.702700 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:25.702928 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:25.703007 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:25.705738 (+ 2731us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.2:54523: BlockingRecv error: recv got EOF from 127.11.146.2:54523 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
Aug 09 15:31:25 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:25 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:25.918496 21604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:25.912581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.3:58061)
0809 15:31:25.912921 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:25.912939 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:25.913060 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:25.913340 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:25.913343 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:25.913575 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:25.913669 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:25.913676 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:25.914578 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:25.914582 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:25.915151 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:25.915160 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:25.915748 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:25.915752 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:25.915841 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:25.916455 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:25.916474 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:25.918307 (+ 1833us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":86,"threads_started":1}
W20260809 15:31:25.918558 21602 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:25.912697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:58061 (local address 127.11.146.62:39563)
0809 15:31:25.912852 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:25.912858 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:25.913001 (+ 143us) server_negotiation.cc:407] Connection header received
0809 15:31:25.913168 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:25.913171 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:25.913229 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:25.913318 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:25.913789 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:25.914463 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:25.915273 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:25.915498 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:25.915762 (+ 264us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:25.918432 (+ 2670us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.3:58061: BlockingRecv error: recv got EOF from 127.11.146.3:58061 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 09 15:31:26 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:26 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:26.506047 21605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:26.500534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.1:53647)
0809 15:31:26.500915 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:26.500928 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:26.501027 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:26.501298 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:26.501300 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:26.501484 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:26.501584 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:26.501589 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:26.502334 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:26.502336 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:26.502881 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:26.502888 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:26.503365 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:26.503367 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:26.503427 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:26.504000 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:26.504012 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:26.505919 (+ 1907us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":194,"threads_started":1}
W20260809 15:31:26.506232 21606 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:26.500659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:53647 (local address 127.11.146.62:39563)
0809 15:31:26.500927 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:26.500930 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:26.501015 (+ 85us) server_negotiation.cc:407] Connection header received
0809 15:31:26.501130 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:26.501132 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:26.501176 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:26.501260 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:26.501685 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:26.502222 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:26.503022 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:26.503260 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:26.503348 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:26.506080 (+ 2732us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.1:53647: BlockingRecv error: recv got EOF from 127.11.146.1:53647 (error 108)
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":120,"threads_started":1}
Aug 09 15:31:26 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:26 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:26.712687 21607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:26.706725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.2:37469)
0809 15:31:26.707105 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:26.707123 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:26.707249 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:26.707564 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:26.707567 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:26.707788 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:26.707887 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:26.707892 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:26.708730 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:26.708736 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:26.709317 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:26.709325 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:26.709797 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:26.709800 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:26.709883 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:26.710481 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:26.710494 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:26.712470 (+ 1976us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":106,"threads_started":1}
W20260809 15:31:26.712746 21606 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:26.706894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:37469 (local address 127.11.146.62:39563)
0809 15:31:26.707084 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:26.707089 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:26.707187 (+ 98us) server_negotiation.cc:407] Connection header received
0809 15:31:26.707395 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:26.707399 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:26.707451 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:26.707540 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:26.708006 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:26.708618 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:26.709453 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:26.709681 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:26.709791 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:26.712611 (+ 2820us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.2:37469: BlockingRecv error: recv got EOF from 127.11.146.2:37469 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 09 15:31:26 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:26 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:26.925665 21609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:26.919515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.3:39897)
0809 15:31:26.919954 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:26.919968 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:26.920096 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:26.920419 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:26.920421 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:26.920626 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:26.920730 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:26.920736 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:26.921566 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:26.921569 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:26.922131 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:26.922139 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:26.922629 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:26.922632 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:26.922701 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:26.923381 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:26.923394 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:26.925528 (+ 2134us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":220,"threads_started":1}
W20260809 15:31:26.925844 21606 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:26.919748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:39897 (local address 127.11.146.62:39563)
0809 15:31:26.919962 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:26.919966 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:26.920041 (+ 75us) server_negotiation.cc:407] Connection header received
0809 15:31:26.920215 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:26.920218 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:26.920270 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:26.920349 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:26.920868 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:26.921442 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:26.922260 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:26.922488 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:26.922576 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:26.925693 (+ 3117us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.3:39897: BlockingRecv error: recv got EOF from 127.11.146.3:39897 (error 108)
Metrics: {"server-negotiator.queue_time_us":110}
Aug 09 15:31:27 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:27 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:27.512529 21610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:27.506904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.1:55553)
0809 15:31:27.507187 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:27.507201 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:27.507290 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:27.507581 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:27.507583 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:27.507770 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:27.507873 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:27.507878 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:27.508658 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:27.508661 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:27.509240 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:27.509249 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:27.509672 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:27.509675 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:27.509742 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:27.510261 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:27.510275 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:27.512395 (+ 2120us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":109,"threads_started":1}
W20260809 15:31:27.512794 21611 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:27.507019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:55553 (local address 127.11.146.62:39563)
0809 15:31:27.507265 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:27.507269 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:27.507282 (+ 13us) server_negotiation.cc:407] Connection header received
0809 15:31:27.507388 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:27.507390 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:27.507434 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:27.507515 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:27.507980 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:27.508562 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:27.509355 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:27.509567 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:27.509642 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:27.512608 (+ 2966us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.1:55553: BlockingRecv error: recv got EOF from 127.11.146.1:55553 (error 108)
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":99,"threads_started":1}
Aug 09 15:31:27 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:27 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:27.721191 21612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:27.713675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.2:49319)
0809 15:31:27.713937 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:27.713958 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:27.714105 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:27.714565 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:27.714568 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:27.714803 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:27.714903 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:27.714909 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:27.716378 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:27.716382 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:27.717370 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:27.717387 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:27.718030 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:27.718034 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:27.718120 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:27.718704 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:27.718717 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:27.721070 (+ 2353us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":72,"threads_started":1}
W20260809 15:31:27.721421 21611 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:27.713718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:49319 (local address 127.11.146.62:39563)
0809 15:31:27.713867 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:27.713871 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:27.714046 (+ 175us) server_negotiation.cc:407] Connection header received
0809 15:31:27.714233 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:27.714236 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:27.714300 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:27.714384 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:27.715212 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:27.716046 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:27.717557 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:27.717899 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:27.718010 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:27.721287 (+ 3277us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.2:49319: BlockingRecv error: recv got EOF from 127.11.146.2:49319 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 09 15:31:27 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:27 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:27.932909 21613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:27.926574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.3:54333)
0809 15:31:27.926870 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:27.926884 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:27.926990 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:27.927250 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:27.927253 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:27.927443 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:27.927543 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:27.927557 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:27.928639 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:27.928644 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:27.929479 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:27.929490 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:27.929928 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:27.929960 (+ 32us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:27.930063 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:27.930617 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:27.930629 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:27.932738 (+ 2109us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":95,"threads_started":1}
W20260809 15:31:27.932993 21611 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:27.926680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:54333 (local address 127.11.146.62:39563)
0809 15:31:27.926851 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:27.926855 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:27.926961 (+ 106us) server_negotiation.cc:407] Connection header received
0809 15:31:27.927079 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:27.927082 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:27.927131 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:27.927212 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:27.927729 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:27.928513 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:27.929587 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:27.929803 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:27.929899 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:27.932868 (+ 2969us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.3:54333: BlockingRecv error: recv got EOF from 127.11.146.3:54333 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 09 15:31:28 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:28 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:28.518762 21614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:28.513248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.1:42137)
0809 15:31:28.513543 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:28.513559 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:28.513669 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:28.513886 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:28.513888 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:28.514078 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:28.514178 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:28.514183 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:28.514922 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:28.514925 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:28.515556 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:28.515663 (+ 107us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:28.516219 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:28.516221 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:28.516291 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:28.516778 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:28.516790 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:28.518643 (+ 1853us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":106,"threads_started":1}
W20260809 15:31:28.519026 21615 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:28.513324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:42137 (local address 127.11.146.62:39563)
0809 15:31:28.513577 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:28.513582 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:28.513615 (+ 33us) server_negotiation.cc:407] Connection header received
0809 15:31:28.513755 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:28.513757 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:28.513802 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:28.513871 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:28.514283 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:28.514817 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:28.515806 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:28.516034 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:28.516213 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:28.518865 (+ 2652us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.1:42137: BlockingRecv error: recv got EOF from 127.11.146.1:42137 (error 108)
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":87,"threads_started":1}
Aug 09 15:31:28 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:28 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:28.733894 21616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:28.722058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.2:58241)
0809 15:31:28.722433 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:28.722451 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:28.722568 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:28.723042 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:28.723046 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:28.723555 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:28.723712 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:28.723721 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:28.724818 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:28.724821 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:28.725412 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:28.725422 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:28.725911 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:28.725914 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:28.725978 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:28.731774 (+ 5796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:28.731788 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:28.733766 (+ 1978us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":196,"threads_started":1}
W20260809 15:31:28.734105 21615 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:28.722216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:58241 (local address 127.11.146.62:39563)
0809 15:31:28.722395 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:28.722399 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:28.722535 (+ 136us) server_negotiation.cc:407] Connection header received
0809 15:31:28.722732 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:28.722736 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:28.722802 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:28.722911 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:28.723838 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:28.724691 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:28.725574 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:28.725791 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:28.725879 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:28.733962 (+ 8083us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.2:58241: BlockingRecv error: recv got EOF from 127.11.146.2:58241 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 09 15:31:28 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:28 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:28.939985 21617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:28.933787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.3:60295)
0809 15:31:28.934072 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:28.934087 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:28.934197 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:28.934437 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:28.934439 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:28.934647 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:28.934744 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:28.934750 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:28.935555 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:28.935557 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:28.936247 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:28.936258 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:28.936734 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:28.936737 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:28.936799 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:28.937352 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:28.937368 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:28.939764 (+ 2396us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":81,"threads_started":1}
W20260809 15:31:28.940043 21615 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:28.933888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:60295 (local address 127.11.146.62:39563)
0809 15:31:28.934091 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:28.934095 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:28.934201 (+ 106us) server_negotiation.cc:407] Connection header received
0809 15:31:28.934263 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:28.934266 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:28.934319 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:28.934400 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:28.934859 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:28.935442 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:28.936396 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:28.936619 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:28.936709 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:28.939901 (+ 3192us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.3:60295: BlockingRecv error: recv got EOF from 127.11.146.3:60295 (error 108)
Metrics: {"server-negotiator.queue_time_us":101}
Aug 09 15:31:29 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:29 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:29.525481 21618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:29.519739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.1:40077)
0809 15:31:29.520052 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:29.520064 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:29.520232 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:29.520484 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:29.520486 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:29.520669 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:29.520763 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:29.520769 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:29.521503 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:29.521506 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:29.522108 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:29.522117 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:29.522538 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:29.522540 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:29.522600 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:29.523103 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:29.523115 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:29.525361 (+ 2246us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":79,"threads_started":1}
W20260809 15:31:29.525658 21619 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:29.519818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:40077 (local address 127.11.146.62:39563)
0809 15:31:29.520121 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:29.520125 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:29.520181 (+ 56us) server_negotiation.cc:407] Connection header received
0809 15:31:29.520318 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:29.520320 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:29.520363 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:29.520446 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:29.520842 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:29.521385 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:29.522216 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:29.522438 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:29.522519 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:29.525486 (+ 2967us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.1:40077: BlockingRecv error: recv got EOF from 127.11.146.1:40077 (error 108)
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":101,"threads_started":1}
Aug 09 15:31:29 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:29 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:29.741691 21620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:29.734984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.2:49181)
0809 15:31:29.735289 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:29.735304 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:29.735393 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:29.735887 (+ 494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:29.735890 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:29.736185 (+ 295us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:29.736329 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:29.736337 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:29.737346 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:29.737350 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:29.738104 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:29.738116 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:29.738634 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:29.738638 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:29.738710 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:29.739341 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:29.739355 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:29.741568 (+ 2213us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":110,"threads_started":1}
W20260809 15:31:29.742017 21619 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:29.735148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:49181 (local address 127.11.146.62:39563)
0809 15:31:29.735358 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:29.735363 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:29.735380 (+ 17us) server_negotiation.cc:407] Connection header received
0809 15:31:29.735502 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:29.735504 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:29.735650 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:29.735831 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:29.736491 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:29.737187 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:29.738235 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:29.738475 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:29.738562 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:29.741903 (+ 3341us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.2:49181: BlockingRecv error: recv got EOF from 127.11.146.2:49181 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 09 15:31:29 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:29 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:29.947041 21621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:29.941015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.3:34821)
0809 15:31:29.941318 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:29.941335 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:29.941477 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:29.941788 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:29.941792 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:29.942059 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:29.942230 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:29.942239 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:29.942973 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:29.942975 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:29.943527 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:29.943536 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:29.944144 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:29.944155 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:29.944252 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:29.944779 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:29.944792 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:29.946923 (+ 2131us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":125,"threads_started":1}
W20260809 15:31:29.947259 21619 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:29.941076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:34821 (local address 127.11.146.62:39563)
0809 15:31:29.941226 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:29.941231 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:29.941431 (+ 200us) server_negotiation.cc:407] Connection header received
0809 15:31:29.941574 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:29.941576 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:29.941623 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:29.941731 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:29.942340 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:29.942876 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:29.943698 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:29.943936 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:29.944028 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:29.947086 (+ 3058us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.3:34821: BlockingRecv error: recv got EOF from 127.11.146.3:34821 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 09 15:31:30 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:30 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:30.532601 21622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:30.526394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.1:41245)
0809 15:31:30.526706 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:30.526721 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:30.526816 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:30.527125 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:30.527128 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:30.527376 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:30.527504 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:30.527515 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:30.528616 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:30.528618 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:30.529199 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:30.529207 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:30.529742 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:30.529745 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:30.529808 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:30.530388 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:30.530409 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:30.532486 (+ 2077us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":91,"threads_started":1}
W20260809 15:31:30.532881 21623 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:30.526500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:41245 (local address 127.11.146.62:39563)
0809 15:31:30.526796 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:30.526800 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:30.526838 (+ 38us) server_negotiation.cc:407] Connection header received
0809 15:31:30.526907 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:30.526910 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:30.526963 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:30.527067 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:30.527691 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:30.528515 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:30.529333 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:30.529640 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:30.529722 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:30.532719 (+ 2997us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.1:41245: BlockingRecv error: recv got EOF from 127.11.146.1:41245 (error 108)
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":85,"threads_started":1}
Aug 09 15:31:30 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:30 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:30.748457 21624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:30.742546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.2:47789)
0809 15:31:30.742820 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:30.742836 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:30.742951 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:30.743206 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:30.743209 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:30.743396 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:30.743493 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:30.743498 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:30.744392 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:30.744395 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:30.744965 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:30.744974 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:30.745418 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:30.745421 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:30.745484 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:30.746057 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:30.746079 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:30.748265 (+ 2186us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":104,"threads_started":1}
W20260809 15:31:30.748548 21623 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:30.742591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:47789 (local address 127.11.146.62:39563)
0809 15:31:30.742755 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:30.742759 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:30.742918 (+ 159us) server_negotiation.cc:407] Connection header received
0809 15:31:30.743035 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:30.743037 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:30.743092 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:30.743174 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:30.743636 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:30.744273 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:30.745079 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:30.745314 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:30.745399 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:30.748410 (+ 3011us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.2:47789: BlockingRecv error: recv got EOF from 127.11.146.2:47789 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 09 15:31:30 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:30 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:30.953974 21625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:30.948030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.3:36501)
0809 15:31:30.948347 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:30.948360 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:30.948461 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:30.948848 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:30.948850 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:30.949045 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:30.949153 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:30.949159 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:30.950020 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:30.950024 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:30.950691 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:30.950702 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:30.951214 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:30.951220 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:30.951297 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:30.951994 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:30.952007 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:30.953848 (+ 1841us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":162,"threads_started":1}
W20260809 15:31:30.954146 21623 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:30.948068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:36501 (local address 127.11.146.62:39563)
0809 15:31:30.948238 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:30.948244 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:30.948436 (+ 192us) server_negotiation.cc:407] Connection header received
0809 15:31:30.948535 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:30.948537 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:30.948711 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:30.948831 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:30.949298 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:30.949851 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:30.950828 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:30.951052 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:30.951162 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:30.954014 (+ 2852us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.3:36501: BlockingRecv error: recv got EOF from 127.11.146.3:36501 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 09 15:31:31 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:31 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:31.539665 21626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:31.533368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.1:60479)
0809 15:31:31.533745 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:31.533759 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:31.533873 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:31.534176 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:31.534178 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:31.534368 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:31.534484 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:31.534490 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:31.535274 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:31.535277 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:31.535990 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:31.536002 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:31.536734 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:31.536737 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:31.536802 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:31.537434 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:31.537446 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:31.539431 (+ 1985us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":110,"threads_started":1}
W20260809 15:31:31.539981 21627 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:31.533485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:60479 (local address 127.11.146.62:39563)
0809 15:31:31.533753 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:31.533757 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:31.533834 (+ 77us) server_negotiation.cc:407] Connection header received
0809 15:31:31.534001 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:31.534004 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:31.534063 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:31.534146 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:31.534608 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:31.535168 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:31.536307 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:31.536604 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:31.536697 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:31.539830 (+ 3133us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.1:60479: BlockingRecv error: recv got EOF from 127.11.146.1:60479 (error 108)
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":69,"threads_started":1}
Aug 09 15:31:31 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:31 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:31.755363 21628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:31.749375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.2:59633)
0809 15:31:31.749723 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:31.749738 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:31.749838 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:31.750131 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:31.750134 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:31.750367 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:31.750464 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:31.750470 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:31.751231 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:31.751238 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:31.752011 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:31.752023 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:31.752565 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:31.752568 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:31.752634 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:31.753209 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:31.753223 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:31.755211 (+ 1988us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":82,"threads_started":1}
W20260809 15:31:31.755563 21627 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:31.749502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:59633 (local address 127.11.146.62:39563)
0809 15:31:31.749662 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:31.749666 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:31.749836 (+ 170us) server_negotiation.cc:407] Connection header received
0809 15:31:31.749931 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:31.749933 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:31.749981 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:31.750090 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:31.750574 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:31.751102 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:31.752217 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:31.752448 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:31.752532 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:31.755382 (+ 2850us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.2:59633: BlockingRecv error: recv got EOF from 127.11.146.2:59633 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 09 15:31:31 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:31 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:31.960525 21629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:31.954786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.3:52215)
0809 15:31:31.955122 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:31.955136 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:31.955236 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:31.955479 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:31.955481 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:31.955795 (+ 314us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:31.955900 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:31.955916 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:31.956671 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:31.956674 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:31.957227 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:31.957234 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:31.957649 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:31.957652 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:31.957715 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:31.958215 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:31.958226 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:31.960345 (+ 2119us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":118,"threads_started":1}
W20260809 15:31:31.960625 21627 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:31.954890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:52215 (local address 127.11.146.62:39563)
0809 15:31:31.955058 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:31.955065 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:31.955209 (+ 144us) server_negotiation.cc:407] Connection header received
0809 15:31:31.955321 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:31.955323 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:31.955370 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:31.955440 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:31.956033 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:31.956577 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:31.957327 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:31.957543 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:31.957620 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:31.960495 (+ 2875us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.3:52215: BlockingRecv error: recv got EOF from 127.11.146.3:52215 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 09 15:31:32 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:32 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:32.546645 21630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:32.540643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.1:54707)
0809 15:31:32.540918 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:32.540935 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:32.541037 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:32.541429 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:32.541436 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:32.541653 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:32.541760 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:32.541767 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:32.542735 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:32.542738 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:32.543315 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:32.543325 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:32.543811 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:32.543814 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:32.543890 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:32.544417 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:32.544429 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:32.546525 (+ 2096us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":82,"threads_started":1}
W20260809 15:31:32.546904 21631 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:32.540798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:54707 (local address 127.11.146.62:39563)
0809 15:31:32.541092 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:32.541099 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:32.541122 (+ 23us) server_negotiation.cc:407] Connection header received
0809 15:31:32.541158 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:32.541160 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:32.541202 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:32.541280 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:32.541921 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:32.542612 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:32.543446 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:32.543680 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:32.543764 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:32.546773 (+ 3009us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.1:54707: BlockingRecv error: recv got EOF from 127.11.146.1:54707 (error 108)
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":86,"threads_started":1}
Aug 09 15:31:32 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:32 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:32.761786 21632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:32.756190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.2:60731)
0809 15:31:32.756462 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:32.756475 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:32.756573 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:32.756790 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:32.756792 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:32.756977 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:32.757074 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:32.757080 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:32.757913 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:32.757915 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:32.758459 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:32.758465 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:32.758904 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:32.758908 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:32.758999 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:32.759672 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:32.759689 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:32.761672 (+ 1983us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":97,"threads_started":1}
W20260809 15:31:32.762090 21631 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:32.756262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:60731 (local address 127.11.146.62:39563)
0809 15:31:32.756411 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:32.756414 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:32.756541 (+ 127us) server_negotiation.cc:407] Connection header received
0809 15:31:32.756637 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:32.756639 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:32.756685 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:32.756756 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:32.757173 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:32.757822 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:32.758557 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:32.758783 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:32.758856 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:32.761864 (+ 3008us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.2:60731: BlockingRecv error: recv got EOF from 127.11.146.2:60731 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 09 15:31:32 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:32 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:32.966645 21634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:32.961434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.3:60601)
0809 15:31:32.961727 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:32.961740 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:32.961838 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:32.962047 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:32.962049 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:32.962227 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:32.962322 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:32.962327 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:32.963039 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:32.963041 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:32.963603 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:32.963611 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:32.964099 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:32.964103 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:32.964162 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:32.964634 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:32.964645 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:32.966473 (+ 1828us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":121,"threads_started":1}
W20260809 15:31:32.966702 21631 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:32.961483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:60601 (local address 127.11.146.62:39563)
0809 15:31:32.961725 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:32.961729 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:32.961808 (+ 79us) server_negotiation.cc:407] Connection header received
0809 15:31:32.961917 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:32.961919 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:32.961965 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:32.962035 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:32.962419 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:32.962939 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:32.963749 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:32.963969 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:32.964056 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:32.966594 (+ 2538us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.3:60601: BlockingRecv error: recv got EOF from 127.11.146.3:60601 (error 108)
Metrics: {"server-negotiator.queue_time_us":155}
Aug 09 15:31:33 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:33 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:33.553197 21635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:33.547511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.1:55949)
0809 15:31:33.547872 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:33.547890 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:33.548012 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:33.548328 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:33.548333 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:33.548582 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:33.548735 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:33.548744 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:33.549518 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:33.549520 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:33.550066 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:33.550074 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:33.550534 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:33.550537 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:33.550599 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:33.551169 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:33.551182 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:33.553079 (+ 1897us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":116,"threads_started":1}
W20260809 15:31:33.553493 21636 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:33.547650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:55949 (local address 127.11.146.62:39563)
0809 15:31:33.547913 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:33.547919 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:33.547938 (+ 19us) server_negotiation.cc:407] Connection header received
0809 15:31:33.548141 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:33.548144 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:33.548201 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:33.548298 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:33.548871 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:33.549424 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:33.550193 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:33.550424 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:33.550513 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:33.553223 (+ 2710us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.1:55949: BlockingRecv error: recv got EOF from 127.11.146.1:55949 (error 108)
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":60,"threads_started":1}
Aug 09 15:31:33 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:33 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:33.774226 21637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:33.762544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.2:50211)
0809 15:31:33.762847 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:33.762861 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:33.762978 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:33.763224 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:33.763227 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:33.763440 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:33.763541 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:33.763565 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:33.764502 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:33.764506 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:33.765057 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:33.765066 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:33.765541 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:33.765545 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:33.765623 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:33.771976 (+ 6353us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:33.771991 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:33.774083 (+ 2092us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":131,"threads_started":1}
W20260809 15:31:33.774453 21636 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:33.762650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:50211 (local address 127.11.146.62:39563)
0809 15:31:33.762799 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:33.762803 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:33.762933 (+ 130us) server_negotiation.cc:407] Connection header received
0809 15:31:33.763063 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:33.763065 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:33.763112 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:33.763182 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:33.763715 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:33.764362 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:33.765185 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:33.765408 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:33.765519 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:33.774291 (+ 8772us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.2:50211: BlockingRecv error: recv got EOF from 127.11.146.2:50211 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 09 15:31:33 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:33 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:33.973905 21638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:33.967484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.3:49749)
0809 15:31:33.967922 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:33.967935 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:33.968114 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:33.968402 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:33.968405 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:33.968626 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:33.968720 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:33.968726 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:33.969507 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:33.969513 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:33.970083 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:33.970092 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:33.970563 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:33.970566 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:33.970651 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:33.971332 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:33.971353 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:33.973701 (+ 2348us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":99,"threads_started":1}
W20260809 15:31:33.973938 21636 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:33.967573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:49749 (local address 127.11.146.62:39563)
0809 15:31:33.967874 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:33.967879 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:33.968014 (+ 135us) server_negotiation.cc:407] Connection header received
0809 15:31:33.968225 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:33.968228 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:33.968283 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:33.968375 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:33.968841 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:33.969387 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:33.970207 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:33.970442 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:33.970558 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:33.973832 (+ 3274us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.3:49749: BlockingRecv error: recv got EOF from 127.11.146.3:49749 (error 108)
Metrics: {"server-negotiator.queue_time_us":200}
Aug 09 15:31:34 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:34 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:34.560623 21639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:34.554118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.1:50535)
0809 15:31:34.554391 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:34.554405 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:34.554494 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:34.554747 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:34.554749 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:34.554935 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:34.555039 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:34.555044 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:34.556228 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:34.556232 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:34.556871 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:34.556881 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:34.557377 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:34.557381 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:34.557452 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:34.557963 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:34.557976 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:34.560414 (+ 2438us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":94,"threads_started":1}
W20260809 15:31:34.560669 21640 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:34.554176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:50535 (local address 127.11.146.62:39563)
0809 15:31:34.554438 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:34.554441 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:34.554455 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:31:34.554587 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:34.554590 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:34.554635 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:34.554713 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:34.555140 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:34.556017 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:34.556989 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:34.557230 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:34.557320 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:34.560545 (+ 3225us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.1:50535: BlockingRecv error: recv got EOF from 127.11.146.1:50535 (error 108)
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":67,"threads_started":1}
Aug 09 15:31:34 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:34 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:34.781038 21641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:34.775232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.2:58821)
0809 15:31:34.775678 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:34.775696 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:34.775845 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:34.776147 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:34.776151 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:34.776356 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:34.776447 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:34.776453 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:34.777212 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:34.777217 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:34.777839 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:34.777849 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:34.778314 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:34.778317 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:34.778405 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:34.778972 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:34.778983 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:34.780923 (+ 1940us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":123,"threads_started":1}
W20260809 15:31:34.781224 21640 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:34.775335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:58821 (local address 127.11.146.62:39563)
0809 15:31:34.775521 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:34.775526 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:34.775792 (+ 266us) server_negotiation.cc:407] Connection header received
0809 15:31:34.775950 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:34.775954 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:34.776009 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:34.776118 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:34.776563 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:34.777103 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:34.777961 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:34.778200 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:34.778310 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:34.781064 (+ 2754us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.2:58821: BlockingRecv error: recv got EOF from 127.11.146.2:58821 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 09 15:31:34 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:34 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:34.981042 21642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:34.974872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.3:44817)
0809 15:31:34.975206 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:34.975224 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:34.975365 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:34.975807 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:34.975810 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:34.976040 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:34.976208 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:34.976214 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:34.977155 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:34.977162 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:34.977810 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:34.977826 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:34.978250 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:34.978253 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:34.978323 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:34.978881 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:34.978906 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:34.980915 (+ 2009us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":111,"threads_started":1}
W20260809 15:31:34.981192 21640 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:34.975125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:44817 (local address 127.11.146.62:39563)
0809 15:31:34.975298 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:34.975303 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:34.975318 (+ 15us) server_negotiation.cc:407] Connection header received
0809 15:31:34.975490 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:34.975495 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:34.975567 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:34.975793 (+ 226us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:34.976338 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:34.977030 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:34.977928 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:34.978145 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:34.978226 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:34.981063 (+ 2837us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.3:44817: BlockingRecv error: recv got EOF from 127.11.146.3:44817 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 09 15:31:35 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:35 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:35.567054 21643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:35.561509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.1:59791)
0809 15:31:35.561791 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:35.561804 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:35.561897 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:35.562140 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:35.562142 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:35.562325 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:35.562424 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:35.562430 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:35.563165 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:35.563167 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:35.563730 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:35.563737 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:35.564213 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:35.564215 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:35.564278 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:35.564810 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:35.564822 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:35.566893 (+ 2071us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":101,"threads_started":1}
W20260809 15:31:35.567214 21644 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:35.561647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:59791 (local address 127.11.146.62:39563)
0809 15:31:35.561886 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:35.561889 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:35.561903 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:31:35.561972 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:35.561974 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:35.562017 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:35.562101 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:35.562532 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:35.563071 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:35.563849 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:35.564114 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:35.564195 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:35.567062 (+ 2867us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.1:59791: BlockingRecv error: recv got EOF from 127.11.146.1:59791 (error 108)
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":87,"threads_started":1}
Aug 09 15:31:35 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:35 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:35.787474 21645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:35.781797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.2:34601)
0809 15:31:35.782161 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:35.782183 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:35.782325 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:35.782622 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:35.782625 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:35.782836 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:35.782947 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:35.782952 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:35.783731 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:35.783736 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:35.784315 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:35.784323 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:35.784798 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:35.784802 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:35.784891 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:35.785433 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:35.785447 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:35.787299 (+ 1852us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":132,"threads_started":1}
W20260809 15:31:35.787550 21644 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:35.781942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:34601 (local address 127.11.146.62:39563)
0809 15:31:35.782118 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:35.782123 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:35.782262 (+ 139us) server_negotiation.cc:407] Connection header received
0809 15:31:35.782429 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:35.782440 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:35.782496 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:35.782584 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:35.783069 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:35.783616 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:35.784444 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:35.784677 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:35.784793 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:35.787427 (+ 2634us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.2:34601: BlockingRecv error: recv got EOF from 127.11.146.2:34601 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 09 15:31:35 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:35 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:35.987694 21646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:35.981963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.3:59425)
0809 15:31:35.982266 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:35.982284 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:35.982436 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:35.982768 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:35.982771 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:35.983003 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:35.983104 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:35.983110 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:35.983856 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:35.983860 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:35.984517 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:35.984527 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:35.984973 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:35.984980 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:35.985061 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:35.985632 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:35.985645 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:35.987517 (+ 1872us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":102,"threads_started":1}
W20260809 15:31:35.987751 21644 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:35.981998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:59425 (local address 127.11.146.62:39563)
0809 15:31:35.982146 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:35.982151 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:35.982382 (+ 231us) server_negotiation.cc:407] Connection header received
0809 15:31:35.982558 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:35.982563 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:35.982622 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:35.982713 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:35.983211 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:35.983735 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:35.984640 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:35.984856 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:35.984934 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:35.987642 (+ 2708us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.3:59425: BlockingRecv error: recv got EOF from 127.11.146.3:59425 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 09 15:31:36 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:36 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:36.573930 21647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:36.567943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.1:48807)
0809 15:31:36.568314 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:36.568330 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:36.568428 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:36.568790 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:36.568793 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:36.568988 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:36.569104 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:36.569110 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:36.569940 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:36.569943 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:36.570536 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:36.570544 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:36.571054 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:36.571057 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:36.571124 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:36.571859 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:36.571871 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:36.573803 (+ 1932us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":130,"threads_started":1}
W20260809 15:31:36.574198 21648 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:36.568141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:48807 (local address 127.11.146.62:39563)
0809 15:31:36.568404 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:36.568408 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:36.568423 (+ 15us) server_negotiation.cc:407] Connection header received
0809 15:31:36.568591 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:36.568593 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:36.568645 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:36.568748 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:36.569231 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:36.569821 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:36.570670 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:36.570920 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:36.571015 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:36.574057 (+ 3042us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.1:48807: BlockingRecv error: recv got EOF from 127.11.146.1:48807 (error 108)
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":68,"threads_started":1}
Aug 09 15:31:36 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:36 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:36.794595 21649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:36.788449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.2:57213)
0809 15:31:36.788776 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:36.788791 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:36.788916 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:36.789189 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:36.789192 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:36.789390 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:36.789493 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:36.789499 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:36.790290 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:36.790292 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:36.790893 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:36.790900 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:36.791439 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:36.791442 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:36.791505 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:36.792158 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:36.792171 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:36.794427 (+ 2256us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":135,"threads_started":1}
W20260809 15:31:36.794688 21648 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:36.788564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:57213 (local address 127.11.146.62:39563)
0809 15:31:36.788719 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:36.788722 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:36.788872 (+ 150us) server_negotiation.cc:407] Connection header received
0809 15:31:36.789006 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:36.789008 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:36.789068 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:36.789145 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:36.789629 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:36.790187 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:36.791030 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:36.791287 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:36.791420 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:36.794575 (+ 3155us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.2:57213: BlockingRecv error: recv got EOF from 127.11.146.2:57213 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 09 15:31:36 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:36 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:36.995460 21650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:36.988671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.3:41937)
0809 15:31:36.989091 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:36.989112 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:36.989226 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:36.989512 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:36.989514 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:36.989735 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:36.989842 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:36.989848 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:36.990726 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:36.990729 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:36.991421 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:36.991431 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:36.992416 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:36.992419 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:36.992588 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:36.993148 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:36.993161 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:36.995288 (+ 2127us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":219,"threads_started":1}
W20260809 15:31:36.995816 21648 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:36.988910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:41937 (local address 127.11.146.62:39563)
0809 15:31:36.989077 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:36.989081 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:36.989178 (+ 97us) server_negotiation.cc:407] Connection header received
0809 15:31:36.989298 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:36.989301 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:36.989350 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:36.989445 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:36.989995 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:36.990577 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:36.991718 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:36.992233 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:36.992356 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:36.995502 (+ 3146us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.3:41937: BlockingRecv error: recv got EOF from 127.11.146.3:41937 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 09 15:31:37 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:37 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:37.588184 21652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:37.575014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.1:44673)
0809 15:31:37.575336 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:37.575351 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:37.575456 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:37.575969 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:37.575972 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:37.576190 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:37.576291 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:37.576297 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:37.577625 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:37.577629 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:37.578393 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:37.578405 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:37.579015 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:37.579019 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:37.579087 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:37.585750 (+ 6663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:37.585776 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:37.587972 (+ 2196us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":99,"threads_started":1}
W20260809 15:31:37.588342 21653 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:37.575096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:44673 (local address 127.11.146.62:39563)
0809 15:31:37.575393 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:37.575396 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:37.575412 (+ 16us) server_negotiation.cc:407] Connection header received
0809 15:31:37.575721 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:37.575725 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:37.575789 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:37.575880 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:37.576483 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:37.577475 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:37.578520 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:37.578861 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:37.578964 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:37.588202 (+ 9238us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.1:44673: BlockingRecv error: recv got EOF from 127.11.146.1:44673 (error 108)
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":67,"threads_started":1}
Aug 09 15:31:37 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:37 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:37.803290 21654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:37.795744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.2:48211)
0809 15:31:37.796045 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:37.796062 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:37.796280 (+ 218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:37.796677 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:37.796680 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:37.796940 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:37.797088 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:37.797096 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:37.798477 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:37.798481 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:37.799417 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:37.799429 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:37.800326 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:37.800329 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:37.800433 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:37.801080 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:37.801101 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:37.803162 (+ 2061us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":115,"threads_started":1}
W20260809 15:31:37.803452 21653 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:37.796084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:48211 (local address 127.11.146.62:39563)
0809 15:31:37.796320 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:37.796327 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:37.796389 (+ 62us) server_negotiation.cc:407] Connection header received
0809 15:31:37.796459 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:37.796462 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:37.796534 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:37.796631 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:37.797212 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:37.798321 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:37.799569 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:37.800189 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:37.800331 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:37.803319 (+ 2988us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.2:48211: BlockingRecv error: recv got EOF from 127.11.146.2:48211 (error 108)
Metrics: {"server-negotiator.queue_time_us":100}
Aug 09 15:31:38 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:38 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:38.003214 21655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:37.996698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.3:60711)
0809 15:31:37.997056 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:37.997071 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:37.997235 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:37.997573 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:37.997576 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:37.997819 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:37.997919 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:37.997926 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:37.998806 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:37.998809 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:37.999420 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:37.999429 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:38.000131 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:38.000139 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:38.000233 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:38.000796 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:38.000808 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:38.003021 (+ 2213us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":84,"threads_started":1}
W20260809 15:31:38.003274 21653 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:37.996742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:60711 (local address 127.11.146.62:39563)
0809 15:31:37.996896 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:37.996901 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:37.997182 (+ 281us) server_negotiation.cc:407] Connection header received
0809 15:31:37.997372 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:37.997375 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:37.997438 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:37.997542 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:37.998063 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:37.998673 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:37.999568 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:37.999927 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:38.000051 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:38.003156 (+ 3105us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.3:60711: BlockingRecv error: recv got EOF from 127.11.146.3:60711 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 09 15:31:38 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:38 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:38.594583 21657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:38.589024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.1:58231)
0809 15:31:38.589359 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:38.589377 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:38.589508 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:38.589740 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:38.589743 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:38.589921 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:38.590035 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:38.590040 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:38.590791 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:38.590793 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:38.591355 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:38.591363 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:38.591982 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:38.591985 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:38.592049 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:38.592636 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:38.592647 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:38.594457 (+ 1810us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":109,"threads_started":1}
W20260809 15:31:38.594740 21658 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:38.589185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:58231 (local address 127.11.146.62:39563)
0809 15:31:38.589519 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:38.589523 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:38.589556 (+ 33us) server_negotiation.cc:407] Connection header received
0809 15:31:38.589590 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:38.589592 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:38.589633 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:38.589702 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:38.590145 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:38.590687 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:38.591483 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:38.591849 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:38.591948 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:38.594603 (+ 2655us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.1:58231: BlockingRecv error: recv got EOF from 127.11.146.1:58231 (error 108)
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":78,"threads_started":1}
Aug 09 15:31:38 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:38 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:38.815141 21659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:38.804158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.2:47567)
0809 15:31:38.804512 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:38.804527 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:38.804674 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:38.804967 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:38.804969 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:38.805188 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:38.805284 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:38.805289 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:38.806067 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:38.806072 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:38.806667 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:38.806675 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:38.807147 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:38.807151 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:38.807241 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:38.812822 (+ 5581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:38.812836 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:38.814945 (+ 2109us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":112,"threads_started":1}
W20260809 15:31:38.815202 21658 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:38.804307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:47567 (local address 127.11.146.62:39563)
0809 15:31:38.804468 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:38.804473 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:38.804615 (+ 142us) server_negotiation.cc:407] Connection header received
0809 15:31:38.804783 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:38.804788 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:38.804849 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:38.804938 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:38.805409 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:38.805956 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:38.806790 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:38.807028 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:38.807141 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:38.815089 (+ 7948us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.2:47567: BlockingRecv error: recv got EOF from 127.11.146.2:47567 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 09 15:31:39 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:39 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.3@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:39.010933 21660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:39.004313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.3:34595)
0809 15:31:39.004753 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:39.004765 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:39.004917 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:39.005277 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:39.005280 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:39.005505 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:39.005605 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:39.005611 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:39.006628 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:39.006632 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:39.007268 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:39.007277 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:39.007798 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:39.007801 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:39.007868 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:39.008549 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:39.008561 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:39.010799 (+ 2238us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":104,"threads_started":1}
W20260809 15:31:39.011116 21658 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:39.004504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:34595 (local address 127.11.146.62:39563)
0809 15:31:39.004660 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:39.004664 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:39.004863 (+ 199us) server_negotiation.cc:407] Connection header received
0809 15:31:39.005063 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:39.005067 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:39.005134 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:39.005234 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:39.005715 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:39.006494 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:39.007428 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:39.007681 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:39.007772 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:39.010974 (+ 3202us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.3:34595: BlockingRecv error: recv got EOF from 127.11.146.3:34595 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 09 15:31:39 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:39 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.1@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:39.601583 21661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:39.595759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.1:33105)
0809 15:31:39.596067 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:39.596126 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:39.596238 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:39.596556 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:39.596560 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:39.596792 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:39.596929 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:39.596936 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:39.597794 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:39.597799 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:39.598358 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:39.598366 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:39.598819 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:39.598822 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:39.598915 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:39.599479 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:39.599498 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:39.601395 (+ 1897us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":96,"threads_started":1}
W20260809 15:31:39.601658 21662 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:39.595859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:33105 (local address 127.11.146.62:39563)
0809 15:31:39.596162 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:39.596166 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:39.596185 (+ 19us) server_negotiation.cc:407] Connection header received
0809 15:31:39.596356 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:39.596359 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:39.596429 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:39.596530 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:39.597042 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:39.597685 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:39.598477 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:39.598707 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:39.598814 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:39.601525 (+ 2711us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.1:33105: BlockingRecv error: recv got EOF from 127.11.146.1:33105 (error 108)
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":63,"threads_started":1}
Aug 09 15:31:39 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 15:31:39 dist-test-slave-1jjb krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.146.2@KRBTEST.COM for oryx/127.11.146.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 15:31:39.822106 21663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:39.816291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:39563 (local address 127.11.146.2:47771)
0809 15:31:39.816592 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:39.816606 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:39.816737 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:39.817055 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:39.817058 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:39.817318 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:39.817466 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:39.817477 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:39.818428 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:39.818434 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:39.818998 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:39.819006 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:39.819478 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:39.819482 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:39.819576 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:39.820094 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:39.820107 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:39.821987 (+ 1880us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.146.62:39563: Server oryx/127.11.146.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":98,"threads_started":1}
W20260809 15:31:39.822309 21662 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:39.816327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:47771 (local address 127.11.146.62:39563)
0809 15:31:39.816472 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:39.816480 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:39.816684 (+ 204us) server_negotiation.cc:407] Connection header received
0809 15:31:39.816841 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:39.816844 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:39.816941 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:39.817026 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:39.817589 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:39.818319 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:39.819120 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:39.819363 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:39.819472 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:39.822172 (+ 2700us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.146.2:47771: BlockingRecv error: recv got EOF from 127.11.146.2:47771 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 15:31:39.895174 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 21153
I20260809 15:31:39.903832 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 21313
I20260809 15:31:39.911222 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 21458
I20260809 15:31:39.920202 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 21080
2026-08-09T15:31:39Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18193 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-09T15:31:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:31:39Z Disabled control of system clock
I20260809 15:31:39.954738 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:32791
--webserver_interface=127.11.146.62
--webserver_port=0
--builtin_ntp_servers=127.11.146.20:42361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:32791
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 15:31:40.074934 21667 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:40.075188 21667 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:40.075222 21667 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:40.079419 21667 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:31:40.079496 21667 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:40.079512 21667 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:40.079530 21667 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:31:40.079545 21667 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:31:40.084848 21667 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:42361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:32791
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:32791
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21667
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:40.085945 21667 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:40.087320 21667 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 15:31:40.096318 21667 server_base.cc:1034] running on GCE node
W20260809 15:31:40.096280 21672 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:40.096537 21675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:40.096340 21673 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:40.097126 21667 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:40.098181 21667 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:40.099380 21667 hybrid_clock.cc:648] HybridClock initialized: now 1786289500099358 us; error 41 us; skew 500 ppm
I20260809 15:31:40.101312 21667 webserver.cc:460] Webserver started at http://127.11.146.62:45897/ using document root <none> and password file <none>
I20260809 15:31:40.101903 21667 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:40.101994 21667 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:40.102244 21667 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:40.104607 21667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "b4868a27ebd24a6ca7ca8d992a275d29"
format_stamp: "Formatted at 2026-08-09 15:31:40 on dist-test-slave-1jjb"
server_key: "882ab54a1d2265b1ec915f37448f2788"
server_key_iv: "a9d6b8fc76c48d6f35c63df72e110598"
server_key_version: "encryptionkey@0"
I20260809 15:31:40.105199 21667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "b4868a27ebd24a6ca7ca8d992a275d29"
format_stamp: "Formatted at 2026-08-09 15:31:40 on dist-test-slave-1jjb"
server_key: "882ab54a1d2265b1ec915f37448f2788"
server_key_iv: "a9d6b8fc76c48d6f35c63df72e110598"
server_key_version: "encryptionkey@0"
I20260809 15:31:40.108919 21667 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 15:31:40.111292 21681 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:40.112708 21667 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:31:40.112867 21667 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "b4868a27ebd24a6ca7ca8d992a275d29"
format_stamp: "Formatted at 2026-08-09 15:31:40 on dist-test-slave-1jjb"
server_key: "882ab54a1d2265b1ec915f37448f2788"
server_key_iv: "a9d6b8fc76c48d6f35c63df72e110598"
server_key_version: "encryptionkey@0"
I20260809 15:31:40.112984 21667 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:40.137697 21667 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:40.138468 21667 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:40.138675 21667 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:40.146488 21667 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:32791
I20260809 15:31:40.146562 21740 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:32791 every 8 connection(s)
I20260809 15:31:40.147579 21667 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:31:40.151073 21741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:40.151453 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 21667
I20260809 15:31:40.151579 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:31:40.151858 11848 external_mini_cluster.cc:1428] Setting key a2009f6037084f9bc6bb751d6ea50da2
I20260809 15:31:40.157948 21741 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4868a27ebd24a6ca7ca8d992a275d29: Bootstrap starting.
I20260809 15:31:40.160832 21741 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b4868a27ebd24a6ca7ca8d992a275d29: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:40.161653 21741 log.cc:824] T 00000000000000000000000000000000 P b4868a27ebd24a6ca7ca8d992a275d29: Log is configured to *not* fsync() on all Append() calls
I20260809 15:31:40.161803 21744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:40.153449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48030 (local address 127.11.146.62:32791)
0809 15:31:40.154211 (+ 762us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:40.154228 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:40.154265 (+ 37us) server_negotiation.cc:407] Connection header received
0809 15:31:40.154937 (+ 672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:40.154953 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:40.155345 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:40.155629 (+ 284us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:40.156196 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:40.157199 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:40.158365 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:40.158835 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:40.158957 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:40.159934 (+ 977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:40.159939 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:40.159951 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:31:40.160419 (+ 468us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:40.160477 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:31:40.160499 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:40.160586 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:40.160767 (+ 181us) server_negotiation.cc:299] Negotiation successful
0809 15:31:40.161051 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":247,"threads_started":1}
I20260809 15:31:40.163611 21741 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4868a27ebd24a6ca7ca8d992a275d29: No bootstrap required, opened a new log
I20260809 15:31:40.167399 21741 raft_consensus.cc:348] T 00000000000000000000000000000000 P b4868a27ebd24a6ca7ca8d992a275d29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4868a27ebd24a6ca7ca8d992a275d29" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 32791 } }
I20260809 15:31:40.167690 21741 raft_consensus.cc:374] T 00000000000000000000000000000000 P b4868a27ebd24a6ca7ca8d992a275d29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:40.167764 21741 raft_consensus.cc:729] T 00000000000000000000000000000000 P b4868a27ebd24a6ca7ca8d992a275d29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4868a27ebd24a6ca7ca8d992a275d29, State: Initialized, Role: FOLLOWER
I20260809 15:31:40.168279 21741 consensus_queue.cc:260] T 00000000000000000000000000000000 P b4868a27ebd24a6ca7ca8d992a275d29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4868a27ebd24a6ca7ca8d992a275d29" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 32791 } }
I20260809 15:31:40.168434 21741 raft_consensus.cc:388] T 00000000000000000000000000000000 P b4868a27ebd24a6ca7ca8d992a275d29 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:31:40.168500 21741 raft_consensus.cc:482] T 00000000000000000000000000000000 P b4868a27ebd24a6ca7ca8d992a275d29 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:31:40.168630 21741 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b4868a27ebd24a6ca7ca8d992a275d29 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:40.169651 21741 raft_consensus.cc:504] T 00000000000000000000000000000000 P b4868a27ebd24a6ca7ca8d992a275d29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4868a27ebd24a6ca7ca8d992a275d29" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 32791 } }
I20260809 15:31:40.169993 21741 leader_election.cc:302] T 00000000000000000000000000000000 P b4868a27ebd24a6ca7ca8d992a275d29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b4868a27ebd24a6ca7ca8d992a275d29; no voters:
I20260809 15:31:40.170296 21741 leader_election.cc:288] T 00000000000000000000000000000000 P b4868a27ebd24a6ca7ca8d992a275d29 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:31:40.170504 21746 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b4868a27ebd24a6ca7ca8d992a275d29 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:31:40.170805 21746 raft_consensus.cc:686] T 00000000000000000000000000000000 P b4868a27ebd24a6ca7ca8d992a275d29 [term 1 LEADER]: Becoming Leader. State: Replica: b4868a27ebd24a6ca7ca8d992a275d29, State: Running, Role: LEADER
I20260809 15:31:40.171118 21746 consensus_queue.cc:237] T 00000000000000000000000000000000 P b4868a27ebd24a6ca7ca8d992a275d29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4868a27ebd24a6ca7ca8d992a275d29" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 32791 } }
I20260809 15:31:40.171677 21741 sys_catalog.cc:564] T 00000000000000000000000000000000 P b4868a27ebd24a6ca7ca8d992a275d29 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:31:40.172907 21748 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4868a27ebd24a6ca7ca8d992a275d29 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b4868a27ebd24a6ca7ca8d992a275d29. Latest consensus state: current_term: 1 leader_uuid: "b4868a27ebd24a6ca7ca8d992a275d29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4868a27ebd24a6ca7ca8d992a275d29" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 32791 } } }
I20260809 15:31:40.173053 21748 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4868a27ebd24a6ca7ca8d992a275d29 [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:40.173430 21747 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4868a27ebd24a6ca7ca8d992a275d29 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b4868a27ebd24a6ca7ca8d992a275d29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4868a27ebd24a6ca7ca8d992a275d29" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 32791 } } }
I20260809 15:31:40.173585 21747 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4868a27ebd24a6ca7ca8d992a275d29 [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:40.173482 21755 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:31:40.177080 21755 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:31:40.182472 21755 catalog_manager.cc:1347] Generated new cluster ID: c0707a33dbbd46ff851fe0c40e43160c
I20260809 15:31:40.182554 21755 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:31:40.233563 21755 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:31:40.234557 21755 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:31:40.239638 21755 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b4868a27ebd24a6ca7ca8d992a275d29: Generated new TSK 0
I20260809 15:31:40.240387 21755 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:31:40.254324 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.1:0
--local_ip_for_outbound_sockets=127.11.146.1
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:32791
--builtin_ntp_servers=127.11.146.20:42361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260809 15:31:40.373768 21765 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:40.374022 21765 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:40.374058 21765 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:40.378189 21765 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:40.378250 21765 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:40.378326 21765 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.1
I20260809 15:31:40.383108 21765 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:42361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:32791
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21765
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.1
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:40.384428 21765 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:40.385874 21765 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:40.395767 21773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:40.395802 21770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:40.395848 21771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:40.396185 21765 server_base.cc:1034] running on GCE node
I20260809 15:31:40.396600 21765 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:40.397250 21765 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:40.398432 21765 hybrid_clock.cc:648] HybridClock initialized: now 1786289500398390 us; error 52 us; skew 500 ppm
I20260809 15:31:40.400665 21765 webserver.cc:460] Webserver started at http://127.11.146.1:44617/ using document root <none> and password file <none>
I20260809 15:31:40.401274 21765 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:40.401381 21765 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:40.401616 21765 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:40.403936 21765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/data/instance:
uuid: "6076b04ead1345838358a240e07f9263"
format_stamp: "Formatted at 2026-08-09 15:31:40 on dist-test-slave-1jjb"
server_key: "882cef03cc423b4ef5ffb35d3ff49883"
server_key_iv: "85f125fb4712d1447b25145c1a241cfc"
server_key_version: "encryptionkey@0"
I20260809 15:31:40.404604 21765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance:
uuid: "6076b04ead1345838358a240e07f9263"
format_stamp: "Formatted at 2026-08-09 15:31:40 on dist-test-slave-1jjb"
server_key: "882cef03cc423b4ef5ffb35d3ff49883"
server_key_iv: "85f125fb4712d1447b25145c1a241cfc"
server_key_version: "encryptionkey@0"
I20260809 15:31:40.408604 21765 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 15:31:40.411125 21780 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:40.412642 21765 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:31:40.412786 21765 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/wal
uuid: "6076b04ead1345838358a240e07f9263"
format_stamp: "Formatted at 2026-08-09 15:31:40 on dist-test-slave-1jjb"
server_key: "882cef03cc423b4ef5ffb35d3ff49883"
server_key_iv: "85f125fb4712d1447b25145c1a241cfc"
server_key_version: "encryptionkey@0"
I20260809 15:31:40.412914 21765 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:40.427520 21765 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:40.428295 21765 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:40.428494 21765 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:40.429107 21765 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:31:40.430065 21765 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:40.430132 21765 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:40.430207 21765 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:40.430249 21765 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:40.439250 21765 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.1:36045
I20260809 15:31:40.439275 21901 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.1:36045 every 8 connection(s)
I20260809 15:31:40.440217 21765 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
I20260809 15:31:40.442162 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 21765
I20260809 15:31:40.442277 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance
I20260809 15:31:40.442615 11848 external_mini_cluster.cc:1428] Setting key a206c529e6681164dfd5997715deb2a9
I20260809 15:31:40.444824 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.2:0
--local_ip_for_outbound_sockets=127.11.146.2
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:32791
--builtin_ntp_servers=127.11.146.20:42361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 15:31:40.450980 21744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:40.442122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:36727 (local address 127.11.146.62:32791)
0809 15:31:40.442273 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:40.442278 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:40.443690 (+ 1412us) server_negotiation.cc:407] Connection header received
0809 15:31:40.445388 (+ 1698us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:40.445391 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:40.445451 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:40.445552 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:40.446469 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:40.447339 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:40.448805 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:40.449020 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:40.449125 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:40.450490 (+ 1365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:40.450494 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:40.450496 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:31:40.450508 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:40.450527 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:31:40.450535 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:40.450593 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:40.450793 (+ 200us) server_negotiation.cc:299] Negotiation successful
0809 15:31:40.450849 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 15:31:40.452468 21904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:40.442675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:32791 (local address 127.11.146.1:36727)
0809 15:31:40.443505 (+ 830us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:40.443573 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:40.445159 (+ 1586us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:40.445734 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:40.445741 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:40.445827 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:40.446335 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:40.446347 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:40.447485 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:40.447488 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:40.448676 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:40.448692 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:40.449203 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:40.449210 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:40.449450 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:40.450165 (+ 715us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:31:40.450168 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:40.450227 (+ 59us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:31:40.450329 (+ 102us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:40.450624 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:40.450638 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:40.450647 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 15:31:40.450797 (+ 150us) client_negotiation.cc:240] Negotiation successful
0809 15:31:40.451154 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":156,"threads_started":1}
I20260809 15:31:40.453893 21902 heartbeater.cc:347] Connected to a master server at 127.11.146.62:32791
I20260809 15:31:40.454172 21902 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:40.454727 21902 heartbeater.cc:511] Master 127.11.146.62:32791 requested a full tablet report, sending...
I20260809 15:31:40.456588 21699 ts_manager.cc:194] Registered new tserver with Master: 6076b04ead1345838358a240e07f9263 (127.11.146.1:36045)
I20260809 15:31:40.457736 21699 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.146.1:36727
W20260809 15:31:40.568120 21905 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:40.568382 21905 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:40.568467 21905 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:40.572912 21905 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:40.572966 21905 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:40.573046 21905 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.2
I20260809 15:31:40.577865 21905 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:42361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:32791
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21905
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.2
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:40.578974 21905 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:40.580417 21905 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:40.589946 21913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:40.590061 21905 server_base.cc:1034] running on GCE node
W20260809 15:31:40.589993 21911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:40.589993 21910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:40.590641 21905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:40.591276 21905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:40.592494 21905 hybrid_clock.cc:648] HybridClock initialized: now 1786289500592469 us; error 34 us; skew 500 ppm
I20260809 15:31:40.594452 21905 webserver.cc:460] Webserver started at http://127.11.146.2:41425/ using document root <none> and password file <none>
I20260809 15:31:40.595016 21905 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:40.595083 21905 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:40.595261 21905 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:40.597491 21905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/data/instance:
uuid: "62f5ca7abebb4c8c91d9ea9fc3cc0e79"
format_stamp: "Formatted at 2026-08-09 15:31:40 on dist-test-slave-1jjb"
server_key: "09c94c18e50610ccf0fedd5811b2c5b2"
server_key_iv: "99c51d9e723a0cda44f503925bd62bb2"
server_key_version: "encryptionkey@0"
I20260809 15:31:40.597999 21905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance:
uuid: "62f5ca7abebb4c8c91d9ea9fc3cc0e79"
format_stamp: "Formatted at 2026-08-09 15:31:40 on dist-test-slave-1jjb"
server_key: "09c94c18e50610ccf0fedd5811b2c5b2"
server_key_iv: "99c51d9e723a0cda44f503925bd62bb2"
server_key_version: "encryptionkey@0"
I20260809 15:31:40.601836 21905 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 15:31:40.604305 21919 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:40.605526 21905 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:31:40.605654 21905 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/wal
uuid: "62f5ca7abebb4c8c91d9ea9fc3cc0e79"
format_stamp: "Formatted at 2026-08-09 15:31:40 on dist-test-slave-1jjb"
server_key: "09c94c18e50610ccf0fedd5811b2c5b2"
server_key_iv: "99c51d9e723a0cda44f503925bd62bb2"
server_key_version: "encryptionkey@0"
I20260809 15:31:40.605784 21905 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:40.632681 21905 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:40.633472 21905 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:40.633699 21905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:40.634366 21905 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:31:40.635471 21905 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:40.635679 21905 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:40.635776 21905 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:40.635831 21905 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:40.646950 21905 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.2:33285
I20260809 15:31:40.646971 22038 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.2:33285 every 8 connection(s)
I20260809 15:31:40.647989 21905 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
I20260809 15:31:40.653627 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 21905
I20260809 15:31:40.653784 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance
I20260809 15:31:40.654155 11848 external_mini_cluster.cc:1428] Setting key 23e36632cf2c3ae6dad4f7723b98ef98
I20260809 15:31:40.656455 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.3:0
--local_ip_for_outbound_sockets=127.11.146.3
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:32791
--builtin_ntp_servers=127.11.146.20:42361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 15:31:40.659699 21744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:40.650057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:50309 (local address 127.11.146.62:32791)
0809 15:31:40.650259 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:40.650265 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:40.652296 (+ 2031us) server_negotiation.cc:407] Connection header received
0809 15:31:40.653768 (+ 1472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:40.653771 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:40.653834 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:40.653961 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:40.655201 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:40.656021 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:40.657398 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:40.657619 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:40.657737 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:40.659103 (+ 1366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:40.659106 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:40.659108 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:31:40.659122 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:40.659144 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:31:40.659153 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:40.659218 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:40.659415 (+ 197us) server_negotiation.cc:299] Negotiation successful
0809 15:31:40.659470 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 15:31:40.660768 22042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:40.650555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:32791 (local address 127.11.146.2:50309)
0809 15:31:40.652052 (+ 1497us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:40.652172 (+ 120us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:40.653546 (+ 1374us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:40.654193 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:40.654203 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:40.654327 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:40.654952 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:40.654972 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:40.656231 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:40.656235 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:40.657259 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:40.657269 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:40.657784 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:40.657788 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:40.657978 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:40.658754 (+ 776us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:31:40.658757 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:40.658820 (+ 63us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:31:40.658926 (+ 106us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:40.659247 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:40.659258 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:40.659265 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 15:31:40.659413 (+ 148us) client_negotiation.cc:240] Negotiation successful
0809 15:31:40.659890 (+ 477us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":889,"thread_start_us":148,"threads_started":1}
I20260809 15:31:40.662027 22039 heartbeater.cc:347] Connected to a master server at 127.11.146.62:32791
I20260809 15:31:40.662292 22039 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:40.662901 22039 heartbeater.cc:511] Master 127.11.146.62:32791 requested a full tablet report, sending...
I20260809 15:31:40.664062 21699 ts_manager.cc:194] Registered new tserver with Master: 62f5ca7abebb4c8c91d9ea9fc3cc0e79 (127.11.146.2:33285)
I20260809 15:31:40.665015 21699 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.146.2:50309
W20260809 15:31:40.773376 22043 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:40.773669 22043 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:40.773705 22043 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:40.777697 22043 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:40.777757 22043 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:40.777810 22043 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.3
I20260809 15:31:40.782506 22043 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:42361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:32791
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22043
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.3
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:40.783604 22043 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:40.785014 22043 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 15:31:40.795243 22043 server_base.cc:1034] running on GCE node
W20260809 15:31:40.795169 22049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:40.795171 22048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:40.795149 22052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:40.795904 22043 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:40.796628 22043 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:40.797847 22043 hybrid_clock.cc:648] HybridClock initialized: now 1786289500797812 us; error 48 us; skew 500 ppm
I20260809 15:31:40.799835 22043 webserver.cc:460] Webserver started at http://127.11.146.3:38373/ using document root <none> and password file <none>
I20260809 15:31:40.800549 22043 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:40.800650 22043 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:40.800879 22043 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:40.803027 22043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/data/instance:
uuid: "561fb1e9745441dbab14dd08774588d8"
format_stamp: "Formatted at 2026-08-09 15:31:40 on dist-test-slave-1jjb"
server_key: "e7f480543dcaab773e39611d360cacc7"
server_key_iv: "afed77edf2b7386784d980c7f064ac18"
server_key_version: "encryptionkey@0"
I20260809 15:31:40.803853 22043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance:
uuid: "561fb1e9745441dbab14dd08774588d8"
format_stamp: "Formatted at 2026-08-09 15:31:40 on dist-test-slave-1jjb"
server_key: "e7f480543dcaab773e39611d360cacc7"
server_key_iv: "afed77edf2b7386784d980c7f064ac18"
server_key_version: "encryptionkey@0"
I20260809 15:31:40.807981 22043 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260809 15:31:40.811041 22058 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:40.812584 22043 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:31:40.812728 22043 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/wal
uuid: "561fb1e9745441dbab14dd08774588d8"
format_stamp: "Formatted at 2026-08-09 15:31:40 on dist-test-slave-1jjb"
server_key: "e7f480543dcaab773e39611d360cacc7"
server_key_iv: "afed77edf2b7386784d980c7f064ac18"
server_key_version: "encryptionkey@0"
I20260809 15:31:40.812858 22043 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:40.830379 22043 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:40.831151 22043 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:40.831362 22043 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:40.832218 22043 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:31:40.833264 22043 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:40.833316 22043 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:40.833359 22043 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:40.833429 22043 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:40.842196 22043 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.3:45785
I20260809 15:31:40.842258 22182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.3:45785 every 8 connection(s)
I20260809 15:31:40.843308 22043 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
I20260809 15:31:40.844756 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 22043
I20260809 15:31:40.844851 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance
I20260809 15:31:40.845161 11848 external_mini_cluster.cc:1428] Setting key cddeaa7e17e0815d14134b371c2686ed
I20260809 15:31:40.853533 21744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:40.845708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:57871 (local address 127.11.146.62:32791)
0809 15:31:40.845853 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:40.845858 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:40.847075 (+ 1217us) server_negotiation.cc:407] Connection header received
0809 15:31:40.848615 (+ 1540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:40.848619 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:40.848674 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:40.848753 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:40.849659 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:40.850217 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:40.851414 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:40.851770 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:40.851919 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:40.853020 (+ 1101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:40.853024 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:40.853027 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:31:40.853041 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:40.853066 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:31:40.853074 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:40.853153 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:40.853327 (+ 174us) server_negotiation.cc:299] Negotiation successful
0809 15:31:40.853389 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 15:31:40.854398 22185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:40.846194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:32791 (local address 127.11.146.3:57871)
0809 15:31:40.846934 (+ 740us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:40.846974 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:40.848411 (+ 1437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:40.848922 (+ 511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:40.848928 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:40.849009 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:40.849515 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:40.849528 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:40.850384 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:40.850387 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:40.851272 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:40.851282 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:40.851956 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:40.851961 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:40.852187 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:40.852740 (+ 553us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:31:40.852741 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:40.852780 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:31:40.852845 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:40.853169 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:40.853178 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:40.853189 (+ 11us) client_negotiation.cc:769] Sending connection context
0809 15:31:40.853312 (+ 123us) client_negotiation.cc:240] Negotiation successful
0809 15:31:40.853618 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":139,"threads_started":1}
I20260809 15:31:40.855556 22183 heartbeater.cc:347] Connected to a master server at 127.11.146.62:32791
I20260809 15:31:40.855795 22183 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:40.856371 22183 heartbeater.cc:511] Master 127.11.146.62:32791 requested a full tablet report, sending...
I20260809 15:31:40.857513 21699 ts_manager.cc:194] Registered new tserver with Master: 561fb1e9745441dbab14dd08774588d8 (127.11.146.3:45785)
I20260809 15:31:40.858263 21699 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.146.3:57871
I20260809 15:31:40.859378 11848 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 15:31:40.862622 21744 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:40.861663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48040 (local address 127.11.146.62:32791)
0809 15:31:40.861793 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:40.861796 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:40.862036 (+ 240us) server_negotiation.cc:407] Connection header received
0809 15:31:40.862102 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:40.862104 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:40.862146 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:40.862215 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:40.862503 (+ 288us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48040: BlockingRecv error: recv got EOF from 127.0.0.1:48040 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 15:31:40.862962 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 21765
I20260809 15:31:40.876677 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 21905
I20260809 15:31:40.885156 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 22043
I20260809 15:31:40.891837 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 21667
2026-08-09T15:31:40Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (971 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-09T15:31:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:31:40Z Disabled control of system clock
I20260809 15:31:40.925629 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:45631
--webserver_interface=127.11.146.62
--webserver_port=0
--builtin_ntp_servers=127.11.146.20:44161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:45631
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 15:31:41.039701 22195 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:41.039996 22195 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:41.040035 22195 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:41.044147 22195 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:31:41.044204 22195 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:41.044219 22195 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:41.044236 22195 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:31:41.044251 22195 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:31:41.049297 22195 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:44161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:45631
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:45631
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22195
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:41.050434 22195 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:41.051906 22195 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:41.060439 22203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:41.060451 22200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:41.060627 22195 server_base.cc:1034] running on GCE node
W20260809 15:31:41.060451 22201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:41.061365 22195 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:41.062453 22195 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:41.063714 22195 hybrid_clock.cc:648] HybridClock initialized: now 1786289501063699 us; error 25 us; skew 500 ppm
I20260809 15:31:41.065683 22195 webserver.cc:460] Webserver started at http://127.11.146.62:34445/ using document root <none> and password file <none>
I20260809 15:31:41.066290 22195 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:41.066395 22195 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:41.066640 22195 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:41.068842 22195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "1547ba922f084e69bb206a3d9df04766"
format_stamp: "Formatted at 2026-08-09 15:31:41 on dist-test-slave-1jjb"
server_key: "c7173e830f66a48709336f5ad79d44ee"
server_key_iv: "cd5b3bfef5238e67978d6edac6491146"
server_key_version: "encryptionkey@0"
I20260809 15:31:41.069442 22195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "1547ba922f084e69bb206a3d9df04766"
format_stamp: "Formatted at 2026-08-09 15:31:41 on dist-test-slave-1jjb"
server_key: "c7173e830f66a48709336f5ad79d44ee"
server_key_iv: "cd5b3bfef5238e67978d6edac6491146"
server_key_version: "encryptionkey@0"
I20260809 15:31:41.073987 22195 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 15:31:41.076572 22209 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:41.077807 22195 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:31:41.077975 22195 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "1547ba922f084e69bb206a3d9df04766"
format_stamp: "Formatted at 2026-08-09 15:31:41 on dist-test-slave-1jjb"
server_key: "c7173e830f66a48709336f5ad79d44ee"
server_key_iv: "cd5b3bfef5238e67978d6edac6491146"
server_key_version: "encryptionkey@0"
I20260809 15:31:41.078104 22195 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:41.083009 22195 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:41.083637 22195 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:41.083837 22195 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:41.091116 22195 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:45631
I20260809 15:31:41.091122 22266 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:45631 every 8 connection(s)
I20260809 15:31:41.092263 22195 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:31:41.095794 22267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:41.101632 22267 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1547ba922f084e69bb206a3d9df04766: Bootstrap starting.
I20260809 15:31:41.102131 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 22195
I20260809 15:31:41.102259 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:31:41.102584 11848 external_mini_cluster.cc:1428] Setting key ed3d14a9254c8ead23194570fdb76ec4
I20260809 15:31:41.104627 22267 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1547ba922f084e69bb206a3d9df04766: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:41.105406 22267 log.cc:824] T 00000000000000000000000000000000 P 1547ba922f084e69bb206a3d9df04766: Log is configured to *not* fsync() on all Append() calls
I20260809 15:31:41.108038 22267 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1547ba922f084e69bb206a3d9df04766: No bootstrap required, opened a new log
I20260809 15:31:41.108721 22270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:41.104021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50244 (local address 127.11.146.62:45631)
0809 15:31:41.104749 (+ 728us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:41.104774 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:41.104810 (+ 36us) server_negotiation.cc:407] Connection header received
0809 15:31:41.105435 (+ 625us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:41.105451 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:41.105925 (+ 474us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:41.106300 (+ 375us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:41.107206 (+ 906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:41.107211 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:41.107223 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:31:41.107233 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:41.107300 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:31:41.107335 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:41.107423 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:41.107585 (+ 162us) server_negotiation.cc:299] Negotiation successful
0809 15:31:41.107817 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":155,"threads_started":1}
I20260809 15:31:41.112370 22267 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1547ba922f084e69bb206a3d9df04766 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1547ba922f084e69bb206a3d9df04766" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 45631 } }
I20260809 15:31:41.112627 22267 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1547ba922f084e69bb206a3d9df04766 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:41.112694 22267 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1547ba922f084e69bb206a3d9df04766 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1547ba922f084e69bb206a3d9df04766, State: Initialized, Role: FOLLOWER
I20260809 15:31:41.113126 22267 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1547ba922f084e69bb206a3d9df04766 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1547ba922f084e69bb206a3d9df04766" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 45631 } }
I20260809 15:31:41.113255 22267 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1547ba922f084e69bb206a3d9df04766 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:31:41.113348 22267 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1547ba922f084e69bb206a3d9df04766 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:31:41.113492 22267 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1547ba922f084e69bb206a3d9df04766 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:41.114490 22267 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1547ba922f084e69bb206a3d9df04766 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1547ba922f084e69bb206a3d9df04766" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 45631 } }
I20260809 15:31:41.114863 22267 leader_election.cc:302] T 00000000000000000000000000000000 P 1547ba922f084e69bb206a3d9df04766 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1547ba922f084e69bb206a3d9df04766; no voters:
I20260809 15:31:41.115196 22267 leader_election.cc:288] T 00000000000000000000000000000000 P 1547ba922f084e69bb206a3d9df04766 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:31:41.115336 22272 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1547ba922f084e69bb206a3d9df04766 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:31:41.115653 22272 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1547ba922f084e69bb206a3d9df04766 [term 1 LEADER]: Becoming Leader. State: Replica: 1547ba922f084e69bb206a3d9df04766, State: Running, Role: LEADER
I20260809 15:31:41.116040 22272 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1547ba922f084e69bb206a3d9df04766 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1547ba922f084e69bb206a3d9df04766" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 45631 } }
I20260809 15:31:41.116614 22267 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1547ba922f084e69bb206a3d9df04766 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:31:41.117911 22275 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1547ba922f084e69bb206a3d9df04766 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1547ba922f084e69bb206a3d9df04766. Latest consensus state: current_term: 1 leader_uuid: "1547ba922f084e69bb206a3d9df04766" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1547ba922f084e69bb206a3d9df04766" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 45631 } } }
I20260809 15:31:41.117911 22274 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1547ba922f084e69bb206a3d9df04766 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1547ba922f084e69bb206a3d9df04766" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1547ba922f084e69bb206a3d9df04766" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 45631 } } }
I20260809 15:31:41.118083 22274 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1547ba922f084e69bb206a3d9df04766 [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:41.118083 22275 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1547ba922f084e69bb206a3d9df04766 [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:41.118683 22282 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:31:41.121471 22282 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:31:41.127727 22282 catalog_manager.cc:1347] Generated new cluster ID: 787c3dabded642c1be21b99f02a6abaf
I20260809 15:31:41.127803 22282 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:31:41.137965 22282 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:31:41.138312 22282 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:31:41.143535 22282 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1547ba922f084e69bb206a3d9df04766: Generated new TSK 0
I20260809 15:31:41.144400 22282 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:31:41.148334 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.1:0
--local_ip_for_outbound_sockets=127.11.146.1
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:45631
--builtin_ntp_servers=127.11.146.20:44161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 15:31:41.270658 22292 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:41.271057 22292 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:41.271145 22292 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:41.275282 22292 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:41.275352 22292 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:41.275444 22292 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.1
I20260809 15:31:41.280287 22292 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:44161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:45631
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22292
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.1
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:41.281488 22292 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:41.283088 22292 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:41.293341 22298 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:41.293351 22299 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:41.293572 22292 server_base.cc:1034] running on GCE node
W20260809 15:31:41.293392 22301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:41.294088 22292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:41.294715 22292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:41.295910 22292 hybrid_clock.cc:648] HybridClock initialized: now 1786289501295890 us; error 30 us; skew 500 ppm
I20260809 15:31:41.297955 22292 webserver.cc:460] Webserver started at http://127.11.146.1:46861/ using document root <none> and password file <none>
I20260809 15:31:41.298573 22292 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:41.298637 22292 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:41.298885 22292 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:41.301066 22292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/data/instance:
uuid: "1251455ab0f24257a7e22861c47960d8"
format_stamp: "Formatted at 2026-08-09 15:31:41 on dist-test-slave-1jjb"
server_key: "f151a1c147f038bb24d18531dbe4a14d"
server_key_iv: "61fe38ce8bed5982487d93717b1b6d6a"
server_key_version: "encryptionkey@0"
I20260809 15:31:41.301759 22292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance:
uuid: "1251455ab0f24257a7e22861c47960d8"
format_stamp: "Formatted at 2026-08-09 15:31:41 on dist-test-slave-1jjb"
server_key: "f151a1c147f038bb24d18531dbe4a14d"
server_key_iv: "61fe38ce8bed5982487d93717b1b6d6a"
server_key_version: "encryptionkey@0"
I20260809 15:31:41.305830 22292 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 15:31:41.308496 22307 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:41.309685 22292 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:31:41.309829 22292 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/wal
uuid: "1251455ab0f24257a7e22861c47960d8"
format_stamp: "Formatted at 2026-08-09 15:31:41 on dist-test-slave-1jjb"
server_key: "f151a1c147f038bb24d18531dbe4a14d"
server_key_iv: "61fe38ce8bed5982487d93717b1b6d6a"
server_key_version: "encryptionkey@0"
I20260809 15:31:41.309949 22292 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:41.314718 22292 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:41.315455 22292 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:41.315683 22292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:41.316396 22292 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:31:41.317466 22292 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:41.317550 22292 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:41.317617 22292 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:41.317669 22292 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:41.326987 22292 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.1:34209
I20260809 15:31:41.327023 22430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.1:34209 every 8 connection(s)
I20260809 15:31:41.327945 22292 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
I20260809 15:31:41.334750 22270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:41.330057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:45419 (local address 127.11.146.62:45631)
0809 15:31:41.330267 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:41.330273 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:41.331463 (+ 1190us) server_negotiation.cc:407] Connection header received
0809 15:31:41.332913 (+ 1450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:41.332916 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:41.332958 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:41.333045 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:41.334218 (+ 1173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:41.334222 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:41.334224 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:31:41.334236 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:41.334264 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:31:41.334273 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:41.334367 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:41.334590 (+ 223us) server_negotiation.cc:299] Negotiation successful
0809 15:31:41.334633 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260809 15:31:41.335739 22433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:41.330483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:45631 (local address 127.11.146.1:45419)
0809 15:31:41.331236 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:41.331278 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:41.332678 (+ 1400us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:41.333217 (+ 539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:41.333224 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:41.333312 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:41.333920 (+ 608us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:31:41.333922 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:41.333964 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:31:41.334034 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:41.334392 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:41.334401 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:41.334406 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 15:31:41.334588 (+ 182us) client_negotiation.cc:240] Negotiation successful
0809 15:31:41.334786 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":133,"threads_started":1}
I20260809 15:31:41.336370 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 22292
I20260809 15:31:41.336467 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance
I20260809 15:31:41.336817 11848 external_mini_cluster.cc:1428] Setting key db7b8beb6dda12910efbaf1bf1ce8b67
I20260809 15:31:41.337255 22431 heartbeater.cc:347] Connected to a master server at 127.11.146.62:45631
I20260809 15:31:41.337507 22431 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:41.338027 22431 heartbeater.cc:511] Master 127.11.146.62:45631 requested a full tablet report, sending...
I20260809 15:31:41.339035 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.2:0
--local_ip_for_outbound_sockets=127.11.146.2
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:45631
--builtin_ntp_servers=127.11.146.20:44161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260809 15:31:41.339911 22226 ts_manager.cc:194] Registered new tserver with Master: 1251455ab0f24257a7e22861c47960d8 (127.11.146.1:34209)
W20260809 15:31:41.459949 22434 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:41.460345 22434 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:41.460422 22434 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:41.464502 22434 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:41.464555 22434 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:41.464639 22434 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.2
I20260809 15:31:41.469460 22434 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:44161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:45631
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22434
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.2
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:41.470760 22434 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:41.472723 22434 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:41.484813 22441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:41.484864 22434 server_base.cc:1034] running on GCE node
W20260809 15:31:41.485095 22442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:41.485152 22444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:41.485599 22434 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:41.486249 22434 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:41.487453 22434 hybrid_clock.cc:648] HybridClock initialized: now 1786289501487432 us; error 31 us; skew 500 ppm
I20260809 15:31:41.489611 22434 webserver.cc:460] Webserver started at http://127.11.146.2:43305/ using document root <none> and password file <none>
I20260809 15:31:41.490213 22434 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:41.490311 22434 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:41.490530 22434 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:41.492935 22434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/data/instance:
uuid: "7a43e068063343bcb7568c8ff79b371a"
format_stamp: "Formatted at 2026-08-09 15:31:41 on dist-test-slave-1jjb"
server_key: "90a4f266569ec069c96ba3fb4636636f"
server_key_iv: "d484a8d2f012de66c10075696ee4f2f9"
server_key_version: "encryptionkey@0"
I20260809 15:31:41.493527 22434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance:
uuid: "7a43e068063343bcb7568c8ff79b371a"
format_stamp: "Formatted at 2026-08-09 15:31:41 on dist-test-slave-1jjb"
server_key: "90a4f266569ec069c96ba3fb4636636f"
server_key_iv: "d484a8d2f012de66c10075696ee4f2f9"
server_key_version: "encryptionkey@0"
I20260809 15:31:41.497577 22434 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 15:31:41.500609 22450 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:41.501956 22434 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:31:41.502108 22434 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/wal
uuid: "7a43e068063343bcb7568c8ff79b371a"
format_stamp: "Formatted at 2026-08-09 15:31:41 on dist-test-slave-1jjb"
server_key: "90a4f266569ec069c96ba3fb4636636f"
server_key_iv: "d484a8d2f012de66c10075696ee4f2f9"
server_key_version: "encryptionkey@0"
I20260809 15:31:41.502241 22434 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:41.507194 22434 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:41.507855 22434 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:41.508056 22434 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:41.508656 22434 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:31:41.509588 22434 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:41.509644 22434 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:41.509689 22434 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:41.509706 22434 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:41.520134 22434 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.2:38349
I20260809 15:31:41.520320 22576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.2:38349 every 8 connection(s)
I20260809 15:31:41.521166 22434 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
I20260809 15:31:41.527870 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 22434
I20260809 15:31:41.528020 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance
I20260809 15:31:41.528141 22270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:41.523153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:50781 (local address 127.11.146.62:45631)
0809 15:31:41.523314 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:41.523317 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:41.524597 (+ 1280us) server_negotiation.cc:407] Connection header received
0809 15:31:41.525927 (+ 1330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:41.525930 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:41.525973 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:41.526064 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:41.527440 (+ 1376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:41.527445 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:41.527448 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:31:41.527462 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:41.527490 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:31:41.527503 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:41.527772 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:41.527906 (+ 134us) server_negotiation.cc:299] Negotiation successful
0809 15:31:41.527959 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 15:31:41.528399 11848 external_mini_cluster.cc:1428] Setting key ba8ed84c7cb4ea43e34189d16c1c4945
I20260809 15:31:41.529238 22580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:41.523615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:45631 (local address 127.11.146.2:50781)
0809 15:31:41.524415 (+ 800us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:41.524458 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:41.525697 (+ 1239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:41.526288 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:41.526295 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:41.526409 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:41.527119 (+ 710us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:31:41.527120 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:41.527162 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:31:41.527233 (+ 71us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:41.527737 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:41.527746 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:41.527751 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 15:31:41.527914 (+ 163us) client_negotiation.cc:240] Negotiation successful
0809 15:31:41.528281 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":109,"threads_started":1}
I20260809 15:31:41.530460 22577 heartbeater.cc:347] Connected to a master server at 127.11.146.62:45631
I20260809 15:31:41.530551 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.3:0
--local_ip_for_outbound_sockets=127.11.146.3
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:45631
--builtin_ntp_servers=127.11.146.20:44161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260809 15:31:41.530711 22577 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:41.531133 22577 heartbeater.cc:511] Master 127.11.146.62:45631 requested a full tablet report, sending...
I20260809 15:31:41.532436 22226 ts_manager.cc:194] Registered new tserver with Master: 7a43e068063343bcb7568c8ff79b371a (127.11.146.2:38349)
W20260809 15:31:41.652527 22581 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:41.652817 22581 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:41.652858 22581 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:41.657052 22581 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:41.657130 22581 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:41.657189 22581 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.3
I20260809 15:31:41.662460 22581 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:44161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:45631
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22581
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.3
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:41.663726 22581 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:41.665275 22581 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:41.675597 22587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:41.675696 22586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:41.675652 22589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:41.675916 22581 server_base.cc:1034] running on GCE node
I20260809 15:31:41.676468 22581 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:41.677069 22581 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:41.678267 22581 hybrid_clock.cc:648] HybridClock initialized: now 1786289501678241 us; error 34 us; skew 500 ppm
I20260809 15:31:41.680474 22581 webserver.cc:460] Webserver started at http://127.11.146.3:40647/ using document root <none> and password file <none>
I20260809 15:31:41.681138 22581 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:41.681209 22581 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:41.681504 22581 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:41.683903 22581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/data/instance:
uuid: "84f335dffede404d9afee4167559c250"
format_stamp: "Formatted at 2026-08-09 15:31:41 on dist-test-slave-1jjb"
server_key: "f60c40e12a1b49f96a0c76102f0ccc4c"
server_key_iv: "e998c4e12f5640cceb2f1c29089e4cc4"
server_key_version: "encryptionkey@0"
I20260809 15:31:41.684614 22581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance:
uuid: "84f335dffede404d9afee4167559c250"
format_stamp: "Formatted at 2026-08-09 15:31:41 on dist-test-slave-1jjb"
server_key: "f60c40e12a1b49f96a0c76102f0ccc4c"
server_key_iv: "e998c4e12f5640cceb2f1c29089e4cc4"
server_key_version: "encryptionkey@0"
I20260809 15:31:41.688726 22581 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 15:31:41.691735 22595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:41.693173 22581 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:31:41.693351 22581 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/wal
uuid: "84f335dffede404d9afee4167559c250"
format_stamp: "Formatted at 2026-08-09 15:31:41 on dist-test-slave-1jjb"
server_key: "f60c40e12a1b49f96a0c76102f0ccc4c"
server_key_iv: "e998c4e12f5640cceb2f1c29089e4cc4"
server_key_version: "encryptionkey@0"
I20260809 15:31:41.693475 22581 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:41.698570 22581 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:41.699203 22581 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:41.699399 22581 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:41.699973 22581 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:31:41.700954 22581 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:41.701001 22581 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:41.701074 22581 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:41.701109 22581 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:41.711000 22581 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.3:32959
I20260809 15:31:41.711030 22719 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.3:32959 every 8 connection(s)
I20260809 15:31:41.711966 22581 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
I20260809 15:31:41.718979 22270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:41.714028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:50483 (local address 127.11.146.62:45631)
0809 15:31:41.714187 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:41.714192 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:41.715404 (+ 1212us) server_negotiation.cc:407] Connection header received
0809 15:31:41.717074 (+ 1670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:41.717077 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:41.717119 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:41.717193 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:41.718430 (+ 1237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:41.718433 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:41.718435 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:31:41.718449 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:41.718470 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:31:41.718480 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:41.718562 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:41.718772 (+ 210us) server_negotiation.cc:299] Negotiation successful
0809 15:31:41.718829 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 15:31:41.718994 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 22581
I20260809 15:31:41.719091 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance
I20260809 15:31:41.719373 11848 external_mini_cluster.cc:1428] Setting key dc266acb003163d340265c3a0526e666
I20260809 15:31:41.719884 22723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:41.714509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:45631 (local address 127.11.146.3:50483)
0809 15:31:41.715225 (+ 716us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:41.715269 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:41.716785 (+ 1516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:41.717379 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:41.717385 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:41.717474 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:41.718122 (+ 648us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:31:41.718123 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:41.718165 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:31:41.718237 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:41.718565 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:41.718572 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:41.718577 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 15:31:41.718734 (+ 157us) client_negotiation.cc:240] Negotiation successful
0809 15:31:41.718935 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":114,"threads_started":1}
I20260809 15:31:41.721017 22720 heartbeater.cc:347] Connected to a master server at 127.11.146.62:45631
I20260809 15:31:41.721248 22720 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:41.721683 22720 heartbeater.cc:511] Master 127.11.146.62:45631 requested a full tablet report, sending...
I20260809 15:31:41.722869 22226 ts_manager.cc:194] Registered new tserver with Master: 84f335dffede404d9afee4167559c250 (127.11.146.3:32959)
I20260809 15:31:41.734241 11848 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 15:31:41.737311 22270 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:31:41.736335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50220 (local address 127.11.146.62:45631)
0809 15:31:41.736500 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:41.736503 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:41.736656 (+ 153us) server_negotiation.cc:407] Connection header received
0809 15:31:41.736811 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:41.736814 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:41.736858 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:41.737028 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:41.737201 (+ 173us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50220: BlockingRecv error: recv got EOF from 127.0.0.1:50220 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 15:31:41.737514 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 22292
I20260809 15:31:41.751394 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 22434
I20260809 15:31:41.760987 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 22581
I20260809 15:31:41.769078 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 22195
2026-08-09T15:31:41Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (876 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:31:41 dist-test-slave-1jjb krb5kdc[22731](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:31:41 dist-test-slave-1jjb krb5kdc[22731](info): set up 2 sockets
Aug 09 15:31:41 dist-test-slave-1jjb krb5kdc[22731](info): commencing operation
krb5kdc: starting...
W20260809 15:31:42.878727 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.085s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:31:42 dist-test-slave-1jjb krb5kdc[22731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289502, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:31:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:31:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.146.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
I20260809 15:31:42.999286 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:44575
--webserver_interface=127.11.146.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:42155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:44575
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:31:43.106729 22746 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:43.106947 22746 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:43.106981 22746 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:43.110896 22746 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:31:43.110942 22746 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:43.110961 22746 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:43.110976 22746 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:31:43.110991 22746 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:31:43.115919 22746 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:42155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:44575
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:44575
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22746
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:43.116930 22746 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:43.117873 22746 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:43.126531 22754 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:43.126503 22752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:43.126497 22751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:43.126747 22746 server_base.cc:1034] running on GCE node
I20260809 15:31:43.127331 22746 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:43.128436 22746 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:43.129645 22746 hybrid_clock.cc:648] HybridClock initialized: now 1786289503129627 us; error 33 us; skew 500 ppm
Aug 09 15:31:43 dist-test-slave-1jjb krb5kdc[22731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289503, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:43.132560 22746 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:31:43.133417 22746 webserver.cc:460] Webserver started at http://127.11.146.62:35261/ using document root <none> and password file <none>
I20260809 15:31:43.133966 22746 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:43.134069 22746 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:43.134315 22746 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:43.136454 22746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "eb1dc01d66ee4cdca02e9bc9c5b8e0a4"
format_stamp: "Formatted at 2026-08-09 15:31:43 on dist-test-slave-1jjb"
server_key: "b00811db17987a0528a5fcf55ff0a217"
server_key_iv: "03da52f3966ec3560d27ce10f0037570"
server_key_version: "encryptionkey@0"
I20260809 15:31:43.137085 22746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "eb1dc01d66ee4cdca02e9bc9c5b8e0a4"
format_stamp: "Formatted at 2026-08-09 15:31:43 on dist-test-slave-1jjb"
server_key: "b00811db17987a0528a5fcf55ff0a217"
server_key_iv: "03da52f3966ec3560d27ce10f0037570"
server_key_version: "encryptionkey@0"
I20260809 15:31:43.140765 22746 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 15:31:43.143127 22761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:43.144287 22746 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260809 15:31:43.144428 22746 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "eb1dc01d66ee4cdca02e9bc9c5b8e0a4"
format_stamp: "Formatted at 2026-08-09 15:31:43 on dist-test-slave-1jjb"
server_key: "b00811db17987a0528a5fcf55ff0a217"
server_key_iv: "03da52f3966ec3560d27ce10f0037570"
server_key_version: "encryptionkey@0"
I20260809 15:31:43.144563 22746 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:43.179919 22746 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:43.183300 22746 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:43.183521 22746 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:43.190965 22746 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:44575
I20260809 15:31:43.191267 22817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:44575 every 8 connection(s)
I20260809 15:31:43.191919 22746 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:31:43.194712 22818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:43.195295 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 22746
I20260809 15:31:43.195433 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:31:43.195705 11848 external_mini_cluster.cc:1428] Setting key 9a223bf13db2502f028fd6df75da883d
I20260809 15:31:43.201200 22818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb1dc01d66ee4cdca02e9bc9c5b8e0a4: Bootstrap starting.
I20260809 15:31:43.203701 22818 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eb1dc01d66ee4cdca02e9bc9c5b8e0a4: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:43.204517 22818 log.cc:824] T 00000000000000000000000000000000 P eb1dc01d66ee4cdca02e9bc9c5b8e0a4: Log is configured to *not* fsync() on all Append() calls
Aug 09 15:31:43 dist-test-slave-1jjb krb5kdc[22731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289502, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:31:43.206558 22818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb1dc01d66ee4cdca02e9bc9c5b8e0a4: No bootstrap required, opened a new log
I20260809 15:31:43.210017 22821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:43.197132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42556 (local address 127.11.146.62:44575)
0809 15:31:43.197587 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:43.197607 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:43.197648 (+ 41us) server_negotiation.cc:407] Connection header received
0809 15:31:43.198451 (+ 803us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:43.198473 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:43.198862 (+ 389us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:43.199202 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:43.199849 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:43.201294 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:43.202183 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:43.202846 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:43.203013 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:43.205610 (+ 2597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:43.205614 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:43.205626 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:43.205652 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:43.207312 (+ 1660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:43.207757 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:43.207768 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:43.207772 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:43.207877 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:43.208211 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:43.208215 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:43.208216 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:43.208579 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:43.208771 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:43.209094 (+ 323us) server_negotiation.cc:299] Negotiation successful
0809 15:31:43.209362 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":118,"threads_started":1}
I20260809 15:31:43.210172 22818 raft_consensus.cc:348] T 00000000000000000000000000000000 P eb1dc01d66ee4cdca02e9bc9c5b8e0a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb1dc01d66ee4cdca02e9bc9c5b8e0a4" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44575 } }
I20260809 15:31:43.210448 22818 raft_consensus.cc:374] T 00000000000000000000000000000000 P eb1dc01d66ee4cdca02e9bc9c5b8e0a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:43.210525 22818 raft_consensus.cc:729] T 00000000000000000000000000000000 P eb1dc01d66ee4cdca02e9bc9c5b8e0a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb1dc01d66ee4cdca02e9bc9c5b8e0a4, State: Initialized, Role: FOLLOWER
I20260809 15:31:43.210917 22818 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb1dc01d66ee4cdca02e9bc9c5b8e0a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb1dc01d66ee4cdca02e9bc9c5b8e0a4" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44575 } }
I20260809 15:31:43.211090 22818 raft_consensus.cc:388] T 00000000000000000000000000000000 P eb1dc01d66ee4cdca02e9bc9c5b8e0a4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:31:43.211174 22818 raft_consensus.cc:482] T 00000000000000000000000000000000 P eb1dc01d66ee4cdca02e9bc9c5b8e0a4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:31:43.211299 22818 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eb1dc01d66ee4cdca02e9bc9c5b8e0a4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:43.212190 22818 raft_consensus.cc:504] T 00000000000000000000000000000000 P eb1dc01d66ee4cdca02e9bc9c5b8e0a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb1dc01d66ee4cdca02e9bc9c5b8e0a4" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44575 } }
I20260809 15:31:43.212520 22818 leader_election.cc:302] T 00000000000000000000000000000000 P eb1dc01d66ee4cdca02e9bc9c5b8e0a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eb1dc01d66ee4cdca02e9bc9c5b8e0a4; no voters:
I20260809 15:31:43.212809 22818 leader_election.cc:288] T 00000000000000000000000000000000 P eb1dc01d66ee4cdca02e9bc9c5b8e0a4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:31:43.212888 22823 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eb1dc01d66ee4cdca02e9bc9c5b8e0a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:31:43.213147 22823 raft_consensus.cc:686] T 00000000000000000000000000000000 P eb1dc01d66ee4cdca02e9bc9c5b8e0a4 [term 1 LEADER]: Becoming Leader. State: Replica: eb1dc01d66ee4cdca02e9bc9c5b8e0a4, State: Running, Role: LEADER
I20260809 15:31:43.213479 22823 consensus_queue.cc:237] T 00000000000000000000000000000000 P eb1dc01d66ee4cdca02e9bc9c5b8e0a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb1dc01d66ee4cdca02e9bc9c5b8e0a4" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44575 } }
I20260809 15:31:43.213939 22818 sys_catalog.cc:564] T 00000000000000000000000000000000 P eb1dc01d66ee4cdca02e9bc9c5b8e0a4 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:31:43.214941 22824 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb1dc01d66ee4cdca02e9bc9c5b8e0a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eb1dc01d66ee4cdca02e9bc9c5b8e0a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb1dc01d66ee4cdca02e9bc9c5b8e0a4" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44575 } } }
I20260809 15:31:43.215060 22824 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb1dc01d66ee4cdca02e9bc9c5b8e0a4 [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:43.215453 22825 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb1dc01d66ee4cdca02e9bc9c5b8e0a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb1dc01d66ee4cdca02e9bc9c5b8e0a4. Latest consensus state: current_term: 1 leader_uuid: "eb1dc01d66ee4cdca02e9bc9c5b8e0a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb1dc01d66ee4cdca02e9bc9c5b8e0a4" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44575 } } }
I20260809 15:31:43.215593 22825 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb1dc01d66ee4cdca02e9bc9c5b8e0a4 [sys.catalog]: This master's current role is: LEADER
I20260809 15:31:43.216323 22832 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:31:43.218753 22832 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:31:43.223779 22832 catalog_manager.cc:1347] Generated new cluster ID: 5b026d34d6514dd9bf2254ee0918d599
I20260809 15:31:43.223851 22832 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:31:43.233178 22832 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:31:43.233963 22832 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:31:43.240722 22832 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eb1dc01d66ee4cdca02e9bc9c5b8e0a4: Generated new TSK 0
I20260809 15:31:43.241308 22832 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.146.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
I20260809 15:31:43.275851 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.1:0
--local_ip_for_outbound_sockets=127.11.146.1
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:44575
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:42155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:31:43.387853 22845 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:43.388139 22845 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:43.388197 22845 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:43.392273 22845 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:43.392329 22845 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:43.392383 22845 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.1
I20260809 15:31:43.397469 22845 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:42155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:44575
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22845
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.1
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:43.398363 22845 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:43.399253 22845 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:43.408393 22850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:43.408403 22851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:43.408442 22853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:43.408718 22845 server_base.cc:1034] running on GCE node
I20260809 15:31:43.409147 22845 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:43.409744 22845 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:43.410941 22845 hybrid_clock.cc:648] HybridClock initialized: now 1786289503410931 us; error 30 us; skew 500 ppm
Aug 09 15:31:43 dist-test-slave-1jjb krb5kdc[22731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289503, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:43.413676 22845 init.cc:377] Logged in from keytab as kudu/127.11.146.1@KRBTEST.COM (short username kudu)
I20260809 15:31:43.414569 22845 webserver.cc:460] Webserver started at http://127.11.146.1:41997/ using document root <none> and password file <none>
I20260809 15:31:43.415181 22845 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:43.415241 22845 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:43.415397 22845 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:43.417354 22845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/data/instance:
uuid: "1b73ef31c3174773b3246bce37130007"
format_stamp: "Formatted at 2026-08-09 15:31:43 on dist-test-slave-1jjb"
server_key: "6a55db7ffef50c0308a75145792459af"
server_key_iv: "ece5f6857c1481783c0796cd61144cf2"
server_key_version: "encryptionkey@0"
I20260809 15:31:43.417863 22845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance:
uuid: "1b73ef31c3174773b3246bce37130007"
format_stamp: "Formatted at 2026-08-09 15:31:43 on dist-test-slave-1jjb"
server_key: "6a55db7ffef50c0308a75145792459af"
server_key_iv: "ece5f6857c1481783c0796cd61144cf2"
server_key_version: "encryptionkey@0"
I20260809 15:31:43.421311 22845 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 15:31:43.423538 22863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:43.424700 22845 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:31:43.424854 22845 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/wal
uuid: "1b73ef31c3174773b3246bce37130007"
format_stamp: "Formatted at 2026-08-09 15:31:43 on dist-test-slave-1jjb"
server_key: "6a55db7ffef50c0308a75145792459af"
server_key_iv: "ece5f6857c1481783c0796cd61144cf2"
server_key_version: "encryptionkey@0"
I20260809 15:31:43.424966 22845 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:43.439256 22845 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:43.442034 22845 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:43.442222 22845 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:43.442780 22845 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:31:43.443500 22845 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:43.443599 22845 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:43.443657 22845 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:43.443722 22845 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:43.452409 22845 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.1:45389
I20260809 15:31:43.452456 22986 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.1:45389 every 8 connection(s)
I20260809 15:31:43.453236 22845 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
I20260809 15:31:43.462057 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 22845
I20260809 15:31:43.462152 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance
I20260809 15:31:43.462442 11848 external_mini_cluster.cc:1428] Setting key 407ff155d4df2629228d7b6f530e7385
Aug 09 15:31:43 dist-test-slave-1jjb krb5kdc[22731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289503, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:31:43.466979 22821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:43.454860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:53895 (local address 127.11.146.62:44575)
0809 15:31:43.454997 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:43.455000 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:43.455680 (+ 680us) server_negotiation.cc:407] Connection header received
0809 15:31:43.457068 (+ 1388us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:43.457071 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:43.457129 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:43.457232 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:43.458321 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:43.458867 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:43.460170 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:43.460393 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:43.460517 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:43.463071 (+ 2554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:43.463076 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:43.463079 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:43.463104 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:43.464730 (+ 1626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:43.465381 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:43.465386 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:43.465388 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:43.465475 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:43.465829 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:43.465834 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:43.465838 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:43.466090 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:43.466220 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:43.466685 (+ 465us) server_negotiation.cc:299] Negotiation successful
0809 15:31:43.466798 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 15:31:43.467907 22991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:43.455121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:44575 (local address 127.11.146.1:53895)
0809 15:31:43.455534 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:43.455572 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:43.456857 (+ 1285us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:43.457406 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:43.457412 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:43.457736 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:43.458171 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:43.458183 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:43.459006 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:43.459010 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:43.459993 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:43.460003 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:43.460554 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:43.460558 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:43.460787 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:43.461394 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:43.461409 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:43.462921 (+ 1512us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:43.464846 (+ 1925us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:43.464850 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:43.464860 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:43.465279 (+ 419us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:43.465584 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:43.465586 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:43.465588 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:43.465733 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:43.466219 (+ 486us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:43.466225 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:43.466455 (+ 230us) client_negotiation.cc:769] Sending connection context
0809 15:31:43.466645 (+ 190us) client_negotiation.cc:240] Negotiation successful
0809 15:31:43.466940 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":113,"threads_started":1}
I20260809 15:31:43.469214 22987 heartbeater.cc:347] Connected to a master server at 127.11.146.62:44575
I20260809 15:31:43.469480 22987 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:43.470096 22987 heartbeater.cc:511] Master 127.11.146.62:44575 requested a full tablet report, sending...
I20260809 15:31:43.472043 22779 ts_manager.cc:194] Registered new tserver with Master: 1b73ef31c3174773b3246bce37130007 (127.11.146.1:45389)
I20260809 15:31:43.473714 22779 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.1@KRBTEST.COM'} at 127.11.146.1:53895
WARNING: no policy specified for kudu/127.11.146.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
I20260809 15:31:43.494817 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.2:0
--local_ip_for_outbound_sockets=127.11.146.2
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:44575
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:42155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:31:43.603796 22995 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:43.604038 22995 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:43.604135 22995 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:43.608223 22995 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:43.608271 22995 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:43.608376 22995 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.2
I20260809 15:31:43.613507 22995 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:42155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:44575
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22995
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.2
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:43.614506 22995 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:43.615522 22995 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 15:31:43.624955 22995 server_base.cc:1034] running on GCE node
W20260809 15:31:43.624944 23000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:43.624941 23001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:43.625180 23003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:43.625609 22995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:43.626191 22995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:43.627379 22995 hybrid_clock.cc:648] HybridClock initialized: now 1786289503627356 us; error 39 us; skew 500 ppm
Aug 09 15:31:43 dist-test-slave-1jjb krb5kdc[22731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289503, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:43.630117 22995 init.cc:377] Logged in from keytab as kudu/127.11.146.2@KRBTEST.COM (short username kudu)
I20260809 15:31:43.630928 22995 webserver.cc:460] Webserver started at http://127.11.146.2:41613/ using document root <none> and password file <none>
I20260809 15:31:43.631457 22995 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:43.631547 22995 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:43.631768 22995 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:43.633702 22995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/data/instance:
uuid: "49fabad32d4e4d21b0452d14a2aedb0d"
format_stamp: "Formatted at 2026-08-09 15:31:43 on dist-test-slave-1jjb"
server_key: "196d7e3143bc74d76ea37a97682b5025"
server_key_iv: "c30fb0265cf9051b6f4646a3996e5b23"
server_key_version: "encryptionkey@0"
I20260809 15:31:43.634254 22995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance:
uuid: "49fabad32d4e4d21b0452d14a2aedb0d"
format_stamp: "Formatted at 2026-08-09 15:31:43 on dist-test-slave-1jjb"
server_key: "196d7e3143bc74d76ea37a97682b5025"
server_key_iv: "c30fb0265cf9051b6f4646a3996e5b23"
server_key_version: "encryptionkey@0"
I20260809 15:31:43.637703 22995 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 15:31:43.639950 23013 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:43.641115 22995 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:31:43.641250 22995 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/wal
uuid: "49fabad32d4e4d21b0452d14a2aedb0d"
format_stamp: "Formatted at 2026-08-09 15:31:43 on dist-test-slave-1jjb"
server_key: "196d7e3143bc74d76ea37a97682b5025"
server_key_iv: "c30fb0265cf9051b6f4646a3996e5b23"
server_key_version: "encryptionkey@0"
I20260809 15:31:43.641355 22995 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:43.668862 22995 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:43.671523 22995 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:43.671729 22995 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:43.672379 22995 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:31:43.673214 22995 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:43.673287 22995 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:43.673354 22995 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:43.673408 22995 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:43.682503 22995 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.2:35985
I20260809 15:31:43.682541 23132 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.2:35985 every 8 connection(s)
I20260809 15:31:43.683312 22995 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
I20260809 15:31:43.691304 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 22995
I20260809 15:31:43.691432 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance
I20260809 15:31:43.691696 11848 external_mini_cluster.cc:1428] Setting key 3347541b69965efd448950bd42017a0f
Aug 09 15:31:43 dist-test-slave-1jjb krb5kdc[22731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289503, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:31:43.697214 22821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:43.685057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:55601 (local address 127.11.146.62:44575)
0809 15:31:43.685199 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:43.685203 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:43.686010 (+ 807us) server_negotiation.cc:407] Connection header received
0809 15:31:43.687333 (+ 1323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:43.687337 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:43.687395 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:43.687478 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:43.688678 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:43.689228 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:43.690358 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:43.690575 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:43.690689 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:43.693528 (+ 2839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:43.693531 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:43.693533 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:43.693556 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:43.694947 (+ 1391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:43.695558 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:43.695565 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:43.695569 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:43.695663 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:43.695985 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:43.695990 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:43.695994 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:43.696280 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:43.696383 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:43.696835 (+ 452us) server_negotiation.cc:299] Negotiation successful
0809 15:31:43.696978 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 15:31:43.697750 23135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:43.685394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:44575 (local address 127.11.146.2:55601)
0809 15:31:43.685871 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:43.685909 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:43.687132 (+ 1223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:43.687658 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:43.687664 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:43.687985 (+ 321us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:43.688516 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:43.688530 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:43.689360 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:43.689364 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:43.690212 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:43.690222 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:43.690724 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:43.690728 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:43.690888 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:43.691548 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:43.691572 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:43.693325 (+ 1753us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:43.695064 (+ 1739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:43.695072 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:43.695089 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:43.695450 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:43.695759 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:43.695761 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:43.695762 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:43.695881 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:43.696394 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:43.696399 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:43.696604 (+ 205us) client_negotiation.cc:769] Sending connection context
0809 15:31:43.696750 (+ 146us) client_negotiation.cc:240] Negotiation successful
0809 15:31:43.696981 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":138,"threads_started":1}
I20260809 15:31:43.698943 23133 heartbeater.cc:347] Connected to a master server at 127.11.146.62:44575
I20260809 15:31:43.699167 23133 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:43.699602 23133 heartbeater.cc:511] Master 127.11.146.62:44575 requested a full tablet report, sending...
I20260809 15:31:43.700647 22779 ts_manager.cc:194] Registered new tserver with Master: 49fabad32d4e4d21b0452d14a2aedb0d (127.11.146.2:35985)
I20260809 15:31:43.701449 22779 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.2@KRBTEST.COM'} at 127.11.146.2:55601
WARNING: no policy specified for kudu/127.11.146.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
I20260809 15:31:43.720890 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.3:0
--local_ip_for_outbound_sockets=127.11.146.3
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:44575
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:42155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:31:43.827971 23139 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:31:43.828258 23139 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:31:43.828333 23139 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:31:43.832441 23139 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:31:43.832489 23139 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:31:43.832593 23139 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.3
I20260809 15:31:43.837366 23139 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:42155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:44575
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23139
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.3
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:31:43.838270 23139 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:31:43.839231 23139 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:31:43.848131 23148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:43.848280 23150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:31:43.848071 23146 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:31:43.848095 23139 server_base.cc:1034] running on GCE node
I20260809 15:31:43.848704 23139 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:31:43.849291 23139 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:31:43.850481 23139 hybrid_clock.cc:648] HybridClock initialized: now 1786289503850470 us; error 25 us; skew 500 ppm
Aug 09 15:31:43 dist-test-slave-1jjb krb5kdc[22731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289503, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:31:43.857256 23139 init.cc:377] Logged in from keytab as kudu/127.11.146.3@KRBTEST.COM (short username kudu)
I20260809 15:31:43.858054 23139 webserver.cc:460] Webserver started at http://127.11.146.3:44321/ using document root <none> and password file <none>
I20260809 15:31:43.858632 23139 fs_manager.cc:359] Metadata directory not provided
I20260809 15:31:43.858726 23139 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:31:43.858949 23139 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:31:43.860898 23139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/data/instance:
uuid: "1af93c9c6f28487fbbefec320f0be24c"
format_stamp: "Formatted at 2026-08-09 15:31:43 on dist-test-slave-1jjb"
server_key: "a7fccbb6777f11f8ad2ce1ece9f6c7c3"
server_key_iv: "adcfab2f891b7b5f1555146850a5d260"
server_key_version: "encryptionkey@0"
I20260809 15:31:43.861464 23139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance:
uuid: "1af93c9c6f28487fbbefec320f0be24c"
format_stamp: "Formatted at 2026-08-09 15:31:43 on dist-test-slave-1jjb"
server_key: "a7fccbb6777f11f8ad2ce1ece9f6c7c3"
server_key_iv: "adcfab2f891b7b5f1555146850a5d260"
server_key_version: "encryptionkey@0"
I20260809 15:31:43.864964 23139 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 15:31:43.867200 23157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:43.868376 23139 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:31:43.868510 23139 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/wal
uuid: "1af93c9c6f28487fbbefec320f0be24c"
format_stamp: "Formatted at 2026-08-09 15:31:43 on dist-test-slave-1jjb"
server_key: "a7fccbb6777f11f8ad2ce1ece9f6c7c3"
server_key_iv: "adcfab2f891b7b5f1555146850a5d260"
server_key_version: "encryptionkey@0"
I20260809 15:31:43.868616 23139 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:31:43.882121 23139 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:31:43.884719 23139 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:31:43.884907 23139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:31:43.885460 23139 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:31:43.886212 23139 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:31:43.886281 23139 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:43.886337 23139 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:31:43.886369 23139 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:31:43.895147 23139 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.3:35249
I20260809 15:31:43.895169 23277 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.3:35249 every 8 connection(s)
I20260809 15:31:43.895941 23139 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
I20260809 15:31:43.896667 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 23139
I20260809 15:31:43.896788 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance
I20260809 15:31:43.897066 11848 external_mini_cluster.cc:1428] Setting key 8dd6e19c5d553bd28706cbc6c3dcede9
Aug 09 15:31:43 dist-test-slave-1jjb krb5kdc[22731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289503, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:31:43.908880 22821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:43.897816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:55729 (local address 127.11.146.62:44575)
0809 15:31:43.897965 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:43.897971 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:43.899034 (+ 1063us) server_negotiation.cc:407] Connection header received
0809 15:31:43.900542 (+ 1508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:43.900545 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:43.900589 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:43.900654 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:43.901667 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:43.902178 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:43.903250 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:43.903456 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:43.903531 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:43.905759 (+ 2228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:43.905762 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:43.905764 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:43.905788 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:43.907167 (+ 1379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:43.907617 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:43.907620 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:43.907621 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:43.907690 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:43.907963 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:43.907965 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:43.907966 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:43.908189 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:43.908264 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:43.908685 (+ 421us) server_negotiation.cc:299] Negotiation successful
0809 15:31:43.908772 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 15:31:43.909649 23281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:43.898286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:44575 (local address 127.11.146.3:55729)
0809 15:31:43.898856 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:43.898912 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:43.900359 (+ 1447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:43.900774 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:43.900780 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:43.901111 (+ 331us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:31:43.901549 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:43.901562 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:43.902283 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:43.902286 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:43.903148 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:43.903157 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:43.903579 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:43.903581 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:43.903718 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:43.904292 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:31:43.904308 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:31:43.905614 (+ 1306us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:31:43.907260 (+ 1646us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:43.907264 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:43.907274 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:43.907533 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:43.907767 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:31:43.907769 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:31:43.907770 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:31:43.907886 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:31:43.908276 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:31:43.908281 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:31:43.908488 (+ 207us) client_negotiation.cc:769] Sending connection context
0809 15:31:43.908637 (+ 149us) client_negotiation.cc:240] Negotiation successful
0809 15:31:43.908849 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":187,"threads_started":1}
I20260809 15:31:43.910781 23278 heartbeater.cc:347] Connected to a master server at 127.11.146.62:44575
I20260809 15:31:43.911018 23278 heartbeater.cc:464] Registering TS with master...
I20260809 15:31:43.911481 23278 heartbeater.cc:511] Master 127.11.146.62:44575 requested a full tablet report, sending...
I20260809 15:31:43.912448 22779 ts_manager.cc:194] Registered new tserver with Master: 1af93c9c6f28487fbbefec320f0be24c (127.11.146.3:35249)
I20260809 15:31:43.912989 22779 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.3@KRBTEST.COM'} at 127.11.146.3:55729
I20260809 15:31:43.922479 11848 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:31:43.931051 22821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:43.924358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42568 (local address 127.11.146.62:44575)
0809 15:31:43.924500 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:43.924504 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:43.924687 (+ 183us) server_negotiation.cc:407] Connection header received
0809 15:31:43.924765 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:43.924767 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:43.924800 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:43.924865 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:31:43.925459 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:43.925895 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:43.926584 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:43.926782 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:43.926862 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:43.928107 (+ 1245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:31:43.928115 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:31:43.928119 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:31:43.928146 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:31:43.929676 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:43.930063 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:43.930066 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:43.930067 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:43.930134 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:31:43.930376 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:31:43.930378 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:31:43.930379 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:31:43.930548 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:31:43.930636 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:43.930800 (+ 164us) server_negotiation.cc:299] Negotiation successful
0809 15:31:43.930887 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 15:31:43.933773 22779 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42568:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:31:43.936717 22779 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:31:43.949810 23296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:43.944932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:35985 (local address 127.0.0.1:60698)
0809 15:31:43.945462 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:43.945474 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:43.945560 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:43.946175 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:43.946180 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:43.946199 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:31:43.946279 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:43.946284 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:43.947430 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:43.947434 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:43.948500 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:43.948510 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:43.949303 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:43.949307 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:43.949411 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:43.949447 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 15:31:43.949556 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 15:31:43.949666 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":83,"threads_started":1}
I20260809 15:31:43.949968 23297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:43.945067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60698 (local address 127.11.146.2:35985)
0809 15:31:43.945783 (+ 716us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:43.945795 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:43.945815 (+ 20us) server_negotiation.cc:407] Connection header received
0809 15:31:43.945880 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:43.945885 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:43.946056 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:43.946190 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:31:43.946376 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:43.947317 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:43.948611 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:43.949168 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:43.949292 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:43.949442 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:43.949740 (+ 298us) server_negotiation.cc:299] Negotiation successful
0809 15:31:43.949826 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":620,"thread_start_us":97,"threads_started":1}
I20260809 15:31:43.950145 23298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:43.945257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52696 (local address 127.11.146.1:45389)
0809 15:31:43.945605 (+ 348us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:43.945623 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:43.945641 (+ 18us) server_negotiation.cc:407] Connection header received
0809 15:31:43.945711 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:43.945718 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:43.945878 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:43.946016 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:31:43.946262 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:43.946931 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:43.948502 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:43.949309 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:43.949510 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:43.949648 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:43.949877 (+ 229us) server_negotiation.cc:299] Negotiation successful
0809 15:31:43.949986 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271,"thread_start_us":94,"threads_started":1}
I20260809 15:31:43.949966 23293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:43.944464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:45389 (local address 127.0.0.1:52696)
0809 15:31:43.944902 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:43.944913 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:43.945121 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:43.946022 (+ 901us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:43.946025 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:43.946043 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:31:43.946140 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:43.946149 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:43.947059 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:43.947062 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:43.948352 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:43.948364 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:43.949458 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:43.949462 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:43.949641 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:43.949662 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 15:31:43.949732 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 15:31:43.949795 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":386,"mutex_wait_us":81,"thread_start_us":102,"threads_started":1}
I20260809 15:31:43.950109 23294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:43.944270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:35249 (local address 127.0.0.1:45710)
0809 15:31:43.944779 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:43.944823 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:43.944937 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:43.945826 (+ 889us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:43.945833 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:43.945856 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:31:43.945972 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:43.945978 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:43.947285 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:43.947288 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:43.948374 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:43.948380 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:43.949458 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:43.949462 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:43.949620 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:43.949647 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 15:31:43.949714 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 15:31:43.949789 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":365,"mutex_wait_us":47,"thread_start_us":72,"threads_started":1}
I20260809 15:31:43.950778 23295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:43.944455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45710 (local address 127.11.146.3:35249)
0809 15:31:43.945355 (+ 900us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:43.945368 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:43.945390 (+ 22us) server_negotiation.cc:407] Connection header received
0809 15:31:43.945458 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:43.945462 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:43.945644 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:43.945819 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:31:43.946107 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:43.947117 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:43.948534 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:43.949309 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:43.950174 (+ 865us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:43.950537 (+ 363us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:43.950599 (+ 62us) server_negotiation.cc:299] Negotiation successful
0809 15:31:43.950678 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":803,"thread_start_us":120,"threads_started":1}
I20260809 15:31:43.953035 22917 tablet_service.cc:1467] Processing CreateTablet for tablet 848bff37edef4196897aae8922b2cafb (DEFAULT_TABLE table=test-table [id=98b51cc6378a41a187bbcfccdfefbe71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:31:43.953107 23208 tablet_service.cc:1467] Processing CreateTablet for tablet 848bff37edef4196897aae8922b2cafb (DEFAULT_TABLE table=test-table [id=98b51cc6378a41a187bbcfccdfefbe71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:31:43.953943 22917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 848bff37edef4196897aae8922b2cafb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:43.953951 23208 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 848bff37edef4196897aae8922b2cafb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:43.956913 23063 tablet_service.cc:1467] Processing CreateTablet for tablet 848bff37edef4196897aae8922b2cafb (DEFAULT_TABLE table=test-table [id=98b51cc6378a41a187bbcfccdfefbe71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:31:43.957880 23063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 848bff37edef4196897aae8922b2cafb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:31:43.959802 23299 tablet_bootstrap.cc:492] T 848bff37edef4196897aae8922b2cafb P 1af93c9c6f28487fbbefec320f0be24c: Bootstrap starting.
I20260809 15:31:43.961164 23300 tablet_bootstrap.cc:492] T 848bff37edef4196897aae8922b2cafb P 1b73ef31c3174773b3246bce37130007: Bootstrap starting.
I20260809 15:31:43.961907 23299 tablet_bootstrap.cc:654] T 848bff37edef4196897aae8922b2cafb P 1af93c9c6f28487fbbefec320f0be24c: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:43.962980 23299 log.cc:824] T 848bff37edef4196897aae8922b2cafb P 1af93c9c6f28487fbbefec320f0be24c: Log is configured to *not* fsync() on all Append() calls
I20260809 15:31:43.963260 23300 tablet_bootstrap.cc:654] T 848bff37edef4196897aae8922b2cafb P 1b73ef31c3174773b3246bce37130007: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:43.964473 23300 log.cc:824] T 848bff37edef4196897aae8922b2cafb P 1b73ef31c3174773b3246bce37130007: Log is configured to *not* fsync() on all Append() calls
I20260809 15:31:43.965186 23299 tablet_bootstrap.cc:492] T 848bff37edef4196897aae8922b2cafb P 1af93c9c6f28487fbbefec320f0be24c: No bootstrap required, opened a new log
I20260809 15:31:43.965415 23299 ts_tablet_manager.cc:1397] T 848bff37edef4196897aae8922b2cafb P 1af93c9c6f28487fbbefec320f0be24c: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 15:31:43.965565 23302 tablet_bootstrap.cc:492] T 848bff37edef4196897aae8922b2cafb P 49fabad32d4e4d21b0452d14a2aedb0d: Bootstrap starting.
I20260809 15:31:43.966315 23300 tablet_bootstrap.cc:492] T 848bff37edef4196897aae8922b2cafb P 1b73ef31c3174773b3246bce37130007: No bootstrap required, opened a new log
I20260809 15:31:43.966507 23300 ts_tablet_manager.cc:1397] T 848bff37edef4196897aae8922b2cafb P 1b73ef31c3174773b3246bce37130007: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 15:31:43.967978 23302 tablet_bootstrap.cc:654] T 848bff37edef4196897aae8922b2cafb P 49fabad32d4e4d21b0452d14a2aedb0d: Neither blocks nor log segments found. Creating new log.
I20260809 15:31:43.968261 23299 raft_consensus.cc:348] T 848bff37edef4196897aae8922b2cafb P 1af93c9c6f28487fbbefec320f0be24c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af93c9c6f28487fbbefec320f0be24c" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 35249 } } peers { permanent_uuid: "1b73ef31c3174773b3246bce37130007" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45389 } } peers { permanent_uuid: "49fabad32d4e4d21b0452d14a2aedb0d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35985 } }
I20260809 15:31:43.968573 23299 raft_consensus.cc:374] T 848bff37edef4196897aae8922b2cafb P 1af93c9c6f28487fbbefec320f0be24c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:43.968631 23299 raft_consensus.cc:729] T 848bff37edef4196897aae8922b2cafb P 1af93c9c6f28487fbbefec320f0be24c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1af93c9c6f28487fbbefec320f0be24c, State: Initialized, Role: FOLLOWER
I20260809 15:31:43.968757 23302 log.cc:824] T 848bff37edef4196897aae8922b2cafb P 49fabad32d4e4d21b0452d14a2aedb0d: Log is configured to *not* fsync() on all Append() calls
I20260809 15:31:43.969095 23299 consensus_queue.cc:260] T 848bff37edef4196897aae8922b2cafb P 1af93c9c6f28487fbbefec320f0be24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af93c9c6f28487fbbefec320f0be24c" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 35249 } } peers { permanent_uuid: "1b73ef31c3174773b3246bce37130007" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45389 } } peers { permanent_uuid: "49fabad32d4e4d21b0452d14a2aedb0d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35985 } }
I20260809 15:31:43.970124 23299 ts_tablet_manager.cc:1428] T 848bff37edef4196897aae8922b2cafb P 1af93c9c6f28487fbbefec320f0be24c: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 15:31:43.970443 23300 raft_consensus.cc:348] T 848bff37edef4196897aae8922b2cafb P 1b73ef31c3174773b3246bce37130007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af93c9c6f28487fbbefec320f0be24c" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 35249 } } peers { permanent_uuid: "1b73ef31c3174773b3246bce37130007" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45389 } } peers { permanent_uuid: "49fabad32d4e4d21b0452d14a2aedb0d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35985 } }
I20260809 15:31:43.970618 23278 heartbeater.cc:503] Master 127.11.146.62:44575 was elected leader, sending a full tablet report...
I20260809 15:31:43.970681 23300 raft_consensus.cc:374] T 848bff37edef4196897aae8922b2cafb P 1b73ef31c3174773b3246bce37130007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:43.970736 23302 tablet_bootstrap.cc:492] T 848bff37edef4196897aae8922b2cafb P 49fabad32d4e4d21b0452d14a2aedb0d: No bootstrap required, opened a new log
I20260809 15:31:43.970752 23300 raft_consensus.cc:729] T 848bff37edef4196897aae8922b2cafb P 1b73ef31c3174773b3246bce37130007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b73ef31c3174773b3246bce37130007, State: Initialized, Role: FOLLOWER
I20260809 15:31:43.970933 23302 ts_tablet_manager.cc:1397] T 848bff37edef4196897aae8922b2cafb P 49fabad32d4e4d21b0452d14a2aedb0d: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 15:31:43.971184 23300 consensus_queue.cc:260] T 848bff37edef4196897aae8922b2cafb P 1b73ef31c3174773b3246bce37130007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af93c9c6f28487fbbefec320f0be24c" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 35249 } } peers { permanent_uuid: "1b73ef31c3174773b3246bce37130007" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45389 } } peers { permanent_uuid: "49fabad32d4e4d21b0452d14a2aedb0d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35985 } }
I20260809 15:31:43.972131 22987 heartbeater.cc:503] Master 127.11.146.62:44575 was elected leader, sending a full tablet report...
I20260809 15:31:43.972970 23300 ts_tablet_manager.cc:1428] T 848bff37edef4196897aae8922b2cafb P 1b73ef31c3174773b3246bce37130007: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260809 15:31:43.974215 23302 raft_consensus.cc:348] T 848bff37edef4196897aae8922b2cafb P 49fabad32d4e4d21b0452d14a2aedb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af93c9c6f28487fbbefec320f0be24c" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 35249 } } peers { permanent_uuid: "1b73ef31c3174773b3246bce37130007" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45389 } } peers { permanent_uuid: "49fabad32d4e4d21b0452d14a2aedb0d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35985 } }
I20260809 15:31:43.974431 23302 raft_consensus.cc:374] T 848bff37edef4196897aae8922b2cafb P 49fabad32d4e4d21b0452d14a2aedb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:31:43.974499 23302 raft_consensus.cc:729] T 848bff37edef4196897aae8922b2cafb P 49fabad32d4e4d21b0452d14a2aedb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49fabad32d4e4d21b0452d14a2aedb0d, State: Initialized, Role: FOLLOWER
I20260809 15:31:43.974892 23302 consensus_queue.cc:260] T 848bff37edef4196897aae8922b2cafb P 49fabad32d4e4d21b0452d14a2aedb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af93c9c6f28487fbbefec320f0be24c" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 35249 } } peers { permanent_uuid: "1b73ef31c3174773b3246bce37130007" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45389 } } peers { permanent_uuid: "49fabad32d4e4d21b0452d14a2aedb0d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35985 } }
I20260809 15:31:43.975522 23133 heartbeater.cc:503] Master 127.11.146.62:44575 was elected leader, sending a full tablet report...
I20260809 15:31:43.975761 23302 ts_tablet_manager.cc:1428] T 848bff37edef4196897aae8922b2cafb P 49fabad32d4e4d21b0452d14a2aedb0d: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
W20260809 15:31:44.146925 23279 tablet.cc:2369] T 848bff37edef4196897aae8922b2cafb P 1af93c9c6f28487fbbefec320f0be24c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 15:31:44.184403 23134 tablet.cc:2369] T 848bff37edef4196897aae8922b2cafb P 49fabad32d4e4d21b0452d14a2aedb0d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 15:31:44.204507 22989 tablet.cc:2369] T 848bff37edef4196897aae8922b2cafb P 1b73ef31c3174773b3246bce37130007: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:31:44.315882 23305 raft_consensus.cc:482] T 848bff37edef4196897aae8922b2cafb P 1af93c9c6f28487fbbefec320f0be24c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:31:44.316147 23305 raft_consensus.cc:504] T 848bff37edef4196897aae8922b2cafb P 1af93c9c6f28487fbbefec320f0be24c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af93c9c6f28487fbbefec320f0be24c" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 35249 } } peers { permanent_uuid: "1b73ef31c3174773b3246bce37130007" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45389 } } peers { permanent_uuid: "49fabad32d4e4d21b0452d14a2aedb0d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35985 } }
I20260809 15:31:44.317243 23305 leader_election.cc:288] T 848bff37edef4196897aae8922b2cafb P 1af93c9c6f28487fbbefec320f0be24c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b73ef31c3174773b3246bce37130007 (127.11.146.1:45389), 49fabad32d4e4d21b0452d14a2aedb0d (127.11.146.2:35985)
I20260809 15:31:44.320924 23281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:44.317497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:45389 (local address 127.11.146.3:52469)
0809 15:31:44.317625 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:44.317642 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:44.317767 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:44.318119 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:44.318122 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:44.318142 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:31:44.318243 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:44.318249 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:44.319007 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:44.319011 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:44.319836 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:44.319845 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:44.320497 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:44.320501 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:44.320615 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:44.320637 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 15:31:44.320733 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 15:31:44.320796 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44,"mutex_wait_us":22}
I20260809 15:31:44.320924 23298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:44.317617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:52469 (local address 127.11.146.1:45389)
0809 15:31:44.317777 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:44.317783 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:44.317800 (+ 17us) server_negotiation.cc:407] Connection header received
0809 15:31:44.317878 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:44.317881 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:44.317948 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:44.318024 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:31:44.318373 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:44.318869 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:44.319974 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:44.320374 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:44.320507 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:44.320577 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:44.320748 (+ 171us) server_negotiation.cc:299] Negotiation successful
0809 15:31:44.320814 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 15:31:44.321376 23308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:44.317789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:35985 (local address 127.11.146.3:39705)
0809 15:31:44.318137 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:44.318149 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 15:31:44.318270 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:31:44.318536 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:31:44.318539 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:31:44.318555 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:31:44.318678 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:44.318683 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:44.319412 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:44.319417 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:44.320259 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:31:44.320268 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:31:44.320890 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:31:44.320893 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:31:44.321008 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:44.321040 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 15:31:44.321148 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 15:31:44.321236 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"mutex_wait_us":1,"thread_start_us":148,"threads_started":1}
I20260809 15:31:44.321363 23297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:44.317923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:39705 (local address 127.11.146.2:35985)
0809 15:31:44.318047 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:44.318052 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:44.318242 (+ 190us) server_negotiation.cc:407] Connection header received
0809 15:31:44.318380 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:44.318383 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:44.318440 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:44.318525 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:31:44.318794 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:44.319274 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:44.320378 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:44.320766 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:44.320889 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:44.320936 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:44.321186 (+ 250us) server_negotiation.cc:299] Negotiation successful
0809 15:31:44.321255 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 15:31:44.321666 22939 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "848bff37edef4196897aae8922b2cafb" candidate_uuid: "1af93c9c6f28487fbbefec320f0be24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b73ef31c3174773b3246bce37130007" is_pre_election: true
I20260809 15:31:44.321960 22939 raft_consensus.cc:2454] T 848bff37edef4196897aae8922b2cafb P 1b73ef31c3174773b3246bce37130007 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1af93c9c6f28487fbbefec320f0be24c in term 0.
I20260809 15:31:44.322474 23158 leader_election.cc:302] T 848bff37edef4196897aae8922b2cafb P 1af93c9c6f28487fbbefec320f0be24c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1af93c9c6f28487fbbefec320f0be24c, 1b73ef31c3174773b3246bce37130007; no voters:
I20260809 15:31:44.322757 23305 raft_consensus.cc:2781] T 848bff37edef4196897aae8922b2cafb P 1af93c9c6f28487fbbefec320f0be24c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:31:44.322770 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "848bff37edef4196897aae8922b2cafb" candidate_uuid: "1af93c9c6f28487fbbefec320f0be24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49fabad32d4e4d21b0452d14a2aedb0d" is_pre_election: true
I20260809 15:31:44.322839 23305 raft_consensus.cc:482] T 848bff37edef4196897aae8922b2cafb P 1af93c9c6f28487fbbefec320f0be24c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:31:44.322889 23305 raft_consensus.cc:3037] T 848bff37edef4196897aae8922b2cafb P 1af93c9c6f28487fbbefec320f0be24c [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:44.323024 23085 raft_consensus.cc:2454] T 848bff37edef4196897aae8922b2cafb P 49fabad32d4e4d21b0452d14a2aedb0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1af93c9c6f28487fbbefec320f0be24c in term 0.
I20260809 15:31:44.324040 23305 raft_consensus.cc:504] T 848bff37edef4196897aae8922b2cafb P 1af93c9c6f28487fbbefec320f0be24c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af93c9c6f28487fbbefec320f0be24c" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 35249 } } peers { permanent_uuid: "1b73ef31c3174773b3246bce37130007" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45389 } } peers { permanent_uuid: "49fabad32d4e4d21b0452d14a2aedb0d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35985 } }
I20260809 15:31:44.324412 23305 leader_election.cc:288] T 848bff37edef4196897aae8922b2cafb P 1af93c9c6f28487fbbefec320f0be24c [CANDIDATE]: Term 1 election: Requested vote from peers 1b73ef31c3174773b3246bce37130007 (127.11.146.1:45389), 49fabad32d4e4d21b0452d14a2aedb0d (127.11.146.2:35985)
I20260809 15:31:44.324759 22939 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "848bff37edef4196897aae8922b2cafb" candidate_uuid: "1af93c9c6f28487fbbefec320f0be24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b73ef31c3174773b3246bce37130007"
I20260809 15:31:44.324827 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "848bff37edef4196897aae8922b2cafb" candidate_uuid: "1af93c9c6f28487fbbefec320f0be24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49fabad32d4e4d21b0452d14a2aedb0d"
I20260809 15:31:44.324908 22939 raft_consensus.cc:3037] T 848bff37edef4196897aae8922b2cafb P 1b73ef31c3174773b3246bce37130007 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:44.324937 23085 raft_consensus.cc:3037] T 848bff37edef4196897aae8922b2cafb P 49fabad32d4e4d21b0452d14a2aedb0d [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:31:44.326166 22939 raft_consensus.cc:2454] T 848bff37edef4196897aae8922b2cafb P 1b73ef31c3174773b3246bce37130007 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1af93c9c6f28487fbbefec320f0be24c in term 1.
I20260809 15:31:44.326166 23085 raft_consensus.cc:2454] T 848bff37edef4196897aae8922b2cafb P 49fabad32d4e4d21b0452d14a2aedb0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1af93c9c6f28487fbbefec320f0be24c in term 1.
I20260809 15:31:44.326429 23158 leader_election.cc:302] T 848bff37edef4196897aae8922b2cafb P 1af93c9c6f28487fbbefec320f0be24c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1af93c9c6f28487fbbefec320f0be24c, 49fabad32d4e4d21b0452d14a2aedb0d; no voters:
I20260809 15:31:44.326593 23305 raft_consensus.cc:2781] T 848bff37edef4196897aae8922b2cafb P 1af93c9c6f28487fbbefec320f0be24c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:31:44.326819 23305 raft_consensus.cc:686] T 848bff37edef4196897aae8922b2cafb P 1af93c9c6f28487fbbefec320f0be24c [term 1 LEADER]: Becoming Leader. State: Replica: 1af93c9c6f28487fbbefec320f0be24c, State: Running, Role: LEADER
I20260809 15:31:44.327131 23305 consensus_queue.cc:237] T 848bff37edef4196897aae8922b2cafb P 1af93c9c6f28487fbbefec320f0be24c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af93c9c6f28487fbbefec320f0be24c" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 35249 } } peers { permanent_uuid: "1b73ef31c3174773b3246bce37130007" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45389 } } peers { permanent_uuid: "49fabad32d4e4d21b0452d14a2aedb0d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35985 } }
I20260809 15:31:44.330454 22778 catalog_manager.cc:5495] T 848bff37edef4196897aae8922b2cafb P 1af93c9c6f28487fbbefec320f0be24c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1af93c9c6f28487fbbefec320f0be24c (127.11.146.3). New cstate: current_term: 1 leader_uuid: "1af93c9c6f28487fbbefec320f0be24c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af93c9c6f28487fbbefec320f0be24c" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 35249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b73ef31c3174773b3246bce37130007" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49fabad32d4e4d21b0452d14a2aedb0d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35985 } health_report { overall_health: UNKNOWN } } }
I20260809 15:31:44.402644 23295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:44.399016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45712 (local address 127.11.146.3:35249)
0809 15:31:44.399170 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 15:31:44.399177 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:31:44.399196 (+ 19us) server_negotiation.cc:407] Connection header received
0809 15:31:44.399285 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:31:44.399288 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:31:44.399343 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:31:44.399464 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:31:44.399726 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:44.400258 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:44.401155 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:31:44.401376 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:31:44.401489 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:31:44.401812 (+ 323us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:31:44.402212 (+ 400us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:31:44.402351 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 15:31:44.402428 (+ 77us) server_negotiation.cc:299] Negotiation successful
0809 15:31:44.402485 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 15:31:44.408636 23085 raft_consensus.cc:1261] T 848bff37edef4196897aae8922b2cafb P 49fabad32d4e4d21b0452d14a2aedb0d [term 1 FOLLOWER]: Refusing update from remote peer 1af93c9c6f28487fbbefec320f0be24c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:31:44.408695 22939 raft_consensus.cc:1261] T 848bff37edef4196897aae8922b2cafb P 1b73ef31c3174773b3246bce37130007 [term 1 FOLLOWER]: Refusing update from remote peer 1af93c9c6f28487fbbefec320f0be24c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:31:44.409490 23305 consensus_queue.cc:1035] T 848bff37edef4196897aae8922b2cafb P 1af93c9c6f28487fbbefec320f0be24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "49fabad32d4e4d21b0452d14a2aedb0d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 35985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:31:44.409687 23309 consensus_queue.cc:1035] T 848bff37edef4196897aae8922b2cafb P 1af93c9c6f28487fbbefec320f0be24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b73ef31c3174773b3246bce37130007" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:31:44.426234 22779 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42568:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:31:44.426424 22779 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42568:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:31:44.428983 22779 catalog_manager.cc:5782] T 00000000000000000000000000000000 P eb1dc01d66ee4cdca02e9bc9c5b8e0a4: Sending DeleteTablet for 3 replicas of tablet 848bff37edef4196897aae8922b2cafb
I20260809 15:31:44.429731 23208 tablet_service.cc:1514] Processing DeleteTablet for tablet 848bff37edef4196897aae8922b2cafb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:31:44 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:45710
I20260809 15:31:44.429797 23063 tablet_service.cc:1514] Processing DeleteTablet for tablet 848bff37edef4196897aae8922b2cafb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:31:44 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:60698
I20260809 15:31:44.429795 22917 tablet_service.cc:1514] Processing DeleteTablet for tablet 848bff37edef4196897aae8922b2cafb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:31:44 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:52696
I20260809 15:31:44.430258 23323 tablet_replica.cc:330] T 848bff37edef4196897aae8922b2cafb P 1b73ef31c3174773b3246bce37130007: stopping tablet replica
I20260809 15:31:44.430328 23322 tablet_replica.cc:330] T 848bff37edef4196897aae8922b2cafb P 1af93c9c6f28487fbbefec320f0be24c: stopping tablet replica
I20260809 15:31:44.430554 23322 raft_consensus.cc:2229] T 848bff37edef4196897aae8922b2cafb P 1af93c9c6f28487fbbefec320f0be24c [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:31:44.430554 23323 raft_consensus.cc:2229] T 848bff37edef4196897aae8922b2cafb P 1b73ef31c3174773b3246bce37130007 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:31:44.430820 23323 raft_consensus.cc:2258] T 848bff37edef4196897aae8922b2cafb P 1b73ef31c3174773b3246bce37130007 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:31:44.430837 23322 raft_consensus.cc:2258] T 848bff37edef4196897aae8922b2cafb P 1af93c9c6f28487fbbefec320f0be24c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:31:44.430984 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 22845
I20260809 15:31:44.431195 23324 tablet_replica.cc:330] T 848bff37edef4196897aae8922b2cafb P 49fabad32d4e4d21b0452d14a2aedb0d: stopping tablet replica
I20260809 15:31:44.431457 23324 raft_consensus.cc:2229] T 848bff37edef4196897aae8922b2cafb P 49fabad32d4e4d21b0452d14a2aedb0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:31:44.431743 23324 raft_consensus.cc:2258] T 848bff37edef4196897aae8922b2cafb P 49fabad32d4e4d21b0452d14a2aedb0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:31:44.433277 23324 ts_tablet_manager.cc:1905] T 848bff37edef4196897aae8922b2cafb P 49fabad32d4e4d21b0452d14a2aedb0d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:31:44.435395 23324 ts_tablet_manager.cc:1918] T 848bff37edef4196897aae8922b2cafb P 49fabad32d4e4d21b0452d14a2aedb0d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:31:44.435493 23324 log.cc:1196] T 848bff37edef4196897aae8922b2cafb P 49fabad32d4e4d21b0452d14a2aedb0d: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-1/wal/wals/848bff37edef4196897aae8922b2cafb
I20260809 15:31:44.435712 23324 ts_tablet_manager.cc:1939] T 848bff37edef4196897aae8922b2cafb P 49fabad32d4e4d21b0452d14a2aedb0d: Deleting consensus metadata
I20260809 15:31:44.436880 22762 catalog_manager.cc:4841] TS 49fabad32d4e4d21b0452d14a2aedb0d (127.11.146.2:35985): tablet 848bff37edef4196897aae8922b2cafb (table test-table [id=98b51cc6378a41a187bbcfccdfefbe71]) successfully deleted
I20260809 15:31:44.441026 23322 ts_tablet_manager.cc:1905] T 848bff37edef4196897aae8922b2cafb P 1af93c9c6f28487fbbefec320f0be24c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:31:44.443069 23322 ts_tablet_manager.cc:1918] T 848bff37edef4196897aae8922b2cafb P 1af93c9c6f28487fbbefec320f0be24c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:31:44.443186 23322 log.cc:1196] T 848bff37edef4196897aae8922b2cafb P 1af93c9c6f28487fbbefec320f0be24c: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786289437399694-11848-0/minicluster-data/ts-2/wal/wals/848bff37edef4196897aae8922b2cafb
I20260809 15:31:44.443538 23322 ts_tablet_manager.cc:1939] T 848bff37edef4196897aae8922b2cafb P 1af93c9c6f28487fbbefec320f0be24c: Deleting consensus metadata
W20260809 15:31:44.443522 22762 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.146.1:45389 (error 108)
I20260809 15:31:44.443647 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 22995
I20260809 15:31:44.446158 23296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:31:44.445758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:45389 (local address 127.0.0.1:52710)
0809 15:31:44.446001 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0809 15:31:44.446078 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.1:45389: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150}
W20260809 15:31:44.446311 22762 catalog_manager.cc:4584] TS 1b73ef31c3174773b3246bce37130007 (127.11.146.1:45389): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 848bff37edef4196897aae8922b2cafb: Network error: Client connection negotiation failed: client connection to 127.11.146.1:45389: connect: Connection refused (error 111)
I20260809 15:31:44.449317 22764 catalog_manager.cc:4841] TS 1af93c9c6f28487fbbefec320f0be24c (127.11.146.3:35249): tablet 848bff37edef4196897aae8922b2cafb (table test-table [id=98b51cc6378a41a187bbcfccdfefbe71]) successfully deleted
I20260809 15:31:44.453007 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 23139
I20260809 15:31:44.459388 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 22746
2026-08-09T15:31:44Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2691 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:31:44 dist-test-slave-1jjb krb5kdc[23328](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:31:44 dist-test-slave-1jjb krb5kdc[23328](info): set up 2 sockets
Aug 09 15:31:44 dist-test-slave-1jjb krb5kdc[23328](info): commencing operation
krb5kdc: starting...
W20260809 15:31:45.590173 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.104s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:31:45 dist-test-slave-1jjb krb5kdc[23328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289505, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:31:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:31:45Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.11.146.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.11.146.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.11.146.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/rangeradmin_127.11.146.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.11.146.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/rangeradmin_127.11.146.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.11.146.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.11.146.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.11.146.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/rangerlookup_127.11.146.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.11.146.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/rangerlookup_127.11.146.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.146.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.11.146.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.146.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/HTTP_127.11.146.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.146.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/HTTP_127.11.146.20@KRBTEST.COM.keytab.
I20260809 15:31:45.758498 11848 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taska0HXVP/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/postgres -l logfile start
2026-08-09 15:31:48.215 UTC [23362] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 15:31:48.215 UTC [23362] LOG: listening on IPv4 address "127.11.146.20", port 58813
2026-08-09 15:31:48.219 UTC [23362] LOG: listening on Unix socket "/tmp/.s.PGSQL.58813"
2026-08-09 15:31:48.240 UTC [23365] LOG: database system was shut down at 2026-08-09 15:31:46 UTC
2026-08-09 15:31:48.243 UTC [23362] LOG: database system is ready to accept connections
I20260809 15:31:49.254067 11848 mini_postgres.cc:96] Postgres bound to 58813
2026-08-09 15:31:49.261 UTC [23373] FATAL: database "slave" does not exist
127.11.146.20:58813 - accepting connections
I20260809 15:31:49.262197 11848 mini_ranger.cc:161] Starting Ranger...
I20260809 15:31:49.277432 11848 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 15:31:49.748337 11848 mini_ranger.cc:87] Created ranger Postgres database
I20260809 15:31:49.748464 11848 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ranger-admin
2026-08-09 15:31:50,009 [I] DB FLAVOR :POSTGRES
2026-08-09 15:31:50,009 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 15:31:50,009 [I] Checking connection..
2026-08-09 15:31:50,009 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:58813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 15:31:50,250 [I] Checking connection passed.
2026-08-09 15:31:50,250 [I] --------- Verifying version history table ---------
2026-08-09 15:31:50,250 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:58813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 15:31:50,483 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 15:31:50,483 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:58813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 15:31:50,739 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 15:31:50,740 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 15:31:50,740 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:58813/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 15:31:51.005 UTC [23441] WARNING: there is no transaction in progress
2026-08-09 15:31:51,012 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 15:31:51,012 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:58813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 15:31:51,259 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 15:31:51,259 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 15:31:51,259 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:58813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 15:31:51,517 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:58813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 15:31:51,771 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:58813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-1jjb.c.gcp-upstream.internal','N') ;"
2026-08-09 15:31:52,024 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:58813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 15:31:52,262 [I] Table x_portal_user does not exist in database ranger
2026-08-09 15:31:52,262 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:58813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 15:31:52,522 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 15:31:52,522 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:58813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 15:31:52,760 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:58813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 15:31:53,021 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 15:31:53,021 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:58813/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 15:31:54.015 UTC [23560] WARNING: there is no transaction in progress
2026-08-09 15:31:54.031 UTC [23560] WARNING: there is no transaction in progress
2026-08-09 15:31:54.047 UTC [23560] WARNING: there is no transaction in progress
2026-08-09 15:31:54.064 UTC [23560] WARNING: there is no transaction in progress
2026-08-09 15:31:54.080 UTC [23560] WARNING: there is no transaction in progress
2026-08-09 15:31:54.100 UTC [23560] WARNING: there is no transaction in progress
2026-08-09 15:31:54.163 UTC [23560] WARNING: there is no transaction in progress
2026-08-09 15:31:54.170 UTC [23560] WARNING: there is no transaction in progress
2026-08-09 15:31:54.183 UTC [23560] WARNING: there is no transaction in progress
2026-08-09 15:31:54.193 UTC [23560] WARNING: there is no transaction in progress
2026-08-09 15:31:54.203 UTC [23560] WARNING: there is no transaction in progress
2026-08-09 15:31:54.216 UTC [23560] WARNING: there is no transaction in progress
2026-08-09 15:31:54.226 UTC [23560] WARNING: there is no transaction in progress
2026-08-09 15:31:54.232 UTC [23560] WARNING: there is no transaction in progress
2026-08-09 15:31:54.238 UTC [23560] WARNING: there is no transaction in progress
2026-08-09 15:31:54.245 UTC [23560] WARNING: there is no transaction in progress
2026-08-09 15:31:54,897 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 15:31:54,898 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:58813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 15:31:55,155 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 15:31:55,156 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:58813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 15:31:55,398 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 15:31:55,399 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:58813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 15:31:55,655 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 15:31:55,656 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:58813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 15:31:55,907 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:58813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 15:31:56,176 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:58813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-1jjb.c.gcp-upstream.internal';"
2026-08-09 15:31:56,427 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 15:31:56,427 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:58813/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 15:31:56,674 [I] DB_PATCHES have already been applied
I20260809 15:31:56.680353 11848 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ranger-admin:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taska0HXVP/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 15:31:56.680436 11848 mini_ranger.cc:193] Using host: 127.11.146.20
I20260809 15:31:56.685264 11848 mini_ranger.cc:227] Ranger admin URL: http://127.11.146.20:56533
Aug 09, 2026 3:31:56 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 3:31:56 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 3:31:57 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 3:31:57 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 3:31:57 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 3:31:57 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 3:31:57 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 15:31:57.851292 11848 mini_ranger.cc:160] Time spent starting Ranger: real 8.589s user 0.007s sys 0.005s
Aug 09, 2026 3:32:17 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 3:32:17 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 09, 2026 3:32:17 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 3:32:17 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 3:32:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 3:32:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 3:32:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 3:32:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 3:32:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 3:32:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 3:32:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 3:32:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 3:32:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 3:32:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 3:32:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 3:32:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 3:32:17 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 3:32:18 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 15:32:18.633558 11848 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.11.146.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.11.146.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.11.146.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/rangerkms_127.11.146.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.11.146.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/rangerkms_127.11.146.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.146.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.11.146.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.146.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/HTTP_127.11.146.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.146.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/HTTP_127.11.146.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 15:32:18 dist-test-slave-1jjb krb5kdc[23328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289538, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 15:32:18.716444 11848 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 15:32:18.725675 11848 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 15:32:19.579742 11848 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 15:32:19.579880 11848 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ranger-kms
I20260809 15:32:19.579988 11848 mini_ranger_kms.cc:227] Using postgres at 127.11.146.20:58813
2026-08-09 15:32:19,856 [I] DB FLAVOR :POSTGRES
2026-08-09 15:32:19,856 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 15:32:19,857 [I] Checking connection
2026-08-09 15:32:19,857 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:58813/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 15:32:20,085 [I] connection success
2026-08-09 15:32:20,085 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 15:32:20,085 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 15:32:20,085 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:58813/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 15:32:20,312 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 15:32:20,313 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 15:32:20,313 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 15:32:20,313 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:58813/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 15:32:20,567 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 15:32:21.024010 11848 mini_ranger_kms.cc:310] Created kms service
I20260809 15:32:21.233347 11848 mini_ranger_kms.cc:326] Created kudu user
I20260809 15:32:21.274204 11848 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 15:32:21 dist-test-slave-1jjb krb5kdc[23328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289538, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.11.146.20@KRBTEST.COM
I20260809 15:32:21.640570 11848 mini_ranger_kms.cc:384] Added ranger policy
I20260809 15:32:21.640730 11848 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ranger-kms:/tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 15:32:21.640767 11848 mini_ranger_kms.cc:240] Using host: 127.11.146.20
I20260809 15:32:21.645712 11848 mini_ranger_kms.cc:276] Ranger KMS PID: 23752
I20260809 15:32:21.645835 11848 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.11.146.20:43839
Aug 09, 2026 3:32:22 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 3:32:22 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 3:32:22 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 3:32:22 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 3:32:22 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 3:32:22 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 15:32:24 dist-test-slave-1jjb krb5kdc[23328](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786289544, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.146.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:32:24.040570 11848 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.324s user 0.017s sys 0.243s
I20260809 15:32:24.040706 11848 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 15:32:24.040823 11848 mini_ranger_kms.cc:401] 127.11.146.20:43839/kms/v1/keys
Aug 09 15:32:24 dist-test-slave-1jjb krb5kdc[23328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289544, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.146.20@KRBTEST.COM for HTTP/127.11.146.20@KRBTEST.COM
Aug 09 15:32:24 dist-test-slave-1jjb krb5kdc[23328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289544, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.146.20@KRBTEST.COM for HTTP/127.11.146.20@KRBTEST.COM
Aug 09 15:32:26 dist-test-slave-1jjb krb5kdc[23328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289546, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.11.146.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
I20260809 15:32:27.019366 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:35157
--webserver_interface=127.11.146.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:36877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:35157
--ranger_config_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.146.20:43839/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:32:27.142509 23808 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:32:27.142740 23808 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:32:27.142776 23808 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:32:27.146721 23808 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:32:27.146766 23808 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:32:27.146785 23808 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:32:27.146798 23808 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:32:27.146812 23808 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:32:27.151857 23808 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:36877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/master-0/wal
--ranger_kms_url=127.11.146.20:43839/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:35157
--ranger_config_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:35157
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23808
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:32:27.152771 23808 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:32:27.153728 23808 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:32:27.163378 23817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:32:27.163388 23813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:32:27.163612 23815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:32:27.163516 23808 server_base.cc:1034] running on GCE node
I20260809 15:32:27.164295 23808 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:32:27.165567 23808 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:32:27.166769 23808 hybrid_clock.cc:648] HybridClock initialized: now 1786289547166737 us; error 41 us; skew 500 ppm
Aug 09 15:32:27 dist-test-slave-1jjb krb5kdc[23328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289547, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:32:27.179790 23808 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:32:27.180892 23808 webserver.cc:460] Webserver started at http://127.11.146.62:32887/ using document root <none> and password file <none>
I20260809 15:32:27.181437 23808 fs_manager.cc:359] Metadata directory not provided
I20260809 15:32:27.181515 23808 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:32:27.181726 23808 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 15:32:27 dist-test-slave-1jjb krb5kdc[23328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289547, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for HTTP/127.11.146.20@KRBTEST.COM
I20260809 15:32:27.244412 23808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "03080b54250949549141f11d712b5f36"
format_stamp: "Formatted at 2026-08-09 15:32:27 on dist-test-slave-1jjb"
server_key: "ff75d04fd1220304927c9d8bdc486f9d"
server_key_iv: "1decf9780438afb14e52521557171387"
server_key_version: "kuduclusterkey@0"
I20260809 15:32:27.245098 23808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "03080b54250949549141f11d712b5f36"
format_stamp: "Formatted at 2026-08-09 15:32:27 on dist-test-slave-1jjb"
server_key: "ff75d04fd1220304927c9d8bdc486f9d"
server_key_iv: "1decf9780438afb14e52521557171387"
server_key_version: "kuduclusterkey@0"
I20260809 15:32:27.249060 23808 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 15:32:27.266337 23825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:32:27.267683 23808 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:32:27.267781 23808 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "03080b54250949549141f11d712b5f36"
format_stamp: "Formatted at 2026-08-09 15:32:27 on dist-test-slave-1jjb"
server_key: "ff75d04fd1220304927c9d8bdc486f9d"
server_key_iv: "1decf9780438afb14e52521557171387"
server_key_version: "kuduclusterkey@0"
I20260809 15:32:27.267917 23808 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:32:27.280505 23808 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:32:27.283334 23808 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:32:27.283514 23808 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:32:27.291298 23808 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:35157
I20260809 15:32:27.291319 23881 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:35157 every 8 connection(s)
I20260809 15:32:27.292245 23808 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:32:27.294909 23884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:32:27.296949 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 23808
I20260809 15:32:27.297073 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:32:27.297380 11848 external_mini_cluster.cc:1428] Setting key d55ffa65fb08292eb856b7a1f66245b7
I20260809 15:32:27.300999 23884 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03080b54250949549141f11d712b5f36: Bootstrap starting.
I20260809 15:32:27.303485 23884 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 03080b54250949549141f11d712b5f36: Neither blocks nor log segments found. Creating new log.
I20260809 15:32:27.304311 23884 log.cc:824] T 00000000000000000000000000000000 P 03080b54250949549141f11d712b5f36: Log is configured to *not* fsync() on all Append() calls
I20260809 15:32:27.306536 23884 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03080b54250949549141f11d712b5f36: No bootstrap required, opened a new log
Aug 09 15:32:27 dist-test-slave-1jjb krb5kdc[23328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289546, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:32:27.311110 23884 raft_consensus.cc:348] T 00000000000000000000000000000000 P 03080b54250949549141f11d712b5f36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03080b54250949549141f11d712b5f36" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 35157 } }
I20260809 15:32:27.311415 23884 raft_consensus.cc:374] T 00000000000000000000000000000000 P 03080b54250949549141f11d712b5f36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:32:27.311481 23884 raft_consensus.cc:729] T 00000000000000000000000000000000 P 03080b54250949549141f11d712b5f36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03080b54250949549141f11d712b5f36, State: Initialized, Role: FOLLOWER
I20260809 15:32:27.312033 23884 consensus_queue.cc:260] T 00000000000000000000000000000000 P 03080b54250949549141f11d712b5f36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03080b54250949549141f11d712b5f36" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 35157 } }
I20260809 15:32:27.312252 23884 raft_consensus.cc:388] T 00000000000000000000000000000000 P 03080b54250949549141f11d712b5f36 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:32:27.312366 23884 raft_consensus.cc:482] T 00000000000000000000000000000000 P 03080b54250949549141f11d712b5f36 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:32:27.312490 23884 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 03080b54250949549141f11d712b5f36 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:32:27.313022 23887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:32:27.298896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52694 (local address 127.11.146.62:35157)
0809 15:32:27.299490 (+ 594us) server_negotiation.cc:206] Beginning negotiation
0809 15:32:27.299508 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 15:32:27.299844 (+ 336us) server_negotiation.cc:407] Connection header received
0809 15:32:27.300759 (+ 915us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:32:27.300782 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:32:27.301175 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:32:27.301508 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:32:27.302328 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:32:27.303765 (+ 1437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:32:27.304940 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:32:27.305439 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:32:27.305627 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:32:27.308225 (+ 2598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:32:27.308230 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:32:27.308241 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:32:27.308264 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:32:27.309948 (+ 1684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:32:27.310403 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:32:27.310408 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:32:27.310412 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:32:27.310519 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:32:27.310798 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:32:27.310802 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:32:27.310804 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:32:27.311162 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:32:27.311371 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0809 15:32:27.311835 (+ 464us) server_negotiation.cc:299] Negotiation successful
0809 15:32:27.312137 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":448,"thread_start_us":131,"threads_started":1}
I20260809 15:32:27.313598 23884 raft_consensus.cc:504] T 00000000000000000000000000000000 P 03080b54250949549141f11d712b5f36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03080b54250949549141f11d712b5f36" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 35157 } }
I20260809 15:32:27.313978 23884 leader_election.cc:302] T 00000000000000000000000000000000 P 03080b54250949549141f11d712b5f36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 03080b54250949549141f11d712b5f36; no voters:
I20260809 15:32:27.314352 23884 leader_election.cc:288] T 00000000000000000000000000000000 P 03080b54250949549141f11d712b5f36 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:32:27.314443 23890 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 03080b54250949549141f11d712b5f36 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:32:27.314692 23890 raft_consensus.cc:686] T 00000000000000000000000000000000 P 03080b54250949549141f11d712b5f36 [term 1 LEADER]: Becoming Leader. State: Replica: 03080b54250949549141f11d712b5f36, State: Running, Role: LEADER
I20260809 15:32:27.315018 23890 consensus_queue.cc:237] T 00000000000000000000000000000000 P 03080b54250949549141f11d712b5f36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03080b54250949549141f11d712b5f36" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 35157 } }
I20260809 15:32:27.315857 23884 sys_catalog.cc:564] T 00000000000000000000000000000000 P 03080b54250949549141f11d712b5f36 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:32:27.316263 23890 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03080b54250949549141f11d712b5f36 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "03080b54250949549141f11d712b5f36" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03080b54250949549141f11d712b5f36" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 35157 } } }
I20260809 15:32:27.316263 23891 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03080b54250949549141f11d712b5f36 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03080b54250949549141f11d712b5f36. Latest consensus state: current_term: 1 leader_uuid: "03080b54250949549141f11d712b5f36" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03080b54250949549141f11d712b5f36" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 35157 } } }
I20260809 15:32:27.316488 23890 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03080b54250949549141f11d712b5f36 [sys.catalog]: This master's current role is: LEADER
I20260809 15:32:27.316488 23891 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03080b54250949549141f11d712b5f36 [sys.catalog]: This master's current role is: LEADER
I20260809 15:32:27.318302 23895 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:32:27.318724 23884 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 15:32:27.321376 23895 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:32:27.337783 23895 catalog_manager.cc:1347] Generated new cluster ID: 883e79af05a6441592d6a3e408912c7a
I20260809 15:32:27.337869 23895 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:32:27.357143 23895 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:32:27.358486 23895 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:32:27.367887 23895 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 03080b54250949549141f11d712b5f36: Generated new TSK 0
I20260809 15:32:27.368765 23895 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.146.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
I20260809 15:32:28.161811 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.146.20:43839/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.1:0
--local_ip_for_outbound_sockets=127.11.146.1
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:35157
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:36877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:32:28.314580 23932 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:32:28.314803 23932 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:32:28.314841 23932 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:32:28.319723 23932 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:32:28.319856 23932 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:32:28.319983 23932 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.1
I20260809 15:32:28.327109 23932 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:36877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.11.146.20:43839/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:35157
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23932
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.1
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:32:28.328199 23932 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:32:28.329206 23932 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:32:28.339375 23938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:32:28.339526 23940 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:32:28.339382 23937 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:32:28.340030 23932 server_base.cc:1034] running on GCE node
I20260809 15:32:28.340467 23932 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:32:28.341225 23932 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:32:28.342423 23932 hybrid_clock.cc:648] HybridClock initialized: now 1786289548342387 us; error 44 us; skew 500 ppm
Aug 09 15:32:28 dist-test-slave-1jjb krb5kdc[23328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289548, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:32:28.345810 23932 init.cc:377] Logged in from keytab as kudu/127.11.146.1@KRBTEST.COM (short username kudu)
I20260809 15:32:28.346657 23932 webserver.cc:460] Webserver started at http://127.11.146.1:35763/ using document root <none> and password file <none>
I20260809 15:32:28.347175 23932 fs_manager.cc:359] Metadata directory not provided
I20260809 15:32:28.347234 23932 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:32:28.347451 23932 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 15:32:28 dist-test-slave-1jjb krb5kdc[23328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289548, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for HTTP/127.11.146.20@KRBTEST.COM
I20260809 15:32:28.368188 23932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-0/data/instance:
uuid: "d8ac47e4fd9c48e59863d0757eb25b39"
format_stamp: "Formatted at 2026-08-09 15:32:28 on dist-test-slave-1jjb"
server_key: "0bf80ef90b007456887a5b33bf49f932"
server_key_iv: "45e3051b8f0b34d78dd6207e0ec75f98"
server_key_version: "kuduclusterkey@0"
I20260809 15:32:28.369227 23932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance:
uuid: "d8ac47e4fd9c48e59863d0757eb25b39"
format_stamp: "Formatted at 2026-08-09 15:32:28 on dist-test-slave-1jjb"
server_key: "0bf80ef90b007456887a5b33bf49f932"
server_key_iv: "45e3051b8f0b34d78dd6207e0ec75f98"
server_key_version: "kuduclusterkey@0"
I20260809 15:32:28.374476 23932 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 15:32:28.395476 23950 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:32:28.396864 23932 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.001s
I20260809 15:32:28.397007 23932 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-0/wal
uuid: "d8ac47e4fd9c48e59863d0757eb25b39"
format_stamp: "Formatted at 2026-08-09 15:32:28 on dist-test-slave-1jjb"
server_key: "0bf80ef90b007456887a5b33bf49f932"
server_key_iv: "45e3051b8f0b34d78dd6207e0ec75f98"
server_key_version: "kuduclusterkey@0"
I20260809 15:32:28.397145 23932 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:32:28.411083 23932 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:32:28.414085 23932 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:32:28.414271 23932 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:32:28.414978 23932 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:32:28.415877 23932 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:32:28.416000 23932 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:32:28.416167 23932 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:32:28.416294 23932 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:32:28.427929 23932 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.1:35577
I20260809 15:32:28.429445 23932 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
I20260809 15:32:28.430397 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 23932
I20260809 15:32:28.430516 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance
I20260809 15:32:28.430788 11848 external_mini_cluster.cc:1428] Setting key 21d224d3212a5e7ca25071199563d318
I20260809 15:32:28.439049 24073 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.1:35577 every 8 connection(s)
WARNING: no policy specified for kudu/127.11.146.2@KRBTEST.COM; defaulting to no policy
Aug 09 15:32:28 dist-test-slave-1jjb krb5kdc[23328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289548, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:32:28.456456 24077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:32:28.441451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:35157 (local address 127.11.146.1:55425)
0809 15:32:28.442067 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0809 15:32:28.442122 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 15:32:28.443097 (+ 975us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:32:28.443914 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:32:28.443923 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:32:28.444268 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:32:28.444944 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:32:28.444963 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:32:28.446177 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:32:28.446180 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:32:28.447454 (+ 1274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:32:28.447465 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:32:28.448118 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:32:28.448122 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:32:28.448313 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:32:28.449082 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:32:28.449104 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:32:28.450849 (+ 1745us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:32:28.453223 (+ 2374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:32:28.453229 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:32:28.453243 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:32:28.453623 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:32:28.453964 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:32:28.453968 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:32:28.453970 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:32:28.454148 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:32:28.454635 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:32:28.454642 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:32:28.454930 (+ 288us) client_negotiation.cc:769] Sending connection context
0809 15:32:28.455102 (+ 172us) client_negotiation.cc:240] Negotiation successful
0809 15:32:28.455417 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":173,"threads_started":1}
I20260809 15:32:28.457787 24079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:32:28.442622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:55425 (local address 127.11.146.62:35157)
0809 15:32:28.443510 (+ 888us) server_negotiation.cc:206] Beginning negotiation
0809 15:32:28.443515 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:32:28.443528 (+ 13us) server_negotiation.cc:407] Connection header received
0809 15:32:28.443570 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:32:28.443573 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:32:28.443618 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:32:28.445088 (+ 1470us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:32:28.445199 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:32:28.446018 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:32:28.447594 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:32:28.447922 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:32:28.451036 (+ 3114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:32:28.451156 (+ 120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:32:28.451160 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:32:28.451162 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:32:28.451179 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:32:28.453087 (+ 1908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:32:28.453766 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:32:28.453769 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:32:28.453771 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:32:28.453858 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:32:28.454272 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:32:28.454275 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:32:28.454277 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:32:28.454491 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:32:28.457433 (+ 2942us) server_negotiation.cc:1035] Waiting for connection context
0809 15:32:28.457505 (+ 72us) server_negotiation.cc:299] Negotiation successful
0809 15:32:28.457639 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":805,"thread_start_us":86,"threads_started":1}
I20260809 15:32:28.458937 24074 heartbeater.cc:347] Connected to a master server at 127.11.146.62:35157
I20260809 15:32:28.459147 24074 heartbeater.cc:464] Registering TS with master...
I20260809 15:32:28.459654 24074 heartbeater.cc:511] Master 127.11.146.62:35157 requested a full tablet report, sending...
I20260809 15:32:28.461336 23842 ts_manager.cc:194] Registered new tserver with Master: d8ac47e4fd9c48e59863d0757eb25b39 (127.11.146.1:35577)
I20260809 15:32:28.462695 23842 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.1@KRBTEST.COM'} at 127.11.146.1:55425
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
I20260809 15:32:28.494807 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.146.20:43839/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.2:0
--local_ip_for_outbound_sockets=127.11.146.2
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:35157
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:36877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 15:32:28 dist-test-slave-1jjb krb5kdc[23328](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786289548, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 15:32:28.684803 24083 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:32:28.685213 24083 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:32:28.685313 24083 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:32:28.691331 24083 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:32:28.691484 24083 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:32:28.691617 24083 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.2
I20260809 15:32:28.699519 24083 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:36877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.11.146.20:43839/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:35157
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24083
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.2
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:32:28.701081 24083 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:32:28.702410 24083 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:32:28.723321 24090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:32:28.723886 24093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:32:28.724449 24089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:32:28.725641 24083 server_base.cc:1034] running on GCE node
I20260809 15:32:28.726137 24083 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:32:28.726935 24083 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:32:28.728114 24083 hybrid_clock.cc:648] HybridClock initialized: now 1786289548728077 us; error 53 us; skew 500 ppm
Aug 09 15:32:28 dist-test-slave-1jjb krb5kdc[23328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289548, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:32:28.732715 24083 init.cc:377] Logged in from keytab as kudu/127.11.146.2@KRBTEST.COM (short username kudu)
I20260809 15:32:28.733852 24083 webserver.cc:460] Webserver started at http://127.11.146.2:40311/ using document root <none> and password file <none>
I20260809 15:32:28.734625 24083 fs_manager.cc:359] Metadata directory not provided
I20260809 15:32:28.734902 24083 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:32:28.735584 24083 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 15:32:28 dist-test-slave-1jjb krb5kdc[23328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289548, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for HTTP/127.11.146.20@KRBTEST.COM
I20260809 15:32:28.751627 24083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-1/data/instance:
uuid: "1bc168a5392d4daf8cc03c09ccb87143"
format_stamp: "Formatted at 2026-08-09 15:32:28 on dist-test-slave-1jjb"
server_key: "6112aa1497894826c2e45dfffb0e1ac6"
server_key_iv: "594a680d154860a5a3efe65757db35f0"
server_key_version: "kuduclusterkey@0"
I20260809 15:32:28.752528 24083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance:
uuid: "1bc168a5392d4daf8cc03c09ccb87143"
format_stamp: "Formatted at 2026-08-09 15:32:28 on dist-test-slave-1jjb"
server_key: "6112aa1497894826c2e45dfffb0e1ac6"
server_key_iv: "594a680d154860a5a3efe65757db35f0"
server_key_version: "kuduclusterkey@0"
I20260809 15:32:28.758144 24083 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 15:32:28.785843 24100 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:32:28.787611 24083 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260809 15:32:28.787746 24083 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-1/wal
uuid: "1bc168a5392d4daf8cc03c09ccb87143"
format_stamp: "Formatted at 2026-08-09 15:32:28 on dist-test-slave-1jjb"
server_key: "6112aa1497894826c2e45dfffb0e1ac6"
server_key_iv: "594a680d154860a5a3efe65757db35f0"
server_key_version: "kuduclusterkey@0"
I20260809 15:32:28.787885 24083 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:32:28.808627 24083 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:32:28.813875 24083 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:32:28.814126 24083 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:32:28.815002 24083 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:32:28.816445 24083 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:32:28.816555 24083 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:32:28.816660 24083 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:32:28.816732 24083 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:32:28.833952 24083 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.2:34547
I20260809 15:32:28.835122 24083 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
I20260809 15:32:28.837138 24222 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.2:34547 every 8 connection(s)
I20260809 15:32:28.844511 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 24083
I20260809 15:32:28.844645 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance
I20260809 15:32:28.845005 11848 external_mini_cluster.cc:1428] Setting key 4b38803ebda3620ce8ce77d5d12430ec
Aug 09 15:32:28 dist-test-slave-1jjb krb5kdc[23328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289548, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:32:28.866707 24079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:32:28.840288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:42441 (local address 127.11.146.62:35157)
0809 15:32:28.840452 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 15:32:28.840457 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:32:28.845833 (+ 5376us) server_negotiation.cc:407] Connection header received
0809 15:32:28.850084 (+ 4251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:32:28.850089 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:32:28.850144 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:32:28.850194 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:32:28.851788 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:32:28.852620 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:32:28.854341 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:32:28.854694 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:32:28.854803 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:32:28.861762 (+ 6959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:32:28.861766 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:32:28.861769 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:32:28.861809 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:32:28.863801 (+ 1992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:32:28.864562 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:32:28.864566 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:32:28.864568 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:32:28.864671 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:32:28.865240 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:32:28.865244 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:32:28.865245 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:32:28.865492 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:32:28.865598 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 15:32:28.866394 (+ 796us) server_negotiation.cc:299] Negotiation successful
0809 15:32:28.866528 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 15:32:28.868687 24226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:32:28.839286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:35157 (local address 127.11.146.2:42441)
0809 15:32:28.845675 (+ 6389us) negotiation.cc:107] Waiting for socket to connect
0809 15:32:28.845732 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 15:32:28.849822 (+ 4090us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:32:28.850624 (+ 802us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:32:28.850632 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:32:28.850964 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:32:28.851618 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:32:28.851647 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:32:28.852790 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:32:28.852793 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:32:28.854208 (+ 1415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:32:28.854219 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:32:28.855045 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:32:28.855049 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:32:28.855246 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:32:28.859631 (+ 4385us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:32:28.859684 (+ 53us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:32:28.861565 (+ 1881us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:32:28.863995 (+ 2430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:32:28.864000 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:32:28.864015 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:32:28.864401 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:32:28.864825 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:32:28.864839 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:32:28.864849 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:32:28.865065 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:32:28.865684 (+ 619us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:32:28.865690 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:32:28.866073 (+ 383us) client_negotiation.cc:769] Sending connection context
0809 15:32:28.867189 (+ 1116us) client_negotiation.cc:240] Negotiation successful
0809 15:32:28.867592 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4925,"thread_start_us":140,"threads_started":1}
I20260809 15:32:28.870464 24224 heartbeater.cc:347] Connected to a master server at 127.11.146.62:35157
I20260809 15:32:28.870707 24224 heartbeater.cc:464] Registering TS with master...
I20260809 15:32:28.871274 24224 heartbeater.cc:511] Master 127.11.146.62:35157 requested a full tablet report, sending...
I20260809 15:32:28.872458 23842 ts_manager.cc:194] Registered new tserver with Master: 1bc168a5392d4daf8cc03c09ccb87143 (127.11.146.2:34547)
I20260809 15:32:28.873127 23842 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.2@KRBTEST.COM'} at 127.11.146.2:42441
WARNING: no policy specified for kudu/127.11.146.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
I20260809 15:32:28.903678 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.146.20:43839/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.3:0
--local_ip_for_outbound_sockets=127.11.146.3
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:35157
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:36877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:32:29.069087 24229 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:32:29.069432 24229 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:32:29.069506 24229 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:32:29.075156 24229 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:32:29.075255 24229 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:32:29.075376 24229 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.3
I20260809 15:32:29.082405 24229 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:36877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.11.146.20:43839/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:35157
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24229
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.3
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:32:29.083599 24229 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:32:29.084818 24229 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:32:29.096606 24237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:32:29.096854 24235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:32:29.097107 24234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:32:29.097445 24229 server_base.cc:1034] running on GCE node
I20260809 15:32:29.097821 24229 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:32:29.098438 24229 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:32:29.099684 24229 hybrid_clock.cc:648] HybridClock initialized: now 1786289549099670 us; error 41 us; skew 500 ppm
Aug 09 15:32:29 dist-test-slave-1jjb krb5kdc[23328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289549, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:32:29.102942 24229 init.cc:377] Logged in from keytab as kudu/127.11.146.3@KRBTEST.COM (short username kudu)
I20260809 15:32:29.103932 24229 webserver.cc:460] Webserver started at http://127.11.146.3:38303/ using document root <none> and password file <none>
I20260809 15:32:29.104576 24229 fs_manager.cc:359] Metadata directory not provided
I20260809 15:32:29.104666 24229 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:32:29.104900 24229 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 15:32:29 dist-test-slave-1jjb krb5kdc[23328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289549, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for HTTP/127.11.146.20@KRBTEST.COM
I20260809 15:32:29.117707 24229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-2/data/instance:
uuid: "074bea131394406880eb49cab921aefa"
format_stamp: "Formatted at 2026-08-09 15:32:29 on dist-test-slave-1jjb"
server_key: "459c451b80c3fc0fc7694b23f6974b65"
server_key_iv: "a8b28cd5dbb22ab0bcfe8becbeca67c3"
server_key_version: "kuduclusterkey@0"
I20260809 15:32:29.118594 24229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance:
uuid: "074bea131394406880eb49cab921aefa"
format_stamp: "Formatted at 2026-08-09 15:32:29 on dist-test-slave-1jjb"
server_key: "459c451b80c3fc0fc7694b23f6974b65"
server_key_iv: "a8b28cd5dbb22ab0bcfe8becbeca67c3"
server_key_version: "kuduclusterkey@0"
I20260809 15:32:29.127372 24229 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.004s sys 0.000s
I20260809 15:32:29.160451 24244 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:32:29.162158 24229 fs_manager.cc:725] Time spent opening block manager: real 0.013s user 0.002s sys 0.000s
I20260809 15:32:29.162353 24229 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-2/wal
uuid: "074bea131394406880eb49cab921aefa"
format_stamp: "Formatted at 2026-08-09 15:32:29 on dist-test-slave-1jjb"
server_key: "459c451b80c3fc0fc7694b23f6974b65"
server_key_iv: "a8b28cd5dbb22ab0bcfe8becbeca67c3"
server_key_version: "kuduclusterkey@0"
I20260809 15:32:29.162581 24229 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 09 15:32:29 dist-test-slave-1jjb krb5kdc[23328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289548, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for HTTP/127.11.146.20@KRBTEST.COM
I20260809 15:32:29.177685 24229 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:32:29.181185 24229 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:32:29.181401 24229 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:32:29.182076 24229 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:32:29.183161 24229 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:32:29.183261 24229 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:32:29.183360 24229 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:32:29.183427 24229 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:32:29.213438 24229 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.3:33543
I20260809 15:32:29.214771 24229 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
I20260809 15:32:29.216645 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 24229
I20260809 15:32:29.216760 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance
I20260809 15:32:29.217073 11848 external_mini_cluster.cc:1428] Setting key 6fb66f31aae9d625ed436109dcbd614f
I20260809 15:32:29.218488 24374 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.3:33543 every 8 connection(s)
Aug 09 15:32:29 dist-test-slave-1jjb krb5kdc[23328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289549, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:32:29.238579 24079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:32:29.221587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:48513 (local address 127.11.146.62:35157)
0809 15:32:29.221694 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0809 15:32:29.221698 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:32:29.222075 (+ 377us) server_negotiation.cc:407] Connection header received
0809 15:32:29.223161 (+ 1086us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:32:29.223165 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:32:29.223214 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:32:29.223259 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:32:29.224821 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:32:29.225660 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:32:29.227372 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:32:29.227695 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:32:29.227766 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:32:29.234550 (+ 6784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:32:29.234554 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:32:29.234557 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:32:29.234584 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:32:29.236364 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:32:29.236944 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:32:29.236948 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:32:29.236951 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:32:29.237031 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:32:29.237384 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:32:29.237387 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:32:29.237389 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:32:29.237593 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:32:29.237670 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 15:32:29.238298 (+ 628us) server_negotiation.cc:299] Negotiation successful
0809 15:32:29.238419 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 15:32:29.240350 24377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:32:29.220610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:35157 (local address 127.11.146.3:48513)
0809 15:32:29.221950 (+ 1340us) negotiation.cc:107] Waiting for socket to connect
0809 15:32:29.221998 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 15:32:29.222939 (+ 941us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:32:29.223717 (+ 778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:32:29.223725 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:32:29.224028 (+ 303us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:32:29.224667 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:32:29.224685 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:32:29.225809 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:32:29.225812 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:32:29.227221 (+ 1409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:32:29.227233 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:32:29.228026 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:32:29.228030 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:32:29.228358 (+ 328us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:32:29.230305 (+ 1947us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:32:29.231215 (+ 910us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:32:29.234367 (+ 3152us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:32:29.236497 (+ 2130us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:32:29.236502 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:32:29.236518 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:32:29.236836 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:32:29.237127 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:32:29.237129 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:32:29.237131 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:32:29.237283 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:32:29.237734 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:32:29.237740 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:32:29.238033 (+ 293us) client_negotiation.cc:769] Sending connection context
0809 15:32:29.239080 (+ 1047us) client_negotiation.cc:240] Negotiation successful
0809 15:32:29.239381 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1146,"thread_start_us":145,"threads_started":1}
I20260809 15:32:29.241786 24375 heartbeater.cc:347] Connected to a master server at 127.11.146.62:35157
I20260809 15:32:29.242029 24375 heartbeater.cc:464] Registering TS with master...
I20260809 15:32:29.242570 24375 heartbeater.cc:511] Master 127.11.146.62:35157 requested a full tablet report, sending...
I20260809 15:32:29.244565 23842 ts_manager.cc:194] Registered new tserver with Master: 074bea131394406880eb49cab921aefa (127.11.146.3:33543)
I20260809 15:32:29.245302 23842 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.3@KRBTEST.COM'} at 127.11.146.3:48513
I20260809 15:32:29.256171 11848 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:32:29.267944 24079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:32:29.258655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52704 (local address 127.11.146.62:35157)
0809 15:32:29.258761 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0809 15:32:29.258766 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:32:29.259096 (+ 330us) server_negotiation.cc:407] Connection header received
0809 15:32:29.259221 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:32:29.259224 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:32:29.259275 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:32:29.259352 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:32:29.260350 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:32:29.261117 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:32:29.262319 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:32:29.262661 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:32:29.262769 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:32:29.264519 (+ 1750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:32:29.264522 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:32:29.264525 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:32:29.264548 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:32:29.266276 (+ 1728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:32:29.266768 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:32:29.266771 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:32:29.266773 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:32:29.266855 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:32:29.267153 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:32:29.267156 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:32:29.267157 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:32:29.267333 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:32:29.267458 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 15:32:29.267725 (+ 267us) server_negotiation.cc:299] Negotiation successful
0809 15:32:29.267823 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 15:32:29.271323 23842 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52704:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:32:29.275738 23842 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:32:29.300875 24389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:32:29.288277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:33543 (local address 127.0.0.1:36872)
0809 15:32:29.290961 (+ 2684us) negotiation.cc:107] Waiting for socket to connect
0809 15:32:29.290973 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 15:32:29.291049 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:32:29.293668 (+ 2619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:32:29.293675 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:32:29.293697 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:32:29.293836 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:32:29.293842 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:32:29.295522 (+ 1680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:32:29.295526 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:32:29.297887 (+ 2361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:32:29.297898 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:32:29.299171 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:32:29.299175 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:32:29.299296 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:32:29.299336 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 15:32:29.299452 (+ 116us) client_negotiation.cc:240] Negotiation successful
0809 15:32:29.299564 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2624,"thread_start_us":138,"threads_started":1}
I20260809 15:32:29.302352 24390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:32:29.289041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36872 (local address 127.11.146.3:33543)
0809 15:32:29.292259 (+ 3218us) server_negotiation.cc:206] Beginning negotiation
0809 15:32:29.292273 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 15:32:29.292299 (+ 26us) server_negotiation.cc:407] Connection header received
0809 15:32:29.292383 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:32:29.292388 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:32:29.292599 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:32:29.293511 (+ 912us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:32:29.294041 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:32:29.295387 (+ 1346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:32:29.298037 (+ 2650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:32:29.298839 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:32:29.298954 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:32:29.299110 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 15:32:29.302115 (+ 3005us) server_negotiation.cc:299] Negotiation successful
0809 15:32:29.302214 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2141,"thread_start_us":164,"threads_started":1}
I20260809 15:32:29.305662 24291 tablet_service.cc:1467] Processing CreateTablet for tablet 6226049444e347479990221d9b728d77 (DEFAULT_TABLE table=test-table [id=bfcc47afa6624ffa8552584cf561be40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:32:29.306797 24291 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6226049444e347479990221d9b728d77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:32:29.316048 24395 tablet_bootstrap.cc:492] T 6226049444e347479990221d9b728d77 P 074bea131394406880eb49cab921aefa: Bootstrap starting.
I20260809 15:32:29.319238 24395 tablet_bootstrap.cc:654] T 6226049444e347479990221d9b728d77 P 074bea131394406880eb49cab921aefa: Neither blocks nor log segments found. Creating new log.
I20260809 15:32:29.319713 24393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:32:29.288161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:35577 (local address 127.0.0.1:50462)
0809 15:32:29.290560 (+ 2399us) negotiation.cc:107] Waiting for socket to connect
0809 15:32:29.290611 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 15:32:29.290737 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:32:29.301856 (+ 11119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:32:29.301859 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:32:29.301877 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:32:29.301974 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:32:29.301980 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:32:29.314521 (+ 12541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:32:29.314525 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:32:29.315911 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:32:29.315924 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:32:29.319194 (+ 3270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:32:29.319198 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:32:29.319316 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:32:29.319346 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 15:32:29.319435 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 15:32:29.319522 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2226,"thread_start_us":113,"threads_started":1}
I20260809 15:32:29.320354 24395 log.cc:824] T 6226049444e347479990221d9b728d77 P 074bea131394406880eb49cab921aefa: Log is configured to *not* fsync() on all Append() calls
I20260809 15:32:29.322505 24395 tablet_bootstrap.cc:492] T 6226049444e347479990221d9b728d77 P 074bea131394406880eb49cab921aefa: No bootstrap required, opened a new log
I20260809 15:32:29.322687 24395 ts_tablet_manager.cc:1397] T 6226049444e347479990221d9b728d77 P 074bea131394406880eb49cab921aefa: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.006s
I20260809 15:32:29.322922 24392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:32:29.289398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50462 (local address 127.11.146.1:35577)
0809 15:32:29.300595 (+ 11197us) server_negotiation.cc:206] Beginning negotiation
0809 15:32:29.300602 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:32:29.300626 (+ 24us) server_negotiation.cc:407] Connection header received
0809 15:32:29.300702 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:32:29.300707 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:32:29.301574 (+ 867us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:32:29.301715 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:32:29.311150 (+ 9435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:32:29.314356 (+ 3206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:32:29.316657 (+ 2301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:32:29.318784 (+ 2127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:32:29.318946 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:32:29.319119 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0809 15:32:29.322648 (+ 3529us) server_negotiation.cc:299] Negotiation successful
0809 15:32:29.322773 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11085,"thread_start_us":85,"threads_started":1}
I20260809 15:32:29.326174 23996 tablet_service.cc:1467] Processing CreateTablet for tablet 6226049444e347479990221d9b728d77 (DEFAULT_TABLE table=test-table [id=bfcc47afa6624ffa8552584cf561be40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:32:29.327106 24395 raft_consensus.cc:348] T 6226049444e347479990221d9b728d77 P 074bea131394406880eb49cab921aefa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac47e4fd9c48e59863d0757eb25b39" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 35577 } } peers { permanent_uuid: "074bea131394406880eb49cab921aefa" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 33543 } } peers { permanent_uuid: "1bc168a5392d4daf8cc03c09ccb87143" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 34547 } }
I20260809 15:32:29.327401 23996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6226049444e347479990221d9b728d77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:32:29.327440 24395 raft_consensus.cc:374] T 6226049444e347479990221d9b728d77 P 074bea131394406880eb49cab921aefa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:32:29.327595 24395 raft_consensus.cc:729] T 6226049444e347479990221d9b728d77 P 074bea131394406880eb49cab921aefa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 074bea131394406880eb49cab921aefa, State: Initialized, Role: FOLLOWER
I20260809 15:32:29.328516 24395 consensus_queue.cc:260] T 6226049444e347479990221d9b728d77 P 074bea131394406880eb49cab921aefa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac47e4fd9c48e59863d0757eb25b39" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 35577 } } peers { permanent_uuid: "074bea131394406880eb49cab921aefa" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 33543 } } peers { permanent_uuid: "1bc168a5392d4daf8cc03c09ccb87143" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 34547 } }
I20260809 15:32:29.329743 24395 ts_tablet_manager.cc:1428] T 6226049444e347479990221d9b728d77 P 074bea131394406880eb49cab921aefa: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260809 15:32:29.330152 24375 heartbeater.cc:503] Master 127.11.146.62:35157 was elected leader, sending a full tablet report...
I20260809 15:32:29.336750 24388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:32:29.289834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:34547 (local address 127.0.0.1:51492)
0809 15:32:29.296753 (+ 6919us) negotiation.cc:107] Waiting for socket to connect
0809 15:32:29.296766 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:32:29.296847 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:32:29.313077 (+ 16230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:32:29.313082 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:32:29.313112 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:32:29.313199 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:32:29.313205 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:32:29.320254 (+ 7049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:32:29.320257 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:32:29.321419 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:32:29.321432 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:32:29.336294 (+ 14862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:32:29.336299 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:32:29.336423 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:32:29.336451 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 15:32:29.336530 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 15:32:29.336611 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6862,"thread_start_us":81,"threads_started":1}
I20260809 15:32:29.337535 24394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:32:29.290280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51492 (local address 127.11.146.2:34547)
0809 15:32:29.312330 (+ 22050us) server_negotiation.cc:206] Beginning negotiation
0809 15:32:29.312347 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 15:32:29.312373 (+ 26us) server_negotiation.cc:407] Connection header received
0809 15:32:29.312454 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:32:29.312460 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:32:29.312674 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:32:29.312891 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:32:29.316105 (+ 3214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:32:29.317493 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:32:29.321687 (+ 4194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:32:29.322493 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:32:29.336291 (+ 13798us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:32:29.336466 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0809 15:32:29.337194 (+ 728us) server_negotiation.cc:299] Negotiation successful
0809 15:32:29.337305 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21935,"thread_start_us":135,"threads_started":1}
I20260809 15:32:29.340746 24148 tablet_service.cc:1467] Processing CreateTablet for tablet 6226049444e347479990221d9b728d77 (DEFAULT_TABLE table=test-table [id=bfcc47afa6624ffa8552584cf561be40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:32:29.341437 24398 tablet_bootstrap.cc:492] T 6226049444e347479990221d9b728d77 P d8ac47e4fd9c48e59863d0757eb25b39: Bootstrap starting.
I20260809 15:32:29.341907 24148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6226049444e347479990221d9b728d77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:32:29.344120 24398 tablet_bootstrap.cc:654] T 6226049444e347479990221d9b728d77 P d8ac47e4fd9c48e59863d0757eb25b39: Neither blocks nor log segments found. Creating new log.
I20260809 15:32:29.345098 24398 log.cc:824] T 6226049444e347479990221d9b728d77 P d8ac47e4fd9c48e59863d0757eb25b39: Log is configured to *not* fsync() on all Append() calls
I20260809 15:32:29.347245 24398 tablet_bootstrap.cc:492] T 6226049444e347479990221d9b728d77 P d8ac47e4fd9c48e59863d0757eb25b39: No bootstrap required, opened a new log
I20260809 15:32:29.347442 24398 ts_tablet_manager.cc:1397] T 6226049444e347479990221d9b728d77 P d8ac47e4fd9c48e59863d0757eb25b39: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 15:32:29.348431 24397 raft_consensus.cc:482] T 6226049444e347479990221d9b728d77 P 074bea131394406880eb49cab921aefa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:32:29.348637 24397 raft_consensus.cc:504] T 6226049444e347479990221d9b728d77 P 074bea131394406880eb49cab921aefa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac47e4fd9c48e59863d0757eb25b39" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 35577 } } peers { permanent_uuid: "074bea131394406880eb49cab921aefa" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 33543 } } peers { permanent_uuid: "1bc168a5392d4daf8cc03c09ccb87143" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 34547 } }
I20260809 15:32:29.353087 24397 leader_election.cc:288] T 6226049444e347479990221d9b728d77 P 074bea131394406880eb49cab921aefa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8ac47e4fd9c48e59863d0757eb25b39 (127.11.146.1:35577), 1bc168a5392d4daf8cc03c09ccb87143 (127.11.146.2:34547)
I20260809 15:32:29.353675 24401 tablet_bootstrap.cc:492] T 6226049444e347479990221d9b728d77 P 1bc168a5392d4daf8cc03c09ccb87143: Bootstrap starting.
I20260809 15:32:29.353945 24398 raft_consensus.cc:348] T 6226049444e347479990221d9b728d77 P d8ac47e4fd9c48e59863d0757eb25b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac47e4fd9c48e59863d0757eb25b39" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 35577 } } peers { permanent_uuid: "074bea131394406880eb49cab921aefa" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 33543 } } peers { permanent_uuid: "1bc168a5392d4daf8cc03c09ccb87143" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 34547 } }
I20260809 15:32:29.354278 24398 raft_consensus.cc:374] T 6226049444e347479990221d9b728d77 P d8ac47e4fd9c48e59863d0757eb25b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:32:29.354377 24398 raft_consensus.cc:729] T 6226049444e347479990221d9b728d77 P d8ac47e4fd9c48e59863d0757eb25b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8ac47e4fd9c48e59863d0757eb25b39, State: Initialized, Role: FOLLOWER
I20260809 15:32:29.354887 24398 consensus_queue.cc:260] T 6226049444e347479990221d9b728d77 P d8ac47e4fd9c48e59863d0757eb25b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac47e4fd9c48e59863d0757eb25b39" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 35577 } } peers { permanent_uuid: "074bea131394406880eb49cab921aefa" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 33543 } } peers { permanent_uuid: "1bc168a5392d4daf8cc03c09ccb87143" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 34547 } }
I20260809 15:32:29.355397 24377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:32:29.350253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:34547 (local address 127.11.146.3:36751)
0809 15:32:29.350441 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0809 15:32:29.350456 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:32:29.350536 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:32:29.351428 (+ 892us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:32:29.351431 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:32:29.351452 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:32:29.351662 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:32:29.351672 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:32:29.352807 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:32:29.352810 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:32:29.354055 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:32:29.354065 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:32:29.354912 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:32:29.354916 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:32:29.355084 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:32:29.355114 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 15:32:29.355169 (+ 55us) client_negotiation.cc:240] Negotiation successful
0809 15:32:29.355253 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114}
I20260809 15:32:29.356555 24398 ts_tablet_manager.cc:1428] T 6226049444e347479990221d9b728d77 P d8ac47e4fd9c48e59863d0757eb25b39: Time spent starting tablet: real 0.009s user 0.009s sys 0.000s
I20260809 15:32:29.356817 24401 tablet_bootstrap.cc:654] T 6226049444e347479990221d9b728d77 P 1bc168a5392d4daf8cc03c09ccb87143: Neither blocks nor log segments found. Creating new log.
I20260809 15:32:29.357009 24074 heartbeater.cc:503] Master 127.11.146.62:35157 was elected leader, sending a full tablet report...
I20260809 15:32:29.357529 24394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:32:29.350882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:36751 (local address 127.11.146.2:34547)
0809 15:32:29.351201 (+ 319us) server_negotiation.cc:206] Beginning negotiation
0809 15:32:29.351205 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:32:29.351217 (+ 12us) server_negotiation.cc:407] Connection header received
0809 15:32:29.351256 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:32:29.351258 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:32:29.351303 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:32:29.351779 (+ 476us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:32:29.351871 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:32:29.352618 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:32:29.354211 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:32:29.354778 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:32:29.357281 (+ 2503us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:32:29.357342 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 15:32:29.357375 (+ 33us) server_negotiation.cc:299] Negotiation successful
0809 15:32:29.357432 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255}
I20260809 15:32:29.357995 24166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6226049444e347479990221d9b728d77" candidate_uuid: "074bea131394406880eb49cab921aefa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bc168a5392d4daf8cc03c09ccb87143" is_pre_election: true
W20260809 15:32:29.360497 24245 leader_election.cc:341] T 6226049444e347479990221d9b728d77 P 074bea131394406880eb49cab921aefa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1bc168a5392d4daf8cc03c09ccb87143 (127.11.146.2:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260809 15:32:29.360692 24401 log.cc:824] T 6226049444e347479990221d9b728d77 P 1bc168a5392d4daf8cc03c09ccb87143: Log is configured to *not* fsync() on all Append() calls
I20260809 15:32:29.362664 24401 tablet_bootstrap.cc:492] T 6226049444e347479990221d9b728d77 P 1bc168a5392d4daf8cc03c09ccb87143: No bootstrap required, opened a new log
I20260809 15:32:29.362845 24401 ts_tablet_manager.cc:1397] T 6226049444e347479990221d9b728d77 P 1bc168a5392d4daf8cc03c09ccb87143: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260809 15:32:29.363113 24377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:32:29.350262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:35577 (local address 127.11.146.3:39387)
0809 15:32:29.355538 (+ 5276us) negotiation.cc:107] Waiting for socket to connect
0809 15:32:29.355551 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:32:29.355627 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:32:29.356334 (+ 707us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:32:29.356337 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:32:29.356369 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:32:29.356454 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:32:29.356461 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:32:29.357387 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:32:29.357390 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:32:29.361652 (+ 4262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:32:29.361666 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:32:29.362702 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:32:29.362719 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:32:29.362818 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:32:29.362841 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 15:32:29.362919 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 15:32:29.362989 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5224,"mutex_wait_us":12,"thread_start_us":178,"threads_started":1}
I20260809 15:32:29.363582 24392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:32:29.351006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:39387 (local address 127.11.146.1:35577)
0809 15:32:29.351116 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0809 15:32:29.351122 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:32:29.355810 (+ 4688us) server_negotiation.cc:407] Connection header received
0809 15:32:29.355878 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:32:29.355880 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:32:29.355952 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:32:29.356022 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:32:29.356584 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:32:29.357267 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:32:29.361799 (+ 4532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:32:29.362482 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:32:29.362568 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:32:29.362611 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 15:32:29.363346 (+ 735us) server_negotiation.cc:299] Negotiation successful
0809 15:32:29.363469 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 15:32:29.364144 24007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6226049444e347479990221d9b728d77" candidate_uuid: "074bea131394406880eb49cab921aefa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ac47e4fd9c48e59863d0757eb25b39" is_pre_election: true
I20260809 15:32:29.364403 24007 raft_consensus.cc:2454] T 6226049444e347479990221d9b728d77 P d8ac47e4fd9c48e59863d0757eb25b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 074bea131394406880eb49cab921aefa in term 0.
I20260809 15:32:29.364920 24246 leader_election.cc:302] T 6226049444e347479990221d9b728d77 P 074bea131394406880eb49cab921aefa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 074bea131394406880eb49cab921aefa, d8ac47e4fd9c48e59863d0757eb25b39; no voters: 1bc168a5392d4daf8cc03c09ccb87143
I20260809 15:32:29.365442 24397 raft_consensus.cc:2781] T 6226049444e347479990221d9b728d77 P 074bea131394406880eb49cab921aefa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:32:29.365520 24397 raft_consensus.cc:482] T 6226049444e347479990221d9b728d77 P 074bea131394406880eb49cab921aefa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:32:29.365562 24397 raft_consensus.cc:3037] T 6226049444e347479990221d9b728d77 P 074bea131394406880eb49cab921aefa [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:32:29.365904 24401 raft_consensus.cc:348] T 6226049444e347479990221d9b728d77 P 1bc168a5392d4daf8cc03c09ccb87143 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac47e4fd9c48e59863d0757eb25b39" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 35577 } } peers { permanent_uuid: "074bea131394406880eb49cab921aefa" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 33543 } } peers { permanent_uuid: "1bc168a5392d4daf8cc03c09ccb87143" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 34547 } }
I20260809 15:32:29.366098 24401 raft_consensus.cc:374] T 6226049444e347479990221d9b728d77 P 1bc168a5392d4daf8cc03c09ccb87143 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:32:29.366142 24401 raft_consensus.cc:729] T 6226049444e347479990221d9b728d77 P 1bc168a5392d4daf8cc03c09ccb87143 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bc168a5392d4daf8cc03c09ccb87143, State: Initialized, Role: FOLLOWER
I20260809 15:32:29.366844 24397 raft_consensus.cc:504] T 6226049444e347479990221d9b728d77 P 074bea131394406880eb49cab921aefa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac47e4fd9c48e59863d0757eb25b39" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 35577 } } peers { permanent_uuid: "074bea131394406880eb49cab921aefa" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 33543 } } peers { permanent_uuid: "1bc168a5392d4daf8cc03c09ccb87143" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 34547 } }
I20260809 15:32:29.366598 24401 consensus_queue.cc:260] T 6226049444e347479990221d9b728d77 P 1bc168a5392d4daf8cc03c09ccb87143 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac47e4fd9c48e59863d0757eb25b39" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 35577 } } peers { permanent_uuid: "074bea131394406880eb49cab921aefa" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 33543 } } peers { permanent_uuid: "1bc168a5392d4daf8cc03c09ccb87143" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 34547 } }
I20260809 15:32:29.367213 24397 leader_election.cc:288] T 6226049444e347479990221d9b728d77 P 074bea131394406880eb49cab921aefa [CANDIDATE]: Term 1 election: Requested vote from peers d8ac47e4fd9c48e59863d0757eb25b39 (127.11.146.1:35577), 1bc168a5392d4daf8cc03c09ccb87143 (127.11.146.2:34547)
I20260809 15:32:29.367630 24166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6226049444e347479990221d9b728d77" candidate_uuid: "074bea131394406880eb49cab921aefa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bc168a5392d4daf8cc03c09ccb87143"
I20260809 15:32:29.367754 24166 raft_consensus.cc:3037] T 6226049444e347479990221d9b728d77 P 1bc168a5392d4daf8cc03c09ccb87143 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:32:29.368255 24401 ts_tablet_manager.cc:1428] T 6226049444e347479990221d9b728d77 P 1bc168a5392d4daf8cc03c09ccb87143: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 15:32:29.368659 24224 heartbeater.cc:503] Master 127.11.146.62:35157 was elected leader, sending a full tablet report...
I20260809 15:32:29.368937 24166 raft_consensus.cc:2454] T 6226049444e347479990221d9b728d77 P 1bc168a5392d4daf8cc03c09ccb87143 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 074bea131394406880eb49cab921aefa in term 1.
I20260809 15:32:29.369321 24245 leader_election.cc:302] T 6226049444e347479990221d9b728d77 P 074bea131394406880eb49cab921aefa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 074bea131394406880eb49cab921aefa, 1bc168a5392d4daf8cc03c09ccb87143; no voters:
I20260809 15:32:29.370281 24007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6226049444e347479990221d9b728d77" candidate_uuid: "074bea131394406880eb49cab921aefa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8ac47e4fd9c48e59863d0757eb25b39"
I20260809 15:32:29.370406 24007 raft_consensus.cc:3037] T 6226049444e347479990221d9b728d77 P d8ac47e4fd9c48e59863d0757eb25b39 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:32:29.371512 24007 raft_consensus.cc:2454] T 6226049444e347479990221d9b728d77 P d8ac47e4fd9c48e59863d0757eb25b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 074bea131394406880eb49cab921aefa in term 1.
I20260809 15:32:29.371984 24397 raft_consensus.cc:2781] T 6226049444e347479990221d9b728d77 P 074bea131394406880eb49cab921aefa [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:32:29.372244 24397 raft_consensus.cc:686] T 6226049444e347479990221d9b728d77 P 074bea131394406880eb49cab921aefa [term 1 LEADER]: Becoming Leader. State: Replica: 074bea131394406880eb49cab921aefa, State: Running, Role: LEADER
I20260809 15:32:29.372586 24397 consensus_queue.cc:237] T 6226049444e347479990221d9b728d77 P 074bea131394406880eb49cab921aefa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac47e4fd9c48e59863d0757eb25b39" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 35577 } } peers { permanent_uuid: "074bea131394406880eb49cab921aefa" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 33543 } } peers { permanent_uuid: "1bc168a5392d4daf8cc03c09ccb87143" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 34547 } }
I20260809 15:32:29.375599 23842 catalog_manager.cc:5495] T 6226049444e347479990221d9b728d77 P 074bea131394406880eb49cab921aefa reported cstate change: term changed from 0 to 1, leader changed from <none> to 074bea131394406880eb49cab921aefa (127.11.146.3). New cstate: current_term: 1 leader_uuid: "074bea131394406880eb49cab921aefa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ac47e4fd9c48e59863d0757eb25b39" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 35577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "074bea131394406880eb49cab921aefa" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 33543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bc168a5392d4daf8cc03c09ccb87143" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260809 15:32:29.394230 24390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:32:29.390345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36874 (local address 127.11.146.3:33543)
0809 15:32:29.390470 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 15:32:29.390474 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:32:29.390583 (+ 109us) server_negotiation.cc:407] Connection header received
0809 15:32:29.390747 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:32:29.390750 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:32:29.390807 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:32:29.390918 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:32:29.391185 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:32:29.391709 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:32:29.392664 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:32:29.392897 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:32:29.393016 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:32:29.393376 (+ 360us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:32:29.393829 (+ 453us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:32:29.393949 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 15:32:29.394018 (+ 69us) server_negotiation.cc:299] Negotiation successful
0809 15:32:29.394066 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 15:32:29.399494 24166 raft_consensus.cc:1261] T 6226049444e347479990221d9b728d77 P 1bc168a5392d4daf8cc03c09ccb87143 [term 1 FOLLOWER]: Refusing update from remote peer 074bea131394406880eb49cab921aefa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:32:29.399535 24007 raft_consensus.cc:1261] T 6226049444e347479990221d9b728d77 P d8ac47e4fd9c48e59863d0757eb25b39 [term 1 FOLLOWER]: Refusing update from remote peer 074bea131394406880eb49cab921aefa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:32:29.400189 24397 consensus_queue.cc:1035] T 6226049444e347479990221d9b728d77 P 074bea131394406880eb49cab921aefa [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bc168a5392d4daf8cc03c09ccb87143" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:32:29.400426 24410 consensus_queue.cc:1035] T 6226049444e347479990221d9b728d77 P 074bea131394406880eb49cab921aefa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8ac47e4fd9c48e59863d0757eb25b39" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 35577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:32:29.411095 24411 mvcc.cc:205] Tried to move back new op lower bound from 7316641994334240768 to 7316641994232725504. Current Snapshot: MvccSnapshot[applied={T|T < 7316641994334240768}]
I20260809 15:32:29.413090 24409 mvcc.cc:205] Tried to move back new op lower bound from 7316641994334240768 to 7316641994232725504. Current Snapshot: MvccSnapshot[applied={T|T < 7316641994334240768}]
I20260809 15:32:29.414263 24412 mvcc.cc:205] Tried to move back new op lower bound from 7316641994334240768 to 7316641994232725504. Current Snapshot: MvccSnapshot[applied={T|T < 7316641994334240768}]
I20260809 15:32:29.423771 23842 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52704:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:32:29.423946 23842 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52704:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:32:29.426563 23842 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 03080b54250949549141f11d712b5f36: Sending DeleteTablet for 3 replicas of tablet 6226049444e347479990221d9b728d77
I20260809 15:32:29.427306 24291 tablet_service.cc:1514] Processing DeleteTablet for tablet 6226049444e347479990221d9b728d77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:32:29 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:36872
I20260809 15:32:29.427546 24148 tablet_service.cc:1514] Processing DeleteTablet for tablet 6226049444e347479990221d9b728d77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:32:29 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:51492
I20260809 15:32:29.428819 23996 tablet_service.cc:1514] Processing DeleteTablet for tablet 6226049444e347479990221d9b728d77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:32:29 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:50462
I20260809 15:32:29.429925 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 23932
I20260809 15:32:29.436360 24420 tablet_replica.cc:330] T 6226049444e347479990221d9b728d77 P 1bc168a5392d4daf8cc03c09ccb87143: stopping tablet replica
I20260809 15:32:29.439644 24420 raft_consensus.cc:2229] T 6226049444e347479990221d9b728d77 P 1bc168a5392d4daf8cc03c09ccb87143 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:32:29.441131 24419 tablet_replica.cc:330] T 6226049444e347479990221d9b728d77 P 074bea131394406880eb49cab921aefa: stopping tablet replica
I20260809 15:32:29.441478 24419 raft_consensus.cc:2229] T 6226049444e347479990221d9b728d77 P 074bea131394406880eb49cab921aefa [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:32:29.441972 24419 raft_consensus.cc:2258] T 6226049444e347479990221d9b728d77 P 074bea131394406880eb49cab921aefa [term 1 FOLLOWER]: Raft consensus is shut down!
W20260809 15:32:29.447397 23827 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.146.1:35577 (error 108)
I20260809 15:32:29.448541 24419 ts_tablet_manager.cc:1905] T 6226049444e347479990221d9b728d77 P 074bea131394406880eb49cab921aefa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:32:29.449311 24388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:32:29.448844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:35577 (local address 127.0.0.1:50476)
0809 15:32:29.449122 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0809 15:32:29.449209 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.1:35577: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158}
W20260809 15:32:29.449599 23827 catalog_manager.cc:4584] TS d8ac47e4fd9c48e59863d0757eb25b39 (127.11.146.1:35577): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6226049444e347479990221d9b728d77: Network error: Client connection negotiation failed: client connection to 127.11.146.1:35577: connect: Connection refused (error 111)
I20260809 15:32:29.449990 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 24083
I20260809 15:32:29.452920 24419 ts_tablet_manager.cc:1918] T 6226049444e347479990221d9b728d77 P 074bea131394406880eb49cab921aefa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:32:29.453019 24419 log.cc:1196] T 6226049444e347479990221d9b728d77 P 074bea131394406880eb49cab921aefa: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786289437399694-11848-0/minicluster-data/ts-2/wal/wals/6226049444e347479990221d9b728d77
I20260809 15:32:29.453343 24419 ts_tablet_manager.cc:1939] T 6226049444e347479990221d9b728d77 P 074bea131394406880eb49cab921aefa: Deleting consensus metadata
I20260809 15:32:29.454535 23829 catalog_manager.cc:4841] TS 074bea131394406880eb49cab921aefa (127.11.146.3:33543): tablet 6226049444e347479990221d9b728d77 (table test-table [id=bfcc47afa6624ffa8552584cf561be40]) successfully deleted
W20260809 15:32:29.490231 24388 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:32:29.489371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:34547 (local address 127.0.0.1:51498)
0809 15:32:29.489560 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0809 15:32:29.489576 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:32:29.489675 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:32:29.490094 (+ 419us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.2:34547: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":110}
I20260809 15:32:29.491101 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 24229
I20260809 15:32:29.504784 24388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:32:29.502782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:35577 (local address 127.0.0.1:50478)
0809 15:32:29.504621 (+ 1839us) negotiation.cc:107] Waiting for socket to connect
0809 15:32:29.504692 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.1:35577: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1744}
I20260809 15:32:29.505774 24388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:32:29.505503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:35577 (local address 127.0.0.1:50488)
0809 15:32:29.505647 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 15:32:29.505699 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.1:35577: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260809 15:32:29.509589 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 23808
I20260809 15:32:29.518186 11848 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 15:32:29.862255 11848 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 15:32:29.862413 11848 mini_ranger.cc:66] Stopping Ranger...
I20260809 15:32:30.206875 11848 mini_ranger.cc:68] Stopped Ranger
2026-08-09 15:32:30.207 UTC [23362] LOG: received smart shutdown request
2026-08-09 15:32:30.211 UTC [23362] LOG: background worker "logical replication launcher" (PID 23371) exited with exit code 1
2026-08-09 15:32:30.211 UTC [23366] LOG: shutting down
2026-08-09 15:32:30.375 UTC [23362] LOG: database system is shut down
2026-08-09T15:32:30Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (46037 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:32:30 dist-test-slave-1jjb krb5kdc[24431](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:32:30 dist-test-slave-1jjb krb5kdc[24431](info): set up 2 sockets
Aug 09 15:32:30 dist-test-slave-1jjb krb5kdc[24431](info): commencing operation
krb5kdc: starting...
W20260809 15:32:31.576152 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.054s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:32:31 dist-test-slave-1jjb krb5kdc[24431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289551, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:32:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:32:31Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.11.146.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.11.146.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.11.146.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/rangeradmin_127.11.146.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.11.146.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/rangeradmin_127.11.146.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.11.146.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.11.146.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.11.146.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/rangerlookup_127.11.146.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.11.146.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/rangerlookup_127.11.146.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.146.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.11.146.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.146.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/HTTP_127.11.146.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.146.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/HTTP_127.11.146.20@KRBTEST.COM.keytab.
I20260809 15:32:31.738451 11848 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taska0HXVP/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/postgres -l logfile start
2026-08-09 15:32:34.056 UTC [24464] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 15:32:34.056 UTC [24464] LOG: listening on IPv4 address "127.11.146.20", port 43445
2026-08-09 15:32:34.059 UTC [24464] LOG: listening on Unix socket "/tmp/.s.PGSQL.43445"
2026-08-09 15:32:34.080 UTC [24467] LOG: database system was shut down at 2026-08-09 15:32:32 UTC
2026-08-09 15:32:34.083 UTC [24464] LOG: database system is ready to accept connections
I20260809 15:32:35.057657 11848 mini_postgres.cc:96] Postgres bound to 43445
2026-08-09 15:32:35.065 UTC [24475] FATAL: database "slave" does not exist
127.11.146.20:43445 - accepting connections
I20260809 15:32:35.066063 11848 mini_ranger.cc:161] Starting Ranger...
I20260809 15:32:35.082129 11848 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 15:32:35.541723 11848 mini_ranger.cc:87] Created ranger Postgres database
I20260809 15:32:35.541806 11848 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ranger-admin
2026-08-09 15:32:35,827 [I] DB FLAVOR :POSTGRES
2026-08-09 15:32:35,828 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 15:32:35,828 [I] Checking connection..
2026-08-09 15:32:35,828 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 15:32:36,082 [I] Checking connection passed.
2026-08-09 15:32:36,083 [I] --------- Verifying version history table ---------
2026-08-09 15:32:36,083 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 15:32:36,341 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 15:32:36,342 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 15:32:36,592 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 15:32:36,592 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 15:32:36,592 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 15:32:36.851 UTC [24546] WARNING: there is no transaction in progress
2026-08-09 15:32:36,857 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 15:32:36,858 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 15:32:37,082 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 15:32:37,083 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 15:32:37,083 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 15:32:37,336 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 15:32:37,570 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-1jjb.c.gcp-upstream.internal','N') ;"
2026-08-09 15:32:37,817 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 15:32:38,079 [I] Table x_portal_user does not exist in database ranger
2026-08-09 15:32:38,080 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 15:32:38,339 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 15:32:38,340 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 15:32:38,606 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 15:32:38,860 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 15:32:38,861 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 15:32:39.819 UTC [24668] WARNING: there is no transaction in progress
2026-08-09 15:32:39.836 UTC [24668] WARNING: there is no transaction in progress
2026-08-09 15:32:39.853 UTC [24668] WARNING: there is no transaction in progress
2026-08-09 15:32:39.869 UTC [24668] WARNING: there is no transaction in progress
2026-08-09 15:32:39.885 UTC [24668] WARNING: there is no transaction in progress
2026-08-09 15:32:39.903 UTC [24668] WARNING: there is no transaction in progress
2026-08-09 15:32:39.957 UTC [24668] WARNING: there is no transaction in progress
2026-08-09 15:32:39.964 UTC [24668] WARNING: there is no transaction in progress
2026-08-09 15:32:39.979 UTC [24668] WARNING: there is no transaction in progress
2026-08-09 15:32:39.989 UTC [24668] WARNING: there is no transaction in progress
2026-08-09 15:32:39.999 UTC [24668] WARNING: there is no transaction in progress
2026-08-09 15:32:40.013 UTC [24668] WARNING: there is no transaction in progress
2026-08-09 15:32:40.022 UTC [24668] WARNING: there is no transaction in progress
2026-08-09 15:32:40.029 UTC [24668] WARNING: there is no transaction in progress
2026-08-09 15:32:40.035 UTC [24668] WARNING: there is no transaction in progress
2026-08-09 15:32:40.042 UTC [24668] WARNING: there is no transaction in progress
2026-08-09 15:32:40,680 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 15:32:40,680 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 15:32:40,917 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 15:32:40,917 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 15:32:41,155 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 15:32:41,155 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 15:32:41,407 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 15:32:41,408 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 15:32:41,632 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 15:32:41,854 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-1jjb.c.gcp-upstream.internal';"
2026-08-09 15:32:42,090 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 15:32:42,091 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 15:32:42,348 [I] DB_PATCHES have already been applied
I20260809 15:32:42.354286 11848 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ranger-admin:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taska0HXVP/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 15:32:42.354346 11848 mini_ranger.cc:193] Using host: 127.11.146.20
I20260809 15:32:42.359104 11848 mini_ranger.cc:227] Ranger admin URL: http://127.11.146.20:56821
Aug 09, 2026 3:32:42 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 3:32:42 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 3:32:42 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 3:32:42 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 3:32:42 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 3:32:43 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 3:32:43 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 15:32:43.534400 11848 mini_ranger.cc:160] Time spent starting Ranger: real 8.468s user 0.000s sys 0.012s
Aug 09, 2026 3:33:03 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 3:33:03 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 09, 2026 3:33:03 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 3:33:03 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 3:33:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 3:33:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 3:33:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 3:33:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 3:33:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 3:33:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 3:33:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 3:33:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 3:33:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 3:33:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 3:33:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 3:33:03 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 3:33:03 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 3:33:04 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 15:33:05.264743 11848 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.11.146.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.11.146.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.11.146.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/rangerkms_127.11.146.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.11.146.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/rangerkms_127.11.146.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.146.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.11.146.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.146.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/HTTP_127.11.146.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.146.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/HTTP_127.11.146.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 15:33:05 dist-test-slave-1jjb krb5kdc[24431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289585, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 15:33:05.367846 11848 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 15:33:05.377681 11848 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 15:33:06.197680 11848 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 15:33:06.197767 11848 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ranger-kms
I20260809 15:33:06.197788 11848 mini_ranger_kms.cc:227] Using postgres at 127.11.146.20:43445
2026-08-09 15:33:06,383 [I] DB FLAVOR :POSTGRES
2026-08-09 15:33:06,384 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 15:33:06,384 [I] Checking connection
2026-08-09 15:33:06,384 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:43445/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 15:33:06,646 [I] connection success
2026-08-09 15:33:06,646 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 15:33:06,646 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 15:33:06,647 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:43445/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 15:33:06,908 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 15:33:06,908 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 15:33:06,909 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 15:33:06,909 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.146.20:43445/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 15:33:07,174 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 15:33:07.658974 11848 mini_ranger_kms.cc:310] Created kms service
I20260809 15:33:07.839807 11848 mini_ranger_kms.cc:326] Created kudu user
I20260809 15:33:07.883175 11848 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 15:33:07 dist-test-slave-1jjb krb5kdc[24431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289585, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.11.146.20@KRBTEST.COM
I20260809 15:33:08.269591 11848 mini_ranger_kms.cc:384] Added ranger policy
I20260809 15:33:08.269776 11848 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ranger-kms:/tmp/dist-test-taska0HXVP/build/debug/bin/postgresql.jar:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taska0HXVP/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 15:33:08.269811 11848 mini_ranger_kms.cc:240] Using host: 127.11.146.20
I20260809 15:33:08.275822 11848 mini_ranger_kms.cc:276] Ranger KMS PID: 24866
I20260809 15:33:08.275938 11848 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.11.146.20:44059
Aug 09, 2026 3:33:09 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 3:33:09 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 3:33:09 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 3:33:09 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 3:33:10 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 3:33:10 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260809 15:33:10.648234 11848 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.280s user 0.011s sys 0.160s
I20260809 15:33:10.648372 11848 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 15:33:10.648452 11848 mini_ranger_kms.cc:401] 127.11.146.20:44059/kms/v1/keys
Aug 09 15:33:10 dist-test-slave-1jjb krb5kdc[24431](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786289590, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.146.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 09 15:33:11 dist-test-slave-1jjb krb5kdc[24431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289590, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.146.20@KRBTEST.COM for HTTP/127.11.146.20@KRBTEST.COM
Aug 09 15:33:11 dist-test-slave-1jjb krb5kdc[24431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289590, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.146.20@KRBTEST.COM for HTTP/127.11.146.20@KRBTEST.COM
Aug 09 15:33:13 dist-test-slave-1jjb krb5kdc[24431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289593, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.11.146.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
I20260809 15:33:13.742859 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:38461
--webserver_interface=127.11.146.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:45951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:38461
--ranger_config_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.146.20:44059/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:33:13.855448 24919 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:33:13.855661 24919 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:33:13.855697 24919 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:33:13.859737 24919 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:33:13.859787 24919 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:33:13.859807 24919 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:33:13.859823 24919 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:33:13.859846 24919 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:33:13.865110 24919 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:45951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/master-0/wal
--ranger_kms_url=127.11.146.20:44059/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:38461
--ranger_config_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:38461
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24919
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:33:13.866032 24919 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:33:13.866981 24919 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 15:33:13.876084 24919 server_base.cc:1034] running on GCE node
W20260809 15:33:13.876061 24925 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:13.876072 24927 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:13.876065 24929 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:13.876861 24919 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:33:13.877926 24919 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:33:13.879141 24919 hybrid_clock.cc:648] HybridClock initialized: now 1786289593879121 us; error 36 us; skew 500 ppm
Aug 09 15:33:13 dist-test-slave-1jjb krb5kdc[24431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289593, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:33:13.886785 24919 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:33:13.887660 24919 webserver.cc:460] Webserver started at http://127.11.146.62:37639/ using document root <none> and password file <none>
I20260809 15:33:13.888206 24919 fs_manager.cc:359] Metadata directory not provided
I20260809 15:33:13.888264 24919 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:33:13.888532 24919 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 15:33:13 dist-test-slave-1jjb krb5kdc[24431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289593, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for HTTP/127.11.146.20@KRBTEST.COM
I20260809 15:33:13.949975 24919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "bb0131f3ac804cc19a9c1e0283128869"
format_stamp: "Formatted at 2026-08-09 15:33:13 on dist-test-slave-1jjb"
server_key: "7001d7bd9ddee8a39250d61af1863312"
server_key_iv: "775f7d870693438f8e58aca896bba8ff"
server_key_version: "kuduclusterkey@0"
I20260809 15:33:13.950598 24919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "bb0131f3ac804cc19a9c1e0283128869"
format_stamp: "Formatted at 2026-08-09 15:33:13 on dist-test-slave-1jjb"
server_key: "7001d7bd9ddee8a39250d61af1863312"
server_key_iv: "775f7d870693438f8e58aca896bba8ff"
server_key_version: "kuduclusterkey@0"
I20260809 15:33:13.954505 24919 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 15:33:13.969913 24937 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:13.971560 24919 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:33:13.971720 24919 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "bb0131f3ac804cc19a9c1e0283128869"
format_stamp: "Formatted at 2026-08-09 15:33:13 on dist-test-slave-1jjb"
server_key: "7001d7bd9ddee8a39250d61af1863312"
server_key_iv: "775f7d870693438f8e58aca896bba8ff"
server_key_version: "kuduclusterkey@0"
I20260809 15:33:13.971853 24919 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:33:14.010994 24919 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:33:14.014005 24919 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:33:14.014216 24919 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:33:14.022127 24919 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:38461
I20260809 15:33:14.022135 24997 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:38461 every 8 connection(s)
I20260809 15:33:14.023077 24919 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:33:14.026470 24998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:33:14.031582 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 24919
I20260809 15:33:14.031718 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:33:14.032021 11848 external_mini_cluster.cc:1428] Setting key 5a2bfd97b7f4c289b87afc30dbac1938
I20260809 15:33:14.033440 24998 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869: Bootstrap starting.
I20260809 15:33:14.036154 24998 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869: Neither blocks nor log segments found. Creating new log.
I20260809 15:33:14.037034 24998 log.cc:824] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869: Log is configured to *not* fsync() on all Append() calls
I20260809 15:33:14.039294 24998 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869: No bootstrap required, opened a new log
Aug 09 15:33:14 dist-test-slave-1jjb krb5kdc[24431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289593, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:33:14.043591 24998 raft_consensus.cc:348] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb0131f3ac804cc19a9c1e0283128869" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 38461 } }
I20260809 15:33:14.043848 24998 raft_consensus.cc:374] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:33:14.043944 24998 raft_consensus.cc:729] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb0131f3ac804cc19a9c1e0283128869, State: Initialized, Role: FOLLOWER
I20260809 15:33:14.044482 24998 consensus_queue.cc:260] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb0131f3ac804cc19a9c1e0283128869" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 38461 } }
I20260809 15:33:14.044695 24998 raft_consensus.cc:388] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:33:14.044775 24998 raft_consensus.cc:482] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:33:14.044893 24998 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:33:14.045567 25001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:14.033426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42192 (local address 127.11.146.62:38461)
0809 15:33:14.033855 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:14.033875 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:14.033910 (+ 35us) server_negotiation.cc:407] Connection header received
0809 15:33:14.034518 (+ 608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:14.034533 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:14.034824 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:14.035138 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:14.035928 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:14.037011 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:14.038091 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:14.038543 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:14.038720 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:14.041194 (+ 2474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:14.041219 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:14.041230 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:14.041254 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:14.042808 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:14.043250 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:14.043261 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:14.043266 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:14.043374 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:14.043660 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:14.043663 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:14.043665 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:14.044178 (+ 513us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:14.044389 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:14.044637 (+ 248us) server_negotiation.cc:299] Negotiation successful
0809 15:33:14.044918 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":142,"threads_started":1}
I20260809 15:33:14.045861 24998 raft_consensus.cc:504] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb0131f3ac804cc19a9c1e0283128869" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 38461 } }
I20260809 15:33:14.046211 24998 leader_election.cc:302] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bb0131f3ac804cc19a9c1e0283128869; no voters:
I20260809 15:33:14.046499 24998 leader_election.cc:288] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:33:14.046597 25003 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:33:14.046856 25003 raft_consensus.cc:686] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [term 1 LEADER]: Becoming Leader. State: Replica: bb0131f3ac804cc19a9c1e0283128869, State: Running, Role: LEADER
I20260809 15:33:14.047183 25003 consensus_queue.cc:237] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb0131f3ac804cc19a9c1e0283128869" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 38461 } }
I20260809 15:33:14.047706 24998 sys_catalog.cc:564] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:33:14.048393 25003 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bb0131f3ac804cc19a9c1e0283128869" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb0131f3ac804cc19a9c1e0283128869" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 38461 } } }
I20260809 15:33:14.048522 25003 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [sys.catalog]: This master's current role is: LEADER
I20260809 15:33:14.048753 25003 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bb0131f3ac804cc19a9c1e0283128869. Latest consensus state: current_term: 1 leader_uuid: "bb0131f3ac804cc19a9c1e0283128869" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb0131f3ac804cc19a9c1e0283128869" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 38461 } } }
I20260809 15:33:14.048910 25003 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [sys.catalog]: This master's current role is: LEADER
I20260809 15:33:14.048907 25010 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:33:14.052004 25010 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:33:14.052424 24998 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 15:33:14.063256 25010 catalog_manager.cc:1347] Generated new cluster ID: 67a931b7b1f14213a4738d8db49b6070
I20260809 15:33:14.063325 25010 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:33:14.077235 25010 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:33:14.078485 25010 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:33:14.096760 25010 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869: Generated new TSK 0
I20260809 15:33:14.097635 25010 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.146.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
I20260809 15:33:14.814962 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.146.20:44059/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.1:0
--local_ip_for_outbound_sockets=127.11.146.1
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:38461
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:45951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:33:14.954008 25047 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:33:14.954226 25047 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:33:14.954265 25047 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:33:14.958272 25047 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:33:14.958326 25047 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:33:14.958413 25047 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.1
I20260809 15:33:14.963608 25047 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:45951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.11.146.20:44059/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:38461
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25047
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.1
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:33:14.964618 25047 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:33:14.965883 25047 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:33:14.976352 25054 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:14.976387 25055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:14.976854 25058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:14.977016 25047 server_base.cc:1034] running on GCE node
I20260809 15:33:14.977531 25047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:33:14.978329 25047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:33:14.981665 25047 hybrid_clock.cc:648] HybridClock initialized: now 1786289594981590 us; error 87 us; skew 500 ppm
Aug 09 15:33:14 dist-test-slave-1jjb krb5kdc[24431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289594, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:33:14.984972 25047 init.cc:377] Logged in from keytab as kudu/127.11.146.1@KRBTEST.COM (short username kudu)
I20260809 15:33:14.985742 25047 webserver.cc:460] Webserver started at http://127.11.146.1:33487/ using document root <none> and password file <none>
I20260809 15:33:14.986272 25047 fs_manager.cc:359] Metadata directory not provided
I20260809 15:33:14.986340 25047 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:33:14.986554 25047 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 15:33:14 dist-test-slave-1jjb krb5kdc[24431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289594, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for HTTP/127.11.146.20@KRBTEST.COM
I20260809 15:33:15.005772 25047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-0/data/instance:
uuid: "e11a602d7fd64ceea17a396173b1ecb6"
format_stamp: "Formatted at 2026-08-09 15:33:14 on dist-test-slave-1jjb"
server_key: "addcf08c51fb1091e746d311cb44fabb"
server_key_iv: "b410615a06b15796dc54e7f8fa841c11"
server_key_version: "kuduclusterkey@0"
I20260809 15:33:15.006379 25047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance:
uuid: "e11a602d7fd64ceea17a396173b1ecb6"
format_stamp: "Formatted at 2026-08-09 15:33:14 on dist-test-slave-1jjb"
server_key: "addcf08c51fb1091e746d311cb44fabb"
server_key_iv: "b410615a06b15796dc54e7f8fa841c11"
server_key_version: "kuduclusterkey@0"
I20260809 15:33:15.011050 25047 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 15:33:15.035056 25067 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:15.036708 25047 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.003s sys 0.000s
I20260809 15:33:15.036895 25047 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-0/wal
uuid: "e11a602d7fd64ceea17a396173b1ecb6"
format_stamp: "Formatted at 2026-08-09 15:33:14 on dist-test-slave-1jjb"
server_key: "addcf08c51fb1091e746d311cb44fabb"
server_key_iv: "b410615a06b15796dc54e7f8fa841c11"
server_key_version: "kuduclusterkey@0"
I20260809 15:33:15.037142 25047 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:33:15.053035 25047 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:33:15.056600 25047 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:33:15.056838 25047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:33:15.057592 25047 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:33:15.058626 25047 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:33:15.058737 25047 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:15.058900 25047 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:33:15.059000 25047 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:15.069553 25047 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.1:37925
I20260809 15:33:15.069728 25190 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.1:37925 every 8 connection(s)
I20260809 15:33:15.070690 25047 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
I20260809 15:33:15.079020 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 25047
I20260809 15:33:15.079150 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance
I20260809 15:33:15.079460 11848 external_mini_cluster.cc:1428] Setting key 87f6daa67bd13abbcd6cf93be16ed091
Aug 09 15:33:15 dist-test-slave-1jjb krb5kdc[24431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289594, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:33:15.095270 25194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:15.074229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:49693 (local address 127.11.146.62:38461)
0809 15:33:15.076618 (+ 2389us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:15.076630 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:15.076651 (+ 21us) server_negotiation.cc:407] Connection header received
0809 15:33:15.076737 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:15.076741 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:15.076794 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:15.076933 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:15.078627 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:15.083900 (+ 5273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:15.085642 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:15.086011 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:15.086121 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:15.090540 (+ 4419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:15.090544 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:15.090547 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:15.090573 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:15.092585 (+ 2012us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:15.093274 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:15.093280 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:15.093284 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:15.093382 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:15.093836 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:15.093841 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:15.093844 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:15.094100 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:15.094210 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:15.094910 (+ 700us) server_negotiation.cc:299] Negotiation successful
0809 15:33:15.095042 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2290,"thread_start_us":92,"threads_started":1}
I20260809 15:33:15.096206 25193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:15.073169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:38461 (local address 127.11.146.1:49693)
0809 15:33:15.074965 (+ 1796us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:15.075015 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:15.076127 (+ 1112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:15.077249 (+ 1122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:15.077258 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:15.077690 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:33:15.078453 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:15.078473 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:15.084075 (+ 5602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:15.084079 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:15.085493 (+ 1414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:15.085505 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:15.086302 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:15.086307 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:15.086505 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:15.088444 (+ 1939us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:33:15.088465 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:33:15.090336 (+ 1871us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:33:15.092729 (+ 2393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:15.092738 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:15.092756 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:15.093138 (+ 382us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:15.093495 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:15.093500 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:15.093503 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:15.093707 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:15.094236 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:33:15.094243 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:33:15.094587 (+ 344us) client_negotiation.cc:769] Sending connection context
0809 15:33:15.094796 (+ 209us) client_negotiation.cc:240] Negotiation successful
0809 15:33:15.095146 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1556,"thread_start_us":135,"threads_started":1}
I20260809 15:33:15.097910 25191 heartbeater.cc:347] Connected to a master server at 127.11.146.62:38461
I20260809 15:33:15.098161 25191 heartbeater.cc:464] Registering TS with master...
I20260809 15:33:15.098763 25191 heartbeater.cc:511] Master 127.11.146.62:38461 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.146.2@KRBTEST.COM; defaulting to no policy
I20260809 15:33:15.100634 24958 ts_manager.cc:194] Registered new tserver with Master: e11a602d7fd64ceea17a396173b1ecb6 (127.11.146.1:37925)
I20260809 15:33:15.101771 24958 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.1@KRBTEST.COM'} at 127.11.146.1:49693
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
I20260809 15:33:15.120112 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.146.20:44059/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.2:0
--local_ip_for_outbound_sockets=127.11.146.2
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:38461
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:45951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 15:33:15 dist-test-slave-1jjb krb5kdc[24431](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786289595, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 15:33:15.267621 25202 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:33:15.267985 25202 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:33:15.268123 25202 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:33:15.272388 25202 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:33:15.272457 25202 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:33:15.272543 25202 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.2
I20260809 15:33:15.277961 25202 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:45951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.11.146.20:44059/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:38461
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25202
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.2
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:33:15.279091 25202 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:33:15.280139 25202 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:33:15.289422 25210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:15.289412 25209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:15.289527 25212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:15.290089 25202 server_base.cc:1034] running on GCE node
I20260809 15:33:15.290553 25202 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:33:15.291380 25202 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:33:15.292591 25202 hybrid_clock.cc:648] HybridClock initialized: now 1786289595292569 us; error 43 us; skew 500 ppm
Aug 09 15:33:15 dist-test-slave-1jjb krb5kdc[24431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289595, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:33:15.296057 25202 init.cc:377] Logged in from keytab as kudu/127.11.146.2@KRBTEST.COM (short username kudu)
I20260809 15:33:15.296932 25202 webserver.cc:460] Webserver started at http://127.11.146.2:41651/ using document root <none> and password file <none>
I20260809 15:33:15.297461 25202 fs_manager.cc:359] Metadata directory not provided
I20260809 15:33:15.297518 25202 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:33:15.297708 25202 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 15:33:15 dist-test-slave-1jjb krb5kdc[24431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289595, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for HTTP/127.11.146.20@KRBTEST.COM
I20260809 15:33:15.317319 25202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-1/data/instance:
uuid: "56e7643f7ab5438683e46c67075de9d0"
format_stamp: "Formatted at 2026-08-09 15:33:15 on dist-test-slave-1jjb"
server_key: "e17a21ec99d923cbd2e5377d92f763c0"
server_key_iv: "869b308082030b72384bc44d2e7b5402"
server_key_version: "kuduclusterkey@0"
I20260809 15:33:15.317984 25202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance:
uuid: "56e7643f7ab5438683e46c67075de9d0"
format_stamp: "Formatted at 2026-08-09 15:33:15 on dist-test-slave-1jjb"
server_key: "e17a21ec99d923cbd2e5377d92f763c0"
server_key_iv: "869b308082030b72384bc44d2e7b5402"
server_key_version: "kuduclusterkey@0"
I20260809 15:33:15.322870 25202 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 15:33:15.345242 25220 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:15.349249 25202 fs_manager.cc:725] Time spent opening block manager: real 0.013s user 0.002s sys 0.000s
I20260809 15:33:15.349377 25202 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-1/wal
uuid: "56e7643f7ab5438683e46c67075de9d0"
format_stamp: "Formatted at 2026-08-09 15:33:15 on dist-test-slave-1jjb"
server_key: "e17a21ec99d923cbd2e5377d92f763c0"
server_key_iv: "869b308082030b72384bc44d2e7b5402"
server_key_version: "kuduclusterkey@0"
I20260809 15:33:15.349505 25202 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:33:15.390287 25202 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:33:15.394239 25202 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:33:15.394517 25202 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:33:15.395323 25202 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:33:15.396723 25202 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:33:15.396845 25202 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:15.396988 25202 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:33:15.397078 25202 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:15.411249 25202 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.2:45179
I20260809 15:33:15.412519 25202 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
I20260809 15:33:15.413178 25344 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.2:45179 every 8 connection(s)
I20260809 15:33:15.421993 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 25202
I20260809 15:33:15.422138 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance
I20260809 15:33:15.422462 11848 external_mini_cluster.cc:1428] Setting key cb500bc6b3f309e1f8cf1d57b8dd49ea
Aug 09 15:33:15 dist-test-slave-1jjb krb5kdc[24431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289595, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:33:15.431545 25194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:15.417022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:42321 (local address 127.11.146.62:38461)
0809 15:33:15.417156 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:15.417161 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:15.417727 (+ 566us) server_negotiation.cc:407] Connection header received
0809 15:33:15.418985 (+ 1258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:15.418989 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:15.419046 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:15.419100 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:15.421015 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:15.421886 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:15.423530 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:15.423848 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:15.423942 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:15.427210 (+ 3268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:15.427214 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:15.427216 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:15.427257 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:15.428964 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:15.429618 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:15.429622 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:15.429624 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:15.429715 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:15.430175 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:15.430179 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:15.430180 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:15.430460 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:15.430554 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:15.431238 (+ 684us) server_negotiation.cc:299] Negotiation successful
0809 15:33:15.431378 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 15:33:15.433324 25347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:15.415896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:38461 (local address 127.11.146.2:42321)
0809 15:33:15.417561 (+ 1665us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:15.417619 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:15.418711 (+ 1092us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:15.419502 (+ 791us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:15.419510 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:15.419867 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:33:15.420595 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:15.420616 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:15.422097 (+ 1481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:15.422101 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:15.423401 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:15.423412 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:15.424183 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:15.424187 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:15.424371 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:15.425089 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:33:15.425114 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:33:15.427017 (+ 1903us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:33:15.429120 (+ 2103us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:15.429126 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:15.429141 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:15.429490 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:15.429838 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:15.429841 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:15.429843 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:15.430036 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:15.430629 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:33:15.430635 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:33:15.430943 (+ 308us) client_negotiation.cc:769] Sending connection context
0809 15:33:15.431976 (+ 1033us) client_negotiation.cc:240] Negotiation successful
0809 15:33:15.432352 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1442,"thread_start_us":167,"threads_started":1}
I20260809 15:33:15.434975 25345 heartbeater.cc:347] Connected to a master server at 127.11.146.62:38461
I20260809 15:33:15.435206 25345 heartbeater.cc:464] Registering TS with master...
I20260809 15:33:15.435767 25345 heartbeater.cc:511] Master 127.11.146.62:38461 requested a full tablet report, sending...
I20260809 15:33:15.437006 24958 ts_manager.cc:194] Registered new tserver with Master: 56e7643f7ab5438683e46c67075de9d0 (127.11.146.2:45179)
I20260809 15:33:15.437713 24958 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.2@KRBTEST.COM'} at 127.11.146.2:42321
WARNING: no policy specified for kudu/127.11.146.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
I20260809 15:33:15.482977 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.146.20:44059/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.3:0
--local_ip_for_outbound_sockets=127.11.146.3
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:38461
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:45951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:33:15.656137 25351 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:33:15.656589 25351 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:33:15.656724 25351 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:33:15.665544 25351 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:33:15.665674 25351 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:33:15.665815 25351 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.3
I20260809 15:33:15.673563 25351 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:45951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.11.146.20:44059/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:38461
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25351
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.3
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:33:15.675187 25351 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:33:15.676566 25351 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 15:33:15.690649 25351 server_base.cc:1034] running on GCE node
W20260809 15:33:15.690562 25361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:15.693284 25357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:15.695575 25358 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:15.696214 25351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:33:15.697010 25351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:33:15.704439 25351 hybrid_clock.cc:648] HybridClock initialized: now 1786289595704354 us; error 98 us; skew 500 ppm
Aug 09 15:33:15 dist-test-slave-1jjb krb5kdc[24431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289595, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:33:15.708154 25351 init.cc:377] Logged in from keytab as kudu/127.11.146.3@KRBTEST.COM (short username kudu)
I20260809 15:33:15.709249 25351 webserver.cc:460] Webserver started at http://127.11.146.3:42977/ using document root <none> and password file <none>
I20260809 15:33:15.709967 25351 fs_manager.cc:359] Metadata directory not provided
I20260809 15:33:15.710103 25351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:33:15.710367 25351 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 15:33:15 dist-test-slave-1jjb krb5kdc[24431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289595, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for HTTP/127.11.146.20@KRBTEST.COM
Aug 09 15:33:15 dist-test-slave-1jjb krb5kdc[24431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289595, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for HTTP/127.11.146.20@KRBTEST.COM
I20260809 15:33:15.730964 25351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-2/data/instance:
uuid: "9febaa34a77d4404a95313071b52c65f"
format_stamp: "Formatted at 2026-08-09 15:33:15 on dist-test-slave-1jjb"
server_key: "da1c2a3f105b8f9c135492f1de8fd0f5"
server_key_iv: "792d31ec9f5b0e5d2a6c30a7e5c82f78"
server_key_version: "kuduclusterkey@0"
I20260809 15:33:15.731678 25351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance:
uuid: "9febaa34a77d4404a95313071b52c65f"
format_stamp: "Formatted at 2026-08-09 15:33:15 on dist-test-slave-1jjb"
server_key: "da1c2a3f105b8f9c135492f1de8fd0f5"
server_key_iv: "792d31ec9f5b0e5d2a6c30a7e5c82f78"
server_key_version: "kuduclusterkey@0"
I20260809 15:33:15.738888 25351 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260809 15:33:15.766760 25370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:15.768882 25351 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.003s sys 0.000s
I20260809 15:33:15.769381 25351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-2/wal
uuid: "9febaa34a77d4404a95313071b52c65f"
format_stamp: "Formatted at 2026-08-09 15:33:15 on dist-test-slave-1jjb"
server_key: "da1c2a3f105b8f9c135492f1de8fd0f5"
server_key_iv: "792d31ec9f5b0e5d2a6c30a7e5c82f78"
server_key_version: "kuduclusterkey@0"
I20260809 15:33:15.769600 25351 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:33:15.809890 25351 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:33:15.813759 25351 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:33:15.814042 25351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:33:15.814874 25351 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:33:15.816037 25351 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:33:15.816167 25351 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:15.816290 25351 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:33:15.816365 25351 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:15.830909 25351 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.3:40261
I20260809 15:33:15.832813 25351 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
I20260809 15:33:15.837601 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 25351
I20260809 15:33:15.837721 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance
I20260809 15:33:15.838032 11848 external_mini_cluster.cc:1428] Setting key f03600153a71a5b6397eb8dbf4a5fadf
I20260809 15:33:15.834141 25495 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.3:40261 every 8 connection(s)
Aug 09 15:33:15 dist-test-slave-1jjb krb5kdc[24431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289595, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:33:15.857025 25194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:15.838398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:43955 (local address 127.11.146.62:38461)
0809 15:33:15.838750 (+ 352us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:15.838755 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:15.841314 (+ 2559us) server_negotiation.cc:407] Connection header received
0809 15:33:15.842708 (+ 1394us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:15.842711 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:15.842761 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:15.842825 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:15.844540 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:15.845309 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:15.846930 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:15.847242 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:15.847356 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:15.850675 (+ 3319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:15.850679 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:15.850682 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:15.850709 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:15.854252 (+ 3543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:15.855037 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:15.855041 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:15.855043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:15.855134 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:15.855642 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:15.855646 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:15.855648 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:15.855877 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:15.855977 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:15.856719 (+ 742us) server_negotiation.cc:299] Negotiation successful
0809 15:33:15.856844 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261}
I20260809 15:33:15.858875 25498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:15.836359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:38461 (local address 127.11.146.3:43955)
0809 15:33:15.841155 (+ 4796us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:15.841227 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:15.842483 (+ 1256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:15.843313 (+ 830us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:15.843321 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:15.843655 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:33:15.844341 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:15.844360 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:15.845463 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:15.845466 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:15.846779 (+ 1313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:15.846791 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:15.847598 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:15.847602 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:15.847808 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:15.848620 (+ 812us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:33:15.848642 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:33:15.850484 (+ 1842us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:33:15.854433 (+ 3949us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:15.854439 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:15.854456 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:15.854816 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:15.855249 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:15.855252 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:15.855254 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:15.855530 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:15.856050 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:33:15.856056 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:33:15.856421 (+ 365us) client_negotiation.cc:769] Sending connection context
0809 15:33:15.857463 (+ 1042us) client_negotiation.cc:240] Negotiation successful
0809 15:33:15.857800 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4589,"thread_start_us":122,"threads_started":1}
I20260809 15:33:15.860507 25496 heartbeater.cc:347] Connected to a master server at 127.11.146.62:38461
I20260809 15:33:15.860730 25496 heartbeater.cc:464] Registering TS with master...
I20260809 15:33:15.861281 25496 heartbeater.cc:511] Master 127.11.146.62:38461 requested a full tablet report, sending...
I20260809 15:33:15.862341 24958 ts_manager.cc:194] Registered new tserver with Master: 9febaa34a77d4404a95313071b52c65f (127.11.146.3:40261)
I20260809 15:33:15.863049 24958 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.3@KRBTEST.COM'} at 127.11.146.3:43955
I20260809 15:33:15.866662 11848 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:33:15.867604 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 25047
I20260809 15:33:15.879863 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 25202
I20260809 15:33:15.891388 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 25351
I20260809 15:33:15.901870 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 24919
I20260809 15:33:15.910991 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:38461
--webserver_interface=127.11.146.62
--webserver_port=37639
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:45951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:38461
--ranger_config_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.146.20:44059/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.146.20:44059/kms with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:33:16.023675 25499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:33:16.023909 25499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:33:16.023947 25499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:33:16.027922 25499 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:33:16.027971 25499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:33:16.027990 25499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:33:16.028007 25499 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:33:16.028056 25499 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:33:16.033442 25499 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:45951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.146.20:44059/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:38461
--ranger_config_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:38461
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=37639
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25499
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:33:16.034446 25499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:33:16.035439 25499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:33:16.043871 25509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:16.043882 25507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:16.043882 25506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:16.044095 25499 server_base.cc:1034] running on GCE node
I20260809 15:33:16.044708 25499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:33:16.045811 25499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:33:16.047004 25499 hybrid_clock.cc:648] HybridClock initialized: now 1786289596046975 us; error 42 us; skew 500 ppm
Aug 09 15:33:16 dist-test-slave-1jjb krb5kdc[24431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289596, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:33:16.049815 25499 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:33:16.050623 25499 webserver.cc:460] Webserver started at http://127.11.146.62:37639/ using document root <none> and password file <none>
I20260809 15:33:16.051146 25499 fs_manager.cc:359] Metadata directory not provided
I20260809 15:33:16.051235 25499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 15:33:16 dist-test-slave-1jjb krb5kdc[24431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289596, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for HTTP/127.11.146.20@KRBTEST.COM
I20260809 15:33:16.131014 25499 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:33:16.133409 25517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:16.134735 25499 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 15:33:16.134877 25499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "bb0131f3ac804cc19a9c1e0283128869"
format_stamp: "Formatted at 2026-08-09 15:33:13 on dist-test-slave-1jjb"
server_key: "7001d7bd9ddee8a39250d61af1863312"
server_key_iv: "775f7d870693438f8e58aca896bba8ff"
server_key_version: "kuduclusterkey@0"
I20260809 15:33:16.135483 25499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:33:16.151019 25499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:33:16.153959 25499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:33:16.154150 25499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:33:16.161585 25499 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:38461
I20260809 15:33:16.161595 25573 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:38461 every 8 connection(s)
I20260809 15:33:16.162645 25499 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:33:16.166837 25574 sys_catalog.cc:263] Verifying existing consensus state
I20260809 15:33:16.168608 25574 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869: Bootstrap starting.
I20260809 15:33:16.169397 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 25499
I20260809 15:33:16.169862 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.146.20:44059/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.1:37925
--local_ip_for_outbound_sockets=127.11.146.1
--tserver_master_addrs=127.11.146.62:38461
--webserver_port=33487
--webserver_interface=127.11.146.1
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:45951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.146.20:44059/kms with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:33:16.185283 25574 log.cc:824] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869: Log is configured to *not* fsync() on all Append() calls
I20260809 15:33:16.191876 25574 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 15:33:16.192333 25574 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869: Bootstrap complete.
I20260809 15:33:16.196484 25574 raft_consensus.cc:348] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb0131f3ac804cc19a9c1e0283128869" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 38461 } }
I20260809 15:33:16.196887 25574 raft_consensus.cc:729] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb0131f3ac804cc19a9c1e0283128869, State: Initialized, Role: FOLLOWER
I20260809 15:33:16.197395 25574 consensus_queue.cc:260] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb0131f3ac804cc19a9c1e0283128869" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 38461 } }
I20260809 15:33:16.197540 25574 raft_consensus.cc:388] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:33:16.197624 25574 raft_consensus.cc:482] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:33:16.197741 25574 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [term 1 FOLLOWER]: Advancing to term 2
I20260809 15:33:16.199615 25574 raft_consensus.cc:504] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb0131f3ac804cc19a9c1e0283128869" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 38461 } }
I20260809 15:33:16.199939 25574 leader_election.cc:302] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bb0131f3ac804cc19a9c1e0283128869; no voters:
I20260809 15:33:16.200320 25574 leader_election.cc:288] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 15:33:16.200404 25579 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 15:33:16.200616 25579 raft_consensus.cc:686] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [term 2 LEADER]: Becoming Leader. State: Replica: bb0131f3ac804cc19a9c1e0283128869, State: Running, Role: LEADER
I20260809 15:33:16.200915 25579 consensus_queue.cc:237] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb0131f3ac804cc19a9c1e0283128869" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 38461 } }
I20260809 15:33:16.201567 25574 sys_catalog.cc:564] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:33:16.201860 25579 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bb0131f3ac804cc19a9c1e0283128869. Latest consensus state: current_term: 2 leader_uuid: "bb0131f3ac804cc19a9c1e0283128869" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb0131f3ac804cc19a9c1e0283128869" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 38461 } } }
I20260809 15:33:16.202000 25579 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [sys.catalog]: This master's current role is: LEADER
I20260809 15:33:16.202378 25585 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:33:16.202402 25582 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "bb0131f3ac804cc19a9c1e0283128869" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb0131f3ac804cc19a9c1e0283128869" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 38461 } } }
I20260809 15:33:16.202621 25582 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869 [sys.catalog]: This master's current role is: LEADER
I20260809 15:33:16.205754 25585 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:33:16.206223 25574 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 15:33:16.206458 25585 catalog_manager.cc:1259] Loaded cluster ID: 67a931b7b1f14213a4738d8db49b6070
I20260809 15:33:16.206511 25585 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:33:16.208518 25585 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:33:16.211875 25585 catalog_manager.cc:5879] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869: Loaded TSK: 0
I20260809 15:33:16.213780 25585 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 15:33:16.313390 25577 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:33:16.313716 25577 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:33:16.313802 25577 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:33:16.319715 25577 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:33:16.319784 25577 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:33:16.319954 25577 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.1
I20260809 15:33:16.327481 25577 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:45951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.146.20:44059/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.1:37925
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.146.1
--webserver_port=33487
--tserver_master_addrs=127.11.146.62:38461
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25577
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.1
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:33:16.328660 25577 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:33:16.329905 25577 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:33:16.341737 25620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:16.341925 25618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:16.342409 25617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:16.342696 25577 server_base.cc:1034] running on GCE node
I20260809 15:33:16.343130 25577 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:33:16.343847 25577 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:33:16.345036 25577 hybrid_clock.cc:648] HybridClock initialized: now 1786289596345012 us; error 40 us; skew 500 ppm
Aug 09 15:33:16 dist-test-slave-1jjb krb5kdc[24431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289596, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:33:16.348546 25577 init.cc:377] Logged in from keytab as kudu/127.11.146.1@KRBTEST.COM (short username kudu)
I20260809 15:33:16.349577 25577 webserver.cc:460] Webserver started at http://127.11.146.1:33487/ using document root <none> and password file <none>
I20260809 15:33:16.350225 25577 fs_manager.cc:359] Metadata directory not provided
I20260809 15:33:16.350328 25577 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 15:33:16 dist-test-slave-1jjb krb5kdc[24431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289596, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for HTTP/127.11.146.20@KRBTEST.COM
I20260809 15:33:16.380374 25577 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.000s
I20260809 15:33:16.383671 25628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:16.385298 25577 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 15:33:16.385419 25577 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-0/wal
uuid: "e11a602d7fd64ceea17a396173b1ecb6"
format_stamp: "Formatted at 2026-08-09 15:33:14 on dist-test-slave-1jjb"
server_key: "addcf08c51fb1091e746d311cb44fabb"
server_key_iv: "b410615a06b15796dc54e7f8fa841c11"
server_key_version: "kuduclusterkey@0"
I20260809 15:33:16.386174 25577 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:33:16.437068 25577 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:33:16.441275 25577 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:33:16.441504 25577 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:33:16.442330 25577 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:33:16.443437 25577 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:33:16.443501 25577 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:16.443564 25577 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:33:16.443595 25577 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:16.455295 25577 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.1:37925
I20260809 15:33:16.455629 25756 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.1:37925 every 8 connection(s)
I20260809 15:33:16.456679 25577 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
I20260809 15:33:16.465214 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 25577
I20260809 15:33:16.465759 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.146.20:44059/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.2:45179
--local_ip_for_outbound_sockets=127.11.146.2
--tserver_master_addrs=127.11.146.62:38461
--webserver_port=41651
--webserver_interface=127.11.146.2
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:45951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.146.20:44059/kms with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 15:33:16 dist-test-slave-1jjb krb5kdc[24431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289596, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:33:16.491233 25759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:16.459679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:46709 (local address 127.11.146.62:38461)
0809 15:33:16.461882 (+ 2203us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:16.461905 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:16.461951 (+ 46us) server_negotiation.cc:407] Connection header received
0809 15:33:16.464486 (+ 2535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:16.464506 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:16.464929 (+ 423us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:16.465358 (+ 429us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:16.466484 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:16.467477 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:16.470164 (+ 2687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:16.472252 (+ 2088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:16.472448 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:16.485167 (+ 12719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:16.485175 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:16.485192 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:16.485228 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:16.487319 (+ 2091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:16.487957 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:16.487963 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:16.487970 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:16.488126 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:16.488555 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:16.488559 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:16.488564 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:16.489105 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:16.489223 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:16.489928 (+ 705us) server_negotiation.cc:299] Negotiation successful
0809 15:33:16.490247 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2020,"thread_start_us":139,"threads_started":1}
I20260809 15:33:16.492949 25760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:16.459968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:38461 (local address 127.11.146.1:46709)
0809 15:33:16.460581 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:16.460641 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:16.463972 (+ 3331us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:16.465358 (+ 1386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:16.465366 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:16.465719 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:33:16.466309 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:16.466325 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:16.467623 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:16.467627 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:16.469990 (+ 2363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:16.470008 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:16.472781 (+ 2773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:16.472788 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:16.473064 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:16.483121 (+ 10057us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:33:16.483147 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:33:16.484901 (+ 1754us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:33:16.487461 (+ 2560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:16.487468 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:16.487483 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:16.487804 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:16.488239 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:16.488242 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:16.488244 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:16.488424 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:16.489293 (+ 869us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:33:16.489299 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:33:16.489580 (+ 281us) client_negotiation.cc:769] Sending connection context
0809 15:33:16.491724 (+ 2144us) client_negotiation.cc:240] Negotiation successful
0809 15:33:16.492039 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":138,"threads_started":1}
I20260809 15:33:16.495733 25757 heartbeater.cc:347] Connected to a master server at 127.11.146.62:38461
I20260809 15:33:16.495973 25757 heartbeater.cc:464] Registering TS with master...
I20260809 15:33:16.496585 25757 heartbeater.cc:511] Master 127.11.146.62:38461 requested a full tablet report, sending...
W20260809 15:33:16.498667 25757 heartbeater.cc:644] Failed to heartbeat to 127.11.146.62:38461 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 15:33:16.498780 25757 heartbeater.cc:464] Registering TS with master...
I20260809 15:33:16.498951 25757 heartbeater.cc:511] Master 127.11.146.62:38461 requested a full tablet report, sending...
I20260809 15:33:16.499818 25757 heartbeater.cc:464] Registering TS with master...
I20260809 15:33:16.499992 25757 heartbeater.cc:511] Master 127.11.146.62:38461 requested a full tablet report, sending...
W20260809 15:33:16.500787 25757 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 15:33:16.614004 25761 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:33:16.614434 25761 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:33:16.614596 25761 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:33:16.620483 25761 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:33:16.620611 25761 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:33:16.620766 25761 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.2
I20260809 15:33:16.627318 25761 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:45951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.146.20:44059/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.2:45179
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.146.2
--webserver_port=41651
--tserver_master_addrs=127.11.146.62:38461
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25761
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.2
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:33:16.628921 25761 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:33:16.630162 25761 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:33:16.641188 25766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:16.641742 25770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:16.642339 25768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:16.643035 25761 server_base.cc:1034] running on GCE node
I20260809 15:33:16.643460 25761 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:33:16.644234 25761 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:33:16.651607 25761 hybrid_clock.cc:648] HybridClock initialized: now 1786289596651565 us; error 49 us; skew 500 ppm
Aug 09 15:33:16 dist-test-slave-1jjb krb5kdc[24431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289596, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:33:16.655023 25761 init.cc:377] Logged in from keytab as kudu/127.11.146.2@KRBTEST.COM (short username kudu)
I20260809 15:33:16.656062 25761 webserver.cc:460] Webserver started at http://127.11.146.2:41651/ using document root <none> and password file <none>
I20260809 15:33:16.656841 25761 fs_manager.cc:359] Metadata directory not provided
I20260809 15:33:16.656944 25761 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 15:33:16 dist-test-slave-1jjb krb5kdc[24431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289596, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for HTTP/127.11.146.20@KRBTEST.COM
I20260809 15:33:16.674041 25761 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 15:33:16.676656 25780 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:16.680249 25761 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.001s
I20260809 15:33:16.680369 25761 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-1/wal
uuid: "56e7643f7ab5438683e46c67075de9d0"
format_stamp: "Formatted at 2026-08-09 15:33:15 on dist-test-slave-1jjb"
server_key: "e17a21ec99d923cbd2e5377d92f763c0"
server_key_iv: "869b308082030b72384bc44d2e7b5402"
server_key_version: "kuduclusterkey@0"
I20260809 15:33:16.681039 25761 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:33:16.699471 25761 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:33:16.703490 25761 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:33:16.703701 25761 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:33:16.704430 25761 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:33:16.705569 25761 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:33:16.705668 25761 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:16.705727 25761 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:33:16.705762 25761 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:16.717557 25761 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.2:45179
I20260809 15:33:16.717654 25904 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.2:45179 every 8 connection(s)
I20260809 15:33:16.718830 25761 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
Aug 09 15:33:16 dist-test-slave-1jjb krb5kdc[24431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289596, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:33:16.728404 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 25761
I20260809 15:33:16.728950 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.146.20:44059/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.3:40261
--local_ip_for_outbound_sockets=127.11.146.3
--tserver_master_addrs=127.11.146.62:38461
--webserver_port=42977
--webserver_interface=127.11.146.3
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:45951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.146.20:44059/kms with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:33:16.733556 25759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:16.720851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:41721 (local address 127.11.146.62:38461)
0809 15:33:16.721001 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:16.721005 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:16.722067 (+ 1062us) server_negotiation.cc:407] Connection header received
0809 15:33:16.723018 (+ 951us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:16.723022 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:16.723084 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:16.723211 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:16.724357 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:16.724960 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:16.726118 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:16.726353 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:16.726462 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:16.729113 (+ 2651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:16.729118 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:16.729121 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:16.729155 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:16.731132 (+ 1977us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:16.731676 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:16.731681 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:16.731683 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:16.731779 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:16.732176 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:16.732182 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:16.732184 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:16.732386 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:16.732506 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:16.733154 (+ 648us) server_negotiation.cc:299] Negotiation successful
0809 15:33:16.733324 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 15:33:16.735020 25907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:16.721404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:38461 (local address 127.11.146.2:41721)
0809 15:33:16.721919 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:16.721960 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:16.722813 (+ 853us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:16.723410 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:16.723417 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:16.723683 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:33:16.724197 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:16.724213 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:16.725094 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:16.725099 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:16.725991 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:16.726000 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:16.726501 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:16.726505 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:16.726666 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:16.727179 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:33:16.727196 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:33:16.728868 (+ 1672us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:33:16.731249 (+ 2381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:16.731256 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:16.731269 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:16.731554 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:16.731887 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:16.731892 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:16.731895 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:16.732039 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:16.732504 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:33:16.732511 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:33:16.732838 (+ 327us) client_negotiation.cc:769] Sending connection context
0809 15:33:16.733808 (+ 970us) client_negotiation.cc:240] Negotiation successful
0809 15:33:16.734161 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":150,"threads_started":1}
I20260809 15:33:16.736323 25905 heartbeater.cc:347] Connected to a master server at 127.11.146.62:38461
I20260809 15:33:16.736609 25905 heartbeater.cc:464] Registering TS with master...
I20260809 15:33:16.737205 25905 heartbeater.cc:511] Master 127.11.146.62:38461 requested a full tablet report, sending...
W20260809 15:33:16.742587 25905 heartbeater.cc:644] Failed to heartbeat to 127.11.146.62:38461 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 15:33:16.742717 25905 heartbeater.cc:464] Registering TS with master...
I20260809 15:33:16.742900 25905 heartbeater.cc:511] Master 127.11.146.62:38461 requested a full tablet report, sending...
I20260809 15:33:16.743734 25905 heartbeater.cc:464] Registering TS with master...
I20260809 15:33:16.743914 25905 heartbeater.cc:511] Master 127.11.146.62:38461 requested a full tablet report, sending...
W20260809 15:33:16.744812 25905 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 15:33:16.884374 25908 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:33:16.884688 25908 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:33:16.884792 25908 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:33:16.890632 25908 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:33:16.890695 25908 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:33:16.890781 25908 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.3
I20260809 15:33:16.897436 25908 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:45951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.146.20:44059/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.3:40261
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.146.3
--webserver_port=42977
--tserver_master_addrs=127.11.146.62:38461
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25908
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.3
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:33:16.898557 25908 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:33:16.899864 25908 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:33:16.911507 25914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:16.911998 25916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:16.912091 25913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:16.913275 25908 server_base.cc:1034] running on GCE node
I20260809 15:33:16.913682 25908 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:33:16.914350 25908 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:33:16.915534 25908 hybrid_clock.cc:648] HybridClock initialized: now 1786289596915504 us; error 42 us; skew 500 ppm
Aug 09 15:33:16 dist-test-slave-1jjb krb5kdc[24431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289596, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:33:16.919044 25908 init.cc:377] Logged in from keytab as kudu/127.11.146.3@KRBTEST.COM (short username kudu)
I20260809 15:33:16.920042 25908 webserver.cc:460] Webserver started at http://127.11.146.3:42977/ using document root <none> and password file <none>
I20260809 15:33:16.920725 25908 fs_manager.cc:359] Metadata directory not provided
I20260809 15:33:16.920893 25908 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 15:33:16 dist-test-slave-1jjb krb5kdc[24431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289596, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for HTTP/127.11.146.20@KRBTEST.COM
I20260809 15:33:16.937690 25908 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:33:16.940404 25926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:16.941695 25908 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:33:16.941835 25908 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-2/wal
uuid: "9febaa34a77d4404a95313071b52c65f"
format_stamp: "Formatted at 2026-08-09 15:33:15 on dist-test-slave-1jjb"
server_key: "da1c2a3f105b8f9c135492f1de8fd0f5"
server_key_iv: "792d31ec9f5b0e5d2a6c30a7e5c82f78"
server_key_version: "kuduclusterkey@0"
I20260809 15:33:16.942449 25908 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:33:16.968519 25908 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:33:16.971590 25908 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:33:16.971779 25908 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:33:16.972435 25908 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:33:16.973301 25908 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:33:16.973357 25908 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:16.973397 25908 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:33:16.973448 25908 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:16.984239 25908 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.3:40261
I20260809 15:33:16.985222 25908 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
I20260809 15:33:16.991572 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 25908
I20260809 15:33:16.993566 26060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.3:40261 every 8 connection(s)
Aug 09 15:33:16 dist-test-slave-1jjb krb5kdc[24431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289596, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:33:17.000027 25759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:16.987098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:47585 (local address 127.11.146.62:38461)
0809 15:33:16.987226 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:16.987231 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:16.988222 (+ 991us) server_negotiation.cc:407] Connection header received
0809 15:33:16.989209 (+ 987us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:16.989212 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:16.989282 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:16.989383 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:16.990416 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:16.990948 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:16.992622 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:16.992879 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:16.992954 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:16.995799 (+ 2845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:16.995803 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:16.995805 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:16.995842 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:16.997406 (+ 1564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:16.998032 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:16.998036 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:16.998038 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:16.998138 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:16.998656 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:16.998661 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:16.998664 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:16.998892 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:16.999002 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:16.999723 (+ 721us) server_negotiation.cc:299] Negotiation successful
0809 15:33:16.999840 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 15:33:17.001590 26063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:16.987585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:38461 (local address 127.11.146.3:47585)
0809 15:33:16.988042 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:16.988126 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:16.988989 (+ 863us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:16.989556 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:16.989563 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:16.989816 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:33:16.990271 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:16.990284 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:16.991102 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:16.991106 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:16.992482 (+ 1376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:16.992494 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:16.993113 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:16.993115 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:16.993248 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:16.993846 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:33:16.993863 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:33:16.995623 (+ 1760us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:33:16.997538 (+ 1915us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:16.997544 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:16.997557 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:16.997918 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:16.998280 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:16.998283 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:16.998285 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:16.998483 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:16.999079 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:33:16.999086 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:33:16.999426 (+ 340us) client_negotiation.cc:769] Sending connection context
0809 15:33:17.000216 (+ 790us) client_negotiation.cc:240] Negotiation successful
0809 15:33:17.000564 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":131,"threads_started":1}
I20260809 15:33:17.002951 26061 heartbeater.cc:347] Connected to a master server at 127.11.146.62:38461
I20260809 15:33:17.003177 26061 heartbeater.cc:464] Registering TS with master...
I20260809 15:33:17.003644 26061 heartbeater.cc:511] Master 127.11.146.62:38461 requested a full tablet report, sending...
I20260809 15:33:17.004828 26066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:16.992264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42198 (local address 127.11.146.62:38461)
0809 15:33:16.992575 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:16.992585 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:16.993934 (+ 1349us) server_negotiation.cc:407] Connection header received
0809 15:33:16.994057 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:16.994061 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:16.994118 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:16.994208 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:16.995408 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:16.996501 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:16.997754 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:16.998111 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:16.998214 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:16.999782 (+ 1568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:16.999786 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:16.999788 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:16.999812 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:17.001568 (+ 1756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:17.002081 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:17.002087 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:17.002090 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:17.002181 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:17.002851 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:17.002854 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:17.002855 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:17.003941 (+ 1086us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:17.004176 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:17.004375 (+ 199us) server_negotiation.cc:299] Negotiation successful
0809 15:33:17.004506 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":229,"thread_start_us":132,"threads_started":1}
I20260809 15:33:17.005131 25536 ts_manager.cc:194] Registered new tserver with Master: 9febaa34a77d4404a95313071b52c65f (127.11.146.3:40261)
I20260809 15:33:17.006378 25536 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.3@KRBTEST.COM'} at 127.11.146.3:47585
Aug 09 15:33:17 dist-test-slave-1jjb krb5kdc[24431](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786289597, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:33:17.501014 25757 heartbeater.cc:464] Registering TS with master...
I20260809 15:33:17.501299 25757 heartbeater.cc:511] Master 127.11.146.62:38461 requested a full tablet report, sending...
I20260809 15:33:17.502074 25536 ts_manager.cc:194] Registered new tserver with Master: e11a602d7fd64ceea17a396173b1ecb6 (127.11.146.1:37925)
I20260809 15:33:17.502919 25536 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.1@KRBTEST.COM'} at 127.11.146.1:46709
Aug 09 15:33:17 dist-test-slave-1jjb krb5kdc[24431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289597, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for HTTP/127.11.146.20@KRBTEST.COM
I20260809 15:33:17.745049 25905 heartbeater.cc:464] Registering TS with master...
I20260809 15:33:17.745373 25905 heartbeater.cc:511] Master 127.11.146.62:38461 requested a full tablet report, sending...
I20260809 15:33:17.746049 25536 ts_manager.cc:194] Registered new tserver with Master: 56e7643f7ab5438683e46c67075de9d0 (127.11.146.2:45179)
I20260809 15:33:17.746454 11848 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:33:17.746784 25536 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.2@KRBTEST.COM'} at 127.11.146.2:41721
I20260809 15:33:17.756532 26078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:17.748446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42214 (local address 127.11.146.62:38461)
0809 15:33:17.749068 (+ 622us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:17.749073 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:17.749086 (+ 13us) server_negotiation.cc:407] Connection header received
0809 15:33:17.749140 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:17.749146 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:17.749195 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:17.749291 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:17.749938 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:17.750454 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:17.751222 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:17.751512 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:17.751639 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:17.752983 (+ 1344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:17.752987 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:17.752990 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:17.753017 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:17.754463 (+ 1446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:17.754882 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:17.754886 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:17.754888 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:17.754966 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:17.755224 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:17.755227 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:17.755229 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:17.755646 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:17.755833 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:17.756157 (+ 324us) server_negotiation.cc:299] Negotiation successful
0809 15:33:17.756303 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":541,"thread_start_us":73,"threads_started":1}
I20260809 15:33:17.760064 25536 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42214:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:33:17.763782 25536 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:33:17.787127 26088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:17.774506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:45179 (local address 127.0.0.1:41856)
0809 15:33:17.779176 (+ 4670us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:17.779187 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:17.779248 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:17.779868 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:17.779875 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:17.779901 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:33:17.780054 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:17.780063 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:17.782558 (+ 2495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:17.782562 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:17.784204 (+ 1642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:17.784215 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:17.786584 (+ 2369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:17.786588 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:17.786701 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:17.786743 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 15:33:17.786840 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 15:33:17.786957 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4617,"mutex_wait_us":44,"thread_start_us":93,"threads_started":1}
I20260809 15:33:17.788046 26087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:17.774674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41856 (local address 127.11.146.2:45179)
0809 15:33:17.779455 (+ 4781us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:17.779461 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:17.779481 (+ 20us) server_negotiation.cc:407] Connection header received
0809 15:33:17.779545 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:17.779549 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:17.779709 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:17.779901 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:33:17.780226 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:17.782427 (+ 2201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:17.784353 (+ 1926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:17.786173 (+ 1820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:17.786294 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:17.786500 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:17.787791 (+ 1291us) server_negotiation.cc:299] Negotiation successful
0809 15:33:17.787896 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4682,"thread_start_us":87,"threads_started":1}
I20260809 15:33:17.789357 26084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:17.774379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:37925 (local address 127.0.0.1:42702)
0809 15:33:17.778795 (+ 4416us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:17.778846 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:17.778971 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:17.784682 (+ 5711us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:17.784686 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:17.784704 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:33:17.784829 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:17.784836 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:17.786357 (+ 1521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:17.786361 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:17.787657 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:17.787671 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:17.788942 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:17.788946 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:17.789047 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:17.789085 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 15:33:17.789147 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 15:33:17.789223 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4223,"thread_start_us":103,"threads_started":1}
I20260809 15:33:17.790066 26090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:17.778298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42702 (local address 127.11.146.1:37925)
0809 15:33:17.784042 (+ 5744us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:17.784049 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:17.784093 (+ 44us) server_negotiation.cc:407] Connection header received
0809 15:33:17.784175 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:17.784180 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:17.784374 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:17.784513 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:33:17.785017 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:17.786225 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:17.787826 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:17.788774 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:17.789574 (+ 800us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:17.789731 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:17.789785 (+ 54us) server_negotiation.cc:299] Negotiation successful
0809 15:33:17.789911 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5635,"thread_start_us":76,"threads_started":1}
I20260809 15:33:17.791586 25822 tablet_service.cc:1467] Processing CreateTablet for tablet fed4fe7b9220450e850ca61759dffef4 (DEFAULT_TABLE table=test-table [id=956e6272d8ee45b1a635864244f3cb99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:33:17.792421 26089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:17.775931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39390 (local address 127.11.146.3:40261)
0809 15:33:17.776266 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:17.776275 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:17.780301 (+ 4026us) server_negotiation.cc:407] Connection header received
0809 15:33:17.780582 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:17.780588 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:17.780771 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:17.780903 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:33:17.781323 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:17.782655 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:17.790877 (+ 8222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:17.791550 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:17.791622 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:17.791727 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:17.792083 (+ 356us) server_negotiation.cc:299] Negotiation successful
0809 15:33:17.792219 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":148,"threads_started":1}
I20260809 15:33:17.792866 26085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:17.775473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:40261 (local address 127.0.0.1:39390)
0809 15:33:17.780196 (+ 4723us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:17.780212 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:17.780378 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:17.781084 (+ 706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:17.781087 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:17.781104 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:33:17.781202 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:17.781207 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:17.782832 (+ 1625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:17.782835 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:17.789800 (+ 6965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:17.789811 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:17.791812 (+ 2001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:17.791814 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:17.791892 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:17.791908 (+ 16us) client_negotiation.cc:769] Sending connection context
0809 15:33:17.792641 (+ 733us) client_negotiation.cc:240] Negotiation successful
0809 15:33:17.792726 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4647,"mutex_wait_us":5387,"thread_start_us":106,"threads_started":1}
I20260809 15:33:17.793092 25822 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fed4fe7b9220450e850ca61759dffef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:33:17.794476 25684 tablet_service.cc:1467] Processing CreateTablet for tablet fed4fe7b9220450e850ca61759dffef4 (DEFAULT_TABLE table=test-table [id=956e6272d8ee45b1a635864244f3cb99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:33:17.795560 25684 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fed4fe7b9220450e850ca61759dffef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:33:17.795703 25984 tablet_service.cc:1467] Processing CreateTablet for tablet fed4fe7b9220450e850ca61759dffef4 (DEFAULT_TABLE table=test-table [id=956e6272d8ee45b1a635864244f3cb99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:33:17.796672 25984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fed4fe7b9220450e850ca61759dffef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:33:17.808022 26092 tablet_bootstrap.cc:492] T fed4fe7b9220450e850ca61759dffef4 P 9febaa34a77d4404a95313071b52c65f: Bootstrap starting.
I20260809 15:33:17.809314 26093 tablet_bootstrap.cc:492] T fed4fe7b9220450e850ca61759dffef4 P 56e7643f7ab5438683e46c67075de9d0: Bootstrap starting.
I20260809 15:33:17.810515 26092 tablet_bootstrap.cc:654] T fed4fe7b9220450e850ca61759dffef4 P 9febaa34a77d4404a95313071b52c65f: Neither blocks nor log segments found. Creating new log.
I20260809 15:33:17.811398 26093 tablet_bootstrap.cc:654] T fed4fe7b9220450e850ca61759dffef4 P 56e7643f7ab5438683e46c67075de9d0: Neither blocks nor log segments found. Creating new log.
I20260809 15:33:17.811444 26092 log.cc:824] T fed4fe7b9220450e850ca61759dffef4 P 9febaa34a77d4404a95313071b52c65f: Log is configured to *not* fsync() on all Append() calls
I20260809 15:33:17.812574 26093 log.cc:824] T fed4fe7b9220450e850ca61759dffef4 P 56e7643f7ab5438683e46c67075de9d0: Log is configured to *not* fsync() on all Append() calls
I20260809 15:33:17.813961 26092 tablet_bootstrap.cc:492] T fed4fe7b9220450e850ca61759dffef4 P 9febaa34a77d4404a95313071b52c65f: No bootstrap required, opened a new log
I20260809 15:33:17.814146 26092 ts_tablet_manager.cc:1397] T fed4fe7b9220450e850ca61759dffef4 P 9febaa34a77d4404a95313071b52c65f: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 15:33:17.814482 26093 tablet_bootstrap.cc:492] T fed4fe7b9220450e850ca61759dffef4 P 56e7643f7ab5438683e46c67075de9d0: No bootstrap required, opened a new log
I20260809 15:33:17.814641 26093 ts_tablet_manager.cc:1397] T fed4fe7b9220450e850ca61759dffef4 P 56e7643f7ab5438683e46c67075de9d0: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 15:33:17.818730 26092 raft_consensus.cc:348] T fed4fe7b9220450e850ca61759dffef4 P 9febaa34a77d4404a95313071b52c65f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11a602d7fd64ceea17a396173b1ecb6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37925 } } peers { permanent_uuid: "56e7643f7ab5438683e46c67075de9d0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 45179 } } peers { permanent_uuid: "9febaa34a77d4404a95313071b52c65f" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 40261 } }
I20260809 15:33:17.818730 26093 raft_consensus.cc:348] T fed4fe7b9220450e850ca61759dffef4 P 56e7643f7ab5438683e46c67075de9d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11a602d7fd64ceea17a396173b1ecb6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37925 } } peers { permanent_uuid: "56e7643f7ab5438683e46c67075de9d0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 45179 } } peers { permanent_uuid: "9febaa34a77d4404a95313071b52c65f" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 40261 } }
I20260809 15:33:17.818984 26092 raft_consensus.cc:374] T fed4fe7b9220450e850ca61759dffef4 P 9febaa34a77d4404a95313071b52c65f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:33:17.818984 26093 raft_consensus.cc:374] T fed4fe7b9220450e850ca61759dffef4 P 56e7643f7ab5438683e46c67075de9d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:33:17.819048 26092 raft_consensus.cc:729] T fed4fe7b9220450e850ca61759dffef4 P 9febaa34a77d4404a95313071b52c65f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9febaa34a77d4404a95313071b52c65f, State: Initialized, Role: FOLLOWER
I20260809 15:33:17.819036 26093 raft_consensus.cc:729] T fed4fe7b9220450e850ca61759dffef4 P 56e7643f7ab5438683e46c67075de9d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56e7643f7ab5438683e46c67075de9d0, State: Initialized, Role: FOLLOWER
I20260809 15:33:17.819546 26093 consensus_queue.cc:260] T fed4fe7b9220450e850ca61759dffef4 P 56e7643f7ab5438683e46c67075de9d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11a602d7fd64ceea17a396173b1ecb6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37925 } } peers { permanent_uuid: "56e7643f7ab5438683e46c67075de9d0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 45179 } } peers { permanent_uuid: "9febaa34a77d4404a95313071b52c65f" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 40261 } }
I20260809 15:33:17.819679 26092 consensus_queue.cc:260] T fed4fe7b9220450e850ca61759dffef4 P 9febaa34a77d4404a95313071b52c65f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11a602d7fd64ceea17a396173b1ecb6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37925 } } peers { permanent_uuid: "56e7643f7ab5438683e46c67075de9d0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 45179 } } peers { permanent_uuid: "9febaa34a77d4404a95313071b52c65f" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 40261 } }
I20260809 15:33:17.820690 26093 ts_tablet_manager.cc:1428] T fed4fe7b9220450e850ca61759dffef4 P 56e7643f7ab5438683e46c67075de9d0: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260809 15:33:17.820690 26092 ts_tablet_manager.cc:1428] T fed4fe7b9220450e850ca61759dffef4 P 9febaa34a77d4404a95313071b52c65f: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 15:33:17.821048 25905 heartbeater.cc:503] Master 127.11.146.62:38461 was elected leader, sending a full tablet report...
I20260809 15:33:17.821048 26061 heartbeater.cc:503] Master 127.11.146.62:38461 was elected leader, sending a full tablet report...
I20260809 15:33:17.822515 26091 tablet_bootstrap.cc:492] T fed4fe7b9220450e850ca61759dffef4 P e11a602d7fd64ceea17a396173b1ecb6: Bootstrap starting.
I20260809 15:33:17.825037 26091 tablet_bootstrap.cc:654] T fed4fe7b9220450e850ca61759dffef4 P e11a602d7fd64ceea17a396173b1ecb6: Neither blocks nor log segments found. Creating new log.
I20260809 15:33:17.826002 26091 log.cc:824] T fed4fe7b9220450e850ca61759dffef4 P e11a602d7fd64ceea17a396173b1ecb6: Log is configured to *not* fsync() on all Append() calls
I20260809 15:33:17.828285 26091 tablet_bootstrap.cc:492] T fed4fe7b9220450e850ca61759dffef4 P e11a602d7fd64ceea17a396173b1ecb6: No bootstrap required, opened a new log
I20260809 15:33:17.828519 26091 ts_tablet_manager.cc:1397] T fed4fe7b9220450e850ca61759dffef4 P e11a602d7fd64ceea17a396173b1ecb6: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 15:33:17.833184 26091 raft_consensus.cc:348] T fed4fe7b9220450e850ca61759dffef4 P e11a602d7fd64ceea17a396173b1ecb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11a602d7fd64ceea17a396173b1ecb6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37925 } } peers { permanent_uuid: "56e7643f7ab5438683e46c67075de9d0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 45179 } } peers { permanent_uuid: "9febaa34a77d4404a95313071b52c65f" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 40261 } }
I20260809 15:33:17.833509 26091 raft_consensus.cc:374] T fed4fe7b9220450e850ca61759dffef4 P e11a602d7fd64ceea17a396173b1ecb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:33:17.833639 26091 raft_consensus.cc:729] T fed4fe7b9220450e850ca61759dffef4 P e11a602d7fd64ceea17a396173b1ecb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11a602d7fd64ceea17a396173b1ecb6, State: Initialized, Role: FOLLOWER
I20260809 15:33:17.834189 26091 consensus_queue.cc:260] T fed4fe7b9220450e850ca61759dffef4 P e11a602d7fd64ceea17a396173b1ecb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11a602d7fd64ceea17a396173b1ecb6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37925 } } peers { permanent_uuid: "56e7643f7ab5438683e46c67075de9d0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 45179 } } peers { permanent_uuid: "9febaa34a77d4404a95313071b52c65f" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 40261 } }
I20260809 15:33:17.835135 25757 heartbeater.cc:503] Master 127.11.146.62:38461 was elected leader, sending a full tablet report...
I20260809 15:33:17.835435 26091 ts_tablet_manager.cc:1428] T fed4fe7b9220450e850ca61759dffef4 P e11a602d7fd64ceea17a396173b1ecb6: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
Aug 09 15:33:17 dist-test-slave-1jjb krb5kdc[24431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289597, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for HTTP/127.11.146.20@KRBTEST.COM
W20260809 15:33:17.958781 25758 tablet.cc:2369] T fed4fe7b9220450e850ca61759dffef4 P e11a602d7fd64ceea17a396173b1ecb6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 15:33:17.970742 25906 tablet.cc:2369] T fed4fe7b9220450e850ca61759dffef4 P 56e7643f7ab5438683e46c67075de9d0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 15:33:17.987377 26062 tablet.cc:2369] T fed4fe7b9220450e850ca61759dffef4 P 9febaa34a77d4404a95313071b52c65f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:33:18.109146 26097 raft_consensus.cc:482] T fed4fe7b9220450e850ca61759dffef4 P 9febaa34a77d4404a95313071b52c65f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:33:18.109406 26097 raft_consensus.cc:504] T fed4fe7b9220450e850ca61759dffef4 P 9febaa34a77d4404a95313071b52c65f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11a602d7fd64ceea17a396173b1ecb6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37925 } } peers { permanent_uuid: "56e7643f7ab5438683e46c67075de9d0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 45179 } } peers { permanent_uuid: "9febaa34a77d4404a95313071b52c65f" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 40261 } }
I20260809 15:33:18.110787 26097 leader_election.cc:288] T fed4fe7b9220450e850ca61759dffef4 P 9febaa34a77d4404a95313071b52c65f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11a602d7fd64ceea17a396173b1ecb6 (127.11.146.1:37925), 56e7643f7ab5438683e46c67075de9d0 (127.11.146.2:45179)
I20260809 15:33:18.117514 26087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:18.112256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:57473 (local address 127.11.146.2:45179)
0809 15:33:18.112383 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:18.112388 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:18.113189 (+ 801us) server_negotiation.cc:407] Connection header received
0809 15:33:18.113381 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:18.113384 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:18.113428 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:18.113474 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:33:18.113906 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:18.114640 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:18.116249 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:18.116851 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:18.116942 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:18.116994 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:18.117303 (+ 309us) server_negotiation.cc:299] Negotiation successful
0809 15:33:18.117386 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 15:33:18.118039 26102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:18.111660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:45179 (local address 127.11.146.3:57473)
0809 15:33:18.113086 (+ 1426us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:18.113099 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:18.113255 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:18.113600 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:18.113602 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:18.113617 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:33:18.113773 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:18.113779 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:18.114780 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:18.114783 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:18.116064 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:18.116093 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:18.117087 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:18.117090 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:18.117174 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:18.117195 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 15:33:18.117834 (+ 639us) client_negotiation.cc:240] Negotiation successful
0809 15:33:18.117906 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1370,"mutex_wait_us":15,"thread_start_us":159,"threads_started":1}
I20260809 15:33:18.118818 25852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fed4fe7b9220450e850ca61759dffef4" candidate_uuid: "9febaa34a77d4404a95313071b52c65f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56e7643f7ab5438683e46c67075de9d0" is_pre_election: true
I20260809 15:33:18.119194 25852 raft_consensus.cc:2454] T fed4fe7b9220450e850ca61759dffef4 P 56e7643f7ab5438683e46c67075de9d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9febaa34a77d4404a95313071b52c65f in term 0.
I20260809 15:33:18.119817 26090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:18.112445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:55407 (local address 127.11.146.1:37925)
0809 15:33:18.112576 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:18.112581 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:18.112798 (+ 217us) server_negotiation.cc:407] Connection header received
0809 15:33:18.112949 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:18.112953 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:18.113018 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:18.113112 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:33:18.113533 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:18.114322 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:18.118563 (+ 4241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:18.119160 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:18.119251 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:18.119297 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:18.119623 (+ 326us) server_negotiation.cc:299] Negotiation successful
0809 15:33:18.119703 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 15:33:18.119834 25928 leader_election.cc:302] T fed4fe7b9220450e850ca61759dffef4 P 9febaa34a77d4404a95313071b52c65f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56e7643f7ab5438683e46c67075de9d0, 9febaa34a77d4404a95313071b52c65f; no voters:
I20260809 15:33:18.120175 26097 raft_consensus.cc:2781] T fed4fe7b9220450e850ca61759dffef4 P 9febaa34a77d4404a95313071b52c65f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:33:18.120288 26097 raft_consensus.cc:482] T fed4fe7b9220450e850ca61759dffef4 P 9febaa34a77d4404a95313071b52c65f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:33:18.120329 26097 raft_consensus.cc:3037] T fed4fe7b9220450e850ca61759dffef4 P 9febaa34a77d4404a95313071b52c65f [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:33:18.122102 26097 raft_consensus.cc:504] T fed4fe7b9220450e850ca61759dffef4 P 9febaa34a77d4404a95313071b52c65f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11a602d7fd64ceea17a396173b1ecb6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37925 } } peers { permanent_uuid: "56e7643f7ab5438683e46c67075de9d0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 45179 } } peers { permanent_uuid: "9febaa34a77d4404a95313071b52c65f" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 40261 } }
I20260809 15:33:18.122457 26097 leader_election.cc:288] T fed4fe7b9220450e850ca61759dffef4 P 9febaa34a77d4404a95313071b52c65f [CANDIDATE]: Term 1 election: Requested vote from peers e11a602d7fd64ceea17a396173b1ecb6 (127.11.146.1:37925), 56e7643f7ab5438683e46c67075de9d0 (127.11.146.2:45179)
I20260809 15:33:18.120328 26103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:18.111155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:37925 (local address 127.11.146.3:55407)
0809 15:33:18.112682 (+ 1527us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:18.112698 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:18.112850 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:18.113247 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:18.113251 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:18.113272 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:33:18.113384 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:18.113392 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:18.114475 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:18.114478 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:18.118442 (+ 3964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:18.118452 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:18.119401 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:18.119404 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:18.119488 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:18.119508 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 15:33:18.119996 (+ 488us) client_negotiation.cc:240] Negotiation successful
0809 15:33:18.120068 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1452,"mutex_wait_us":2670,"thread_start_us":184,"threads_started":1}
I20260809 15:33:18.122994 25852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fed4fe7b9220450e850ca61759dffef4" candidate_uuid: "9febaa34a77d4404a95313071b52c65f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56e7643f7ab5438683e46c67075de9d0"
I20260809 15:33:18.123116 25852 raft_consensus.cc:3037] T fed4fe7b9220450e850ca61759dffef4 P 56e7643f7ab5438683e46c67075de9d0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:33:18.123128 25703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fed4fe7b9220450e850ca61759dffef4" candidate_uuid: "9febaa34a77d4404a95313071b52c65f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11a602d7fd64ceea17a396173b1ecb6" is_pre_election: true
I20260809 15:33:18.123406 25703 raft_consensus.cc:2454] T fed4fe7b9220450e850ca61759dffef4 P e11a602d7fd64ceea17a396173b1ecb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9febaa34a77d4404a95313071b52c65f in term 0.
I20260809 15:33:18.123699 25705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fed4fe7b9220450e850ca61759dffef4" candidate_uuid: "9febaa34a77d4404a95313071b52c65f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11a602d7fd64ceea17a396173b1ecb6"
I20260809 15:33:18.123826 25705 raft_consensus.cc:3037] T fed4fe7b9220450e850ca61759dffef4 P e11a602d7fd64ceea17a396173b1ecb6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:33:18.124637 25852 raft_consensus.cc:2454] T fed4fe7b9220450e850ca61759dffef4 P 56e7643f7ab5438683e46c67075de9d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9febaa34a77d4404a95313071b52c65f in term 1.
I20260809 15:33:18.125041 25928 leader_election.cc:302] T fed4fe7b9220450e850ca61759dffef4 P 9febaa34a77d4404a95313071b52c65f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56e7643f7ab5438683e46c67075de9d0, 9febaa34a77d4404a95313071b52c65f; no voters:
I20260809 15:33:18.125137 25705 raft_consensus.cc:2454] T fed4fe7b9220450e850ca61759dffef4 P e11a602d7fd64ceea17a396173b1ecb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9febaa34a77d4404a95313071b52c65f in term 1.
I20260809 15:33:18.125276 26097 raft_consensus.cc:2781] T fed4fe7b9220450e850ca61759dffef4 P 9febaa34a77d4404a95313071b52c65f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:33:18.125483 26097 raft_consensus.cc:686] T fed4fe7b9220450e850ca61759dffef4 P 9febaa34a77d4404a95313071b52c65f [term 1 LEADER]: Becoming Leader. State: Replica: 9febaa34a77d4404a95313071b52c65f, State: Running, Role: LEADER
I20260809 15:33:18.125864 26097 consensus_queue.cc:237] T fed4fe7b9220450e850ca61759dffef4 P 9febaa34a77d4404a95313071b52c65f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11a602d7fd64ceea17a396173b1ecb6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37925 } } peers { permanent_uuid: "56e7643f7ab5438683e46c67075de9d0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 45179 } } peers { permanent_uuid: "9febaa34a77d4404a95313071b52c65f" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 40261 } }
I20260809 15:33:18.129424 25535 catalog_manager.cc:5495] T fed4fe7b9220450e850ca61759dffef4 P 9febaa34a77d4404a95313071b52c65f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9febaa34a77d4404a95313071b52c65f (127.11.146.3). New cstate: current_term: 1 leader_uuid: "9febaa34a77d4404a95313071b52c65f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11a602d7fd64ceea17a396173b1ecb6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56e7643f7ab5438683e46c67075de9d0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 45179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9febaa34a77d4404a95313071b52c65f" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 40261 } health_report { overall_health: HEALTHY } } }
I20260809 15:33:18.143872 26089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:18.138749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39400 (local address 127.11.146.3:40261)
0809 15:33:18.138892 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:18.138896 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:18.139149 (+ 253us) server_negotiation.cc:407] Connection header received
0809 15:33:18.139273 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:18.139276 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:18.139371 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:18.139546 (+ 175us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:33:18.139868 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:18.141011 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:18.142249 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:18.142572 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:18.142673 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:18.142996 (+ 323us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:33:18.143473 (+ 477us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:33:18.143585 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:18.143665 (+ 80us) server_negotiation.cc:299] Negotiation successful
0809 15:33:18.143721 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 15:33:18.150787 25705 raft_consensus.cc:1261] T fed4fe7b9220450e850ca61759dffef4 P e11a602d7fd64ceea17a396173b1ecb6 [term 1 FOLLOWER]: Refusing update from remote peer 9febaa34a77d4404a95313071b52c65f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:33:18.150820 25852 raft_consensus.cc:1261] T fed4fe7b9220450e850ca61759dffef4 P 56e7643f7ab5438683e46c67075de9d0 [term 1 FOLLOWER]: Refusing update from remote peer 9febaa34a77d4404a95313071b52c65f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:33:18.151734 26104 consensus_queue.cc:1035] T fed4fe7b9220450e850ca61759dffef4 P 9febaa34a77d4404a95313071b52c65f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11a602d7fd64ceea17a396173b1ecb6" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:33:18.151940 26097 consensus_queue.cc:1035] T fed4fe7b9220450e850ca61759dffef4 P 9febaa34a77d4404a95313071b52c65f [LEADER]: Connected to new peer: Peer: permanent_uuid: "56e7643f7ab5438683e46c67075de9d0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 45179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:33:18.161423 26107 mvcc.cc:205] Tried to move back new op lower bound from 7316642194017894400 to 7316642193927290880. Current Snapshot: MvccSnapshot[applied={T|T < 7316642194017894400}]
I20260809 15:33:18.170596 26108 mvcc.cc:205] Tried to move back new op lower bound from 7316642194017894400 to 7316642193927290880. Current Snapshot: MvccSnapshot[applied={T|T < 7316642194017894400}]
I20260809 15:33:18.179497 25535 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42214:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:33:18.179659 25535 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42214:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:33:18.182188 25535 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bb0131f3ac804cc19a9c1e0283128869: Sending DeleteTablet for 3 replicas of tablet fed4fe7b9220450e850ca61759dffef4
I20260809 15:33:18.183597 25984 tablet_service.cc:1514] Processing DeleteTablet for tablet fed4fe7b9220450e850ca61759dffef4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:33:18 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:39390
I20260809 15:33:18.184180 26119 tablet_replica.cc:330] T fed4fe7b9220450e850ca61759dffef4 P 9febaa34a77d4404a95313071b52c65f: stopping tablet replica
I20260809 15:33:18.184438 25684 tablet_service.cc:1514] Processing DeleteTablet for tablet fed4fe7b9220450e850ca61759dffef4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:33:18 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:42702
I20260809 15:33:18.184600 26119 raft_consensus.cc:2229] T fed4fe7b9220450e850ca61759dffef4 P 9febaa34a77d4404a95313071b52c65f [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:33:18.184954 26119 raft_consensus.cc:2258] T fed4fe7b9220450e850ca61759dffef4 P 9febaa34a77d4404a95313071b52c65f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:33:18.185032 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 25577
I20260809 15:33:18.183174 25822 tablet_service.cc:1514] Processing DeleteTablet for tablet fed4fe7b9220450e850ca61759dffef4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:33:18 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:41856
I20260809 15:33:18.196694 26127 tablet_replica.cc:330] T fed4fe7b9220450e850ca61759dffef4 P 56e7643f7ab5438683e46c67075de9d0: stopping tablet replica
I20260809 15:33:18.197115 26127 raft_consensus.cc:2229] T fed4fe7b9220450e850ca61759dffef4 P 56e7643f7ab5438683e46c67075de9d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:33:18.197461 26127 raft_consensus.cc:2258] T fed4fe7b9220450e850ca61759dffef4 P 56e7643f7ab5438683e46c67075de9d0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260809 15:33:18.197582 25521 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.146.1:37925 (error 108)
I20260809 15:33:18.198479 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 25761
I20260809 15:33:18.198770 26085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:18.198410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:37925 (local address 127.0.0.1:42708)
0809 15:33:18.198585 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:18.198676 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.1:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
W20260809 15:33:18.199770 25521 catalog_manager.cc:4584] TS e11a602d7fd64ceea17a396173b1ecb6 (127.11.146.1:37925): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fed4fe7b9220450e850ca61759dffef4: Network error: Client connection negotiation failed: client connection to 127.11.146.1:37925: connect: Connection refused (error 111)
I20260809 15:33:18.211609 26119 ts_tablet_manager.cc:1905] T fed4fe7b9220450e850ca61759dffef4 P 9febaa34a77d4404a95313071b52c65f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:33:18.215420 26119 ts_tablet_manager.cc:1918] T fed4fe7b9220450e850ca61759dffef4 P 9febaa34a77d4404a95313071b52c65f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:33:18.215523 26119 log.cc:1196] T fed4fe7b9220450e850ca61759dffef4 P 9febaa34a77d4404a95313071b52c65f: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786289437399694-11848-0/minicluster-data/ts-2/wal/wals/fed4fe7b9220450e850ca61759dffef4
I20260809 15:33:18.215876 26119 ts_tablet_manager.cc:1939] T fed4fe7b9220450e850ca61759dffef4 P 9febaa34a77d4404a95313071b52c65f: Deleting consensus metadata
W20260809 15:33:18.216710 26085 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:33:18.216149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:45179 (local address 127.0.0.1:41870)
0809 15:33:18.216320 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:18.216335 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:18.216423 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:18.216608 (+ 185us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.2:45179: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":99}
I20260809 15:33:18.217142 25520 catalog_manager.cc:4841] TS 9febaa34a77d4404a95313071b52c65f (127.11.146.3:40261): tablet fed4fe7b9220450e850ca61759dffef4 (table test-table [id=956e6272d8ee45b1a635864244f3cb99]) successfully deleted
I20260809 15:33:18.217284 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 25908
I20260809 15:33:18.225651 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 25499
I20260809 15:33:18.234688 11848 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 15:33:18.578737 11848 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 15:33:18.578857 11848 mini_ranger.cc:66] Stopping Ranger...
I20260809 15:33:18.922895 11848 mini_ranger.cc:68] Stopped Ranger
2026-08-09 15:33:18.923 UTC [24464] LOG: received smart shutdown request
2026-08-09 15:33:18.927 UTC [24464] LOG: background worker "logical replication launcher" (PID 24473) exited with exit code 1
2026-08-09 15:33:18.928 UTC [24468] LOG: shutting down
2026-08-09 15:33:19.087 UTC [24464] LOG: database system is shut down
2026-08-09T15:33:19Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (48712 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:33:19 dist-test-slave-1jjb krb5kdc[26139](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:33:19 dist-test-slave-1jjb krb5kdc[26139](info): set up 2 sockets
Aug 09 15:33:19 dist-test-slave-1jjb krb5kdc[26139](info): commencing operation
krb5kdc: starting...
W20260809 15:33:20.289471 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.054s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:33:20 dist-test-slave-1jjb krb5kdc[26139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:33:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:33:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.146.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
I20260809 15:33:20.407123 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:44083
--webserver_interface=127.11.146.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:38319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:44083,127.11.146.61:45997,127.11.146.60:45945
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:33:20.513581 26154 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:33:20.513859 26154 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:33:20.513896 26154 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:33:20.517881 26154 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:33:20.517928 26154 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:33:20.517947 26154 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:33:20.517964 26154 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:33:20.518011 26154 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:33:20.522939 26154 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:38319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:44083,127.11.146.61:45997,127.11.146.60:45945
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:44083
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26154
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:33:20.523872 26154 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:33:20.524899 26154 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:33:20.532867 26160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:20.532927 26162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:20.533190 26154 server_base.cc:1034] running on GCE node
W20260809 15:33:20.532896 26159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:20.533728 26154 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:33:20.534734 26154 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:33:20.535907 26154 hybrid_clock.cc:648] HybridClock initialized: now 1786289600535883 us; error 40 us; skew 500 ppm
Aug 09 15:33:20 dist-test-slave-1jjb krb5kdc[26139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289600, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:33:20.538600 26154 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:33:20.539377 26154 webserver.cc:460] Webserver started at http://127.11.146.62:35227/ using document root <none> and password file <none>
I20260809 15:33:20.539863 26154 fs_manager.cc:359] Metadata directory not provided
I20260809 15:33:20.539920 26154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:33:20.540112 26154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:33:20.541942 26154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "44b6a1274f48422ba29eaeda3ed66a6b"
format_stamp: "Formatted at 2026-08-09 15:33:20 on dist-test-slave-1jjb"
server_key: "381934c90214c7b72d738b19dc7de3ba"
server_key_iv: "2a954340fa205387eb9d093c17048ae8"
server_key_version: "encryptionkey@0"
I20260809 15:33:20.542438 26154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "44b6a1274f48422ba29eaeda3ed66a6b"
format_stamp: "Formatted at 2026-08-09 15:33:20 on dist-test-slave-1jjb"
server_key: "381934c90214c7b72d738b19dc7de3ba"
server_key_iv: "2a954340fa205387eb9d093c17048ae8"
server_key_version: "encryptionkey@0"
I20260809 15:33:20.545873 26154 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 15:33:20.548157 26170 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:20.549274 26154 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:33:20.549409 26154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "44b6a1274f48422ba29eaeda3ed66a6b"
format_stamp: "Formatted at 2026-08-09 15:33:20 on dist-test-slave-1jjb"
server_key: "381934c90214c7b72d738b19dc7de3ba"
server_key_iv: "2a954340fa205387eb9d093c17048ae8"
server_key_version: "encryptionkey@0"
I20260809 15:33:20.549512 26154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:33:20.559432 26154 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:33:20.562000 26154 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:33:20.562179 26154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:33:20.568766 26154 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:44083
I20260809 15:33:20.568846 26227 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:44083 every 8 connection(s)
I20260809 15:33:20.569738 26154 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:33:20.572335 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 26154
I20260809 15:33:20.572502 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:33:20.572552 26228 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:33:20.572799 11848 external_mini_cluster.cc:1428] Setting key 12331ee3283eed9d0759a133f657c990
I20260809 15:33:20.577282 26228 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44083 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.146.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.61@KRBTEST.COM" created.
Aug 09 15:33:20 dist-test-slave-1jjb krb5kdc[26139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289600, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:33:20.592422 26231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:20.579617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59878 (local address 127.11.146.62:44083)
0809 15:33:20.580041 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:20.580059 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:20.580337 (+ 278us) server_negotiation.cc:407] Connection header received
0809 15:33:20.581328 (+ 991us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:20.581332 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:20.581499 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:20.581671 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:20.582447 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:20.583403 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:20.584502 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:20.584902 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:20.585064 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:20.587574 (+ 2510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:20.587579 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:20.587588 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:20.587609 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:20.589306 (+ 1697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:20.589936 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:20.589940 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:20.589941 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:20.590040 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:20.590408 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:20.590410 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:20.590411 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:20.590748 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:20.590847 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:20.591314 (+ 467us) server_negotiation.cc:299] Negotiation successful
0809 15:33:20.591653 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":113,"server-negotiator.queue_time_us":280,"thread_start_us":138,"threads_started":1}
I20260809 15:33:20.592427 26232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:20.579618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:44083 (local address 127.0.0.1:59878)
0809 15:33:20.580204 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:20.580238 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:20.581042 (+ 804us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:20.581671 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:20.581675 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:20.582069 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:33:20.582300 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:20.582313 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:20.583539 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:20.583541 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:20.584395 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:20.584406 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:20.585047 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:20.585051 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:20.585155 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:20.585733 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:33:20.585749 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:33:20.587350 (+ 1601us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:33:20.589439 (+ 2089us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:20.589452 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:20.589465 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:20.589809 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:20.590137 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:20.590143 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:20.590147 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:20.590309 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:20.590882 (+ 573us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:33:20.590889 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:33:20.591051 (+ 162us) client_negotiation.cc:769] Sending connection context
0809 15:33:20.591245 (+ 194us) client_negotiation.cc:240] Negotiation successful
0809 15:33:20.591602 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":416,"spinlock_wait_cycles":17664,"thread_start_us":151,"threads_started":1}
I20260809 15:33:20.594681 26228 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.61" port: 45997 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:33:20.595472 26232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:20.595244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:45997 (local address 127.0.0.1:46200)
0809 15:33:20.595362 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:20.595424 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.61:45997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 15:33:20.595672 26172 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.146.61:45997: connect: Connection refused (error 111)
I20260809 15:33:20.596524 26232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:20.596343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:45997 (local address 127.0.0.1:46214)
0809 15:33:20.596431 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:20.596479 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.61:45997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260809 15:33:20.596675 26228 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.146.61:45997: Network error: Client connection negotiation failed: client connection to 127.11.146.61:45997: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.61.keytab.
Entry for principal kudu/127.11.146.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.61.keytab.
I20260809 15:33:20.600713 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.61:45997
--webserver_interface=127.11.146.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.61.keytab
--principal=kudu/127.11.146.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:38319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:44083,127.11.146.61:45997,127.11.146.60:45945
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:33:20.645907 26228 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.61" port: 45997 } attempt: 1
I20260809 15:33:20.646824 26232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:20.646516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:45997 (local address 127.0.0.1:46220)
0809 15:33:20.646696 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:20.646753 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.61:45997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260809 15:33:20.647487 26232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:20.647285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:45997 (local address 127.0.0.1:46232)
0809 15:33:20.647397 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:20.647437 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.61:45997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 15:33:20.647609 26228 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.146.61:45997: Network error: Client connection negotiation failed: client connection to 127.11.146.61:45997: connect: Connection refused (error 111)
W20260809 15:33:20.713472 26235 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:33:20.713765 26235 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:33:20.713846 26235 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260809 15:33:20.715773 26228 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.61" port: 45997 } attempt: 2
I20260809 15:33:20.716717 26232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:20.716411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:45997 (local address 127.0.0.1:46242)
0809 15:33:20.716569 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:20.716641 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.61:45997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260809 15:33:20.717491 26232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:20.717262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:45997 (local address 127.0.0.1:46248)
0809 15:33:20.717387 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:20.717438 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.61:45997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260809 15:33:20.717624 26228 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.146.61:45997: Network error: Client connection negotiation failed: client connection to 127.11.146.61:45997: connect: Connection refused (error 111)
W20260809 15:33:20.718117 26235 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:33:20.718163 26235 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:33:20.718192 26235 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:33:20.718243 26235 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:33:20.718310 26235 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:33:20.723214 26235 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:38319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:44083,127.11.146.61:45997,127.11.146.60:45945
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.61.keytab
--principal=kudu/127.11.146.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.61:45997
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.146.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26235
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:33:20.724193 26235 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:33:20.725147 26235 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:33:20.733265 26241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:20.733278 26240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:20.733556 26235 server_base.cc:1034] running on GCE node
W20260809 15:33:20.733341 26243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:20.734211 26235 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:33:20.735203 26235 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:33:20.736371 26235 hybrid_clock.cc:648] HybridClock initialized: now 1786289600736323 us; error 57 us; skew 500 ppm
Aug 09 15:33:20 dist-test-slave-1jjb krb5kdc[26139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289600, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:33:20.739141 26235 init.cc:377] Logged in from keytab as kudu/127.11.146.61@KRBTEST.COM (short username kudu)
I20260809 15:33:20.739915 26235 webserver.cc:460] Webserver started at http://127.11.146.61:41319/ using document root <none> and password file <none>
I20260809 15:33:20.740445 26235 fs_manager.cc:359] Metadata directory not provided
I20260809 15:33:20.740506 26235 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:33:20.740658 26235 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:33:20.742457 26235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-1/data/instance:
uuid: "3609626462e04c06b0e86661d5d9d4a7"
format_stamp: "Formatted at 2026-08-09 15:33:20 on dist-test-slave-1jjb"
server_key: "6f8a550114eb6d3fb21520bd7fc8bce7"
server_key_iv: "f3d57a2021f0e5b02571ce6856252742"
server_key_version: "encryptionkey@0"
I20260809 15:33:20.742944 26235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-1/wal/instance:
uuid: "3609626462e04c06b0e86661d5d9d4a7"
format_stamp: "Formatted at 2026-08-09 15:33:20 on dist-test-slave-1jjb"
server_key: "6f8a550114eb6d3fb21520bd7fc8bce7"
server_key_iv: "f3d57a2021f0e5b02571ce6856252742"
server_key_version: "encryptionkey@0"
I20260809 15:33:20.746348 26235 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 15:33:20.748529 26255 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:20.749702 26235 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:33:20.749850 26235 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-1/wal
uuid: "3609626462e04c06b0e86661d5d9d4a7"
format_stamp: "Formatted at 2026-08-09 15:33:20 on dist-test-slave-1jjb"
server_key: "6f8a550114eb6d3fb21520bd7fc8bce7"
server_key_iv: "f3d57a2021f0e5b02571ce6856252742"
server_key_version: "encryptionkey@0"
I20260809 15:33:20.749958 26235 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:33:20.763602 26235 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:33:20.766192 26235 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:33:20.766376 26235 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:33:20.773447 26235 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.61:45997
I20260809 15:33:20.773473 26314 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.61:45997 every 8 connection(s)
I20260809 15:33:20.774308 26235 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-1/data/info.pb
I20260809 15:33:20.776383 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 26235
I20260809 15:33:20.776506 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-1/wal/instance
I20260809 15:33:20.776746 11848 external_mini_cluster.cc:1428] Setting key 45a07f2b3ec14715983f0a9755e296cd
I20260809 15:33:20.776961 26315 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:33:20.780562 26315 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44083 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.146.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.60@KRBTEST.COM" created.
Aug 09 15:33:20 dist-test-slave-1jjb krb5kdc[26139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289600, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.61@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:33:20.794315 26231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:20.782228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59882 (local address 127.11.146.62:44083)
0809 15:33:20.782412 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:20.782420 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:20.783129 (+ 709us) server_negotiation.cc:407] Connection header received
0809 15:33:20.784005 (+ 876us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:20.784011 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:20.784071 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:20.784193 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:20.785194 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:20.785851 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:20.786986 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:20.787208 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:20.787315 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:20.790151 (+ 2836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:20.790156 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:20.790161 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:20.790194 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:20.791968 (+ 1774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:20.792509 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:20.792516 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:20.792521 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:20.792623 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:20.793032 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:20.793038 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:20.793042 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:20.793289 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:20.793408 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:20.793909 (+ 501us) server_negotiation.cc:299] Negotiation successful
0809 15:33:20.794067 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 15:33:20.794813 26319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:20.782535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:44083 (local address 127.0.0.1:59882)
0809 15:33:20.782973 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:20.783023 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:20.783802 (+ 779us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:20.784320 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:20.784326 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:20.784607 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:33:20.785046 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:20.785059 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:20.785968 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:20.785970 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:20.786853 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:20.786863 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:20.787358 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:20.787363 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:20.787530 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:20.788158 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:33:20.788200 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:33:20.789989 (+ 1789us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:33:20.792128 (+ 2139us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:20.792133 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:20.792144 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:20.792400 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:20.792749 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:20.792753 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:20.792755 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:20.792931 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:20.793398 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:33:20.793404 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:33:20.793633 (+ 229us) client_negotiation.cc:769] Sending connection context
0809 15:33:20.793798 (+ 165us) client_negotiation.cc:240] Negotiation successful
0809 15:33:20.794040 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":119,"threads_started":1}
I20260809 15:33:20.796267 26315 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.61" port: 45997 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 15:33:20 dist-test-slave-1jjb krb5kdc[26139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289600, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.61@KRBTEST.COM for kudu/127.11.146.61@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.60.keytab.
Entry for principal kudu/127.11.146.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.60.keytab.
I20260809 15:33:20.805011 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.60:45945
--webserver_interface=127.11.146.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.60.keytab
--principal=kudu/127.11.146.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:38319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:44083,127.11.146.61:45997,127.11.146.60:45945
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:33:20.805616 26319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:20.796826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:45997 (local address 127.0.0.1:46256)
0809 15:33:20.796936 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:20.796947 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:20.797004 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:20.797649 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:20.797652 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:20.797816 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:33:20.797882 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:20.797902 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:20.799052 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:20.799058 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:20.799558 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:20.799566 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:20.800173 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:20.800177 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:20.800286 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:20.800769 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:33:20.800781 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:33:20.802038 (+ 1257us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:33:20.803781 (+ 1743us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:20.803786 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:20.803788 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:20.804004 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:20.804422 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:20.804427 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:20.804429 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:20.804529 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:20.804986 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:33:20.804989 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:33:20.805096 (+ 107us) client_negotiation.cc:769] Sending connection context
0809 15:33:20.805215 (+ 119us) client_negotiation.cc:240] Negotiation successful
0809 15:33:20.805357 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":2}
I20260809 15:33:20.806327 26321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:20.796973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46256 (local address 127.11.146.61:45997)
0809 15:33:20.797313 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:20.797320 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:20.797336 (+ 16us) server_negotiation.cc:407] Connection header received
0809 15:33:20.797365 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:20.797369 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:20.797520 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:20.797669 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:20.798028 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:20.798914 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:20.799673 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:20.800019 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:20.800165 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:20.802164 (+ 1999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:20.802179 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:20.802188 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:20.802208 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:20.803676 (+ 1468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:20.804150 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:20.804171 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:20.804176 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:20.804294 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:20.804628 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:20.804631 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:20.804632 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:20.804880 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:20.804985 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:20.805865 (+ 880us) server_negotiation.cc:299] Negotiation successful
0809 15:33:20.806056 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":49,"server-negotiator.queue_time_us":266,"thread_start_us":164,"threads_started":1}
I20260809 15:33:20.808225 26315 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45945 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:33:20.808790 26228 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.61" port: 45997 } attempt: 3
I20260809 15:33:20.808914 26319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:20.808647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:45945 (local address 127.0.0.1:43934)
0809 15:33:20.808748 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:20.808836 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:45945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 15:33:20.809161 26258 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.146.60:45945: connect: Connection refused (error 111)
I20260809 15:33:20.810213 26319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:20.809853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:45945 (local address 127.0.0.1:43950)
0809 15:33:20.810074 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:20.810135 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:45945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136}
W20260809 15:33:20.810387 26315 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.146.60:45945: Network error: Client connection negotiation failed: client connection to 127.11.146.60:45945: connect: Connection refused (error 111)
Aug 09 15:33:20 dist-test-slave-1jjb krb5kdc[26139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289600, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for kudu/127.11.146.61@KRBTEST.COM
I20260809 15:33:20.817425 26232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:20.809200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:45997 (local address 127.0.0.1:46268)
0809 15:33:20.809398 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:20.809408 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:20.809506 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:20.809799 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:20.809802 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:20.809965 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:33:20.810058 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:20.810063 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:20.810880 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:20.810883 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:20.811783 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:20.811793 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:20.812306 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:20.812309 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:20.812423 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:20.812859 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:33:20.812870 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:33:20.813992 (+ 1122us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:33:20.815769 (+ 1777us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:20.815773 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:20.815775 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:20.815992 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:20.816318 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:20.816323 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:20.816328 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:20.816417 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:20.816858 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:33:20.816862 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:33:20.816971 (+ 109us) client_negotiation.cc:769] Sending connection context
0809 15:33:20.817094 (+ 123us) client_negotiation.cc:240] Negotiation successful
0809 15:33:20.817233 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108}
I20260809 15:33:20.817425 26321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:20.809226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46268 (local address 127.11.146.61:45997)
0809 15:33:20.809314 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:20.809319 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:20.809464 (+ 145us) server_negotiation.cc:407] Connection header received
0809 15:33:20.809623 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:20.809626 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:20.809667 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:20.809780 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:20.810168 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:20.810779 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:20.811900 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:20.812199 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:20.812303 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:20.814115 (+ 1812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:20.814118 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:20.814121 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:20.814143 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:20.815621 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:20.816127 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:20.816131 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:20.816132 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:20.816218 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:20.816541 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:20.816546 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:20.816548 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:20.816726 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:20.816858 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:20.817160 (+ 302us) server_negotiation.cc:299] Negotiation successful
0809 15:33:20.817265 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 15:33:20.818636 26228 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45945 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:33:20.819309 26232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:20.819070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:45945 (local address 127.0.0.1:43962)
0809 15:33:20.819179 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:20.819229 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:45945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260809 15:33:20.820017 26232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:20.819760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:45945 (local address 127.0.0.1:43974)
0809 15:33:20.819911 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:20.819965 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:45945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
W20260809 15:33:20.820173 26228 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.146.60:45945: Network error: Client connection negotiation failed: client connection to 127.11.146.60:45945: connect: Connection refused (error 111)
I20260809 15:33:20.851347 26228 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45945 } attempt: 1
I20260809 15:33:20.852028 26232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:20.851771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:45945 (local address 127.0.0.1:43986)
0809 15:33:20.851904 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:20.851963 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:45945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260809 15:33:20.852777 26232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:20.852549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:45945 (local address 127.0.0.1:43990)
0809 15:33:20.852676 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:20.852727 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:45945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260809 15:33:20.852953 26228 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.146.60:45945: Network error: Client connection negotiation failed: client connection to 127.11.146.60:45945: connect: Connection refused (error 111)
I20260809 15:33:20.859658 26315 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45945 } attempt: 1
I20260809 15:33:20.860333 26319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:20.860063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:45945 (local address 127.0.0.1:43996)
0809 15:33:20.860226 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:20.860275 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:45945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260809 15:33:20.861034 26319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:20.860794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:45945 (local address 127.0.0.1:44002)
0809 15:33:20.860881 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:20.860988 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:45945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260809 15:33:20.861218 26315 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.146.60:45945: Network error: Client connection negotiation failed: client connection to 127.11.146.60:45945: connect: Connection refused (error 111)
W20260809 15:33:20.915818 26322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:33:20.916054 26322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:33:20.916110 26322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:33:20.920007 26322 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:33:20.920054 26322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:33:20.920125 26322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:33:20.920159 26322 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:33:20.920197 26322 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:33:20.925164 26322 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:38319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:44083,127.11.146.61:45997,127.11.146.60:45945
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.60.keytab
--principal=kudu/127.11.146.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.60:45945
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.146.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26322
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:33:20.926100 26322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:33:20.927034 26322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 15:33:20.928148 26228 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45945 } attempt: 2
I20260809 15:33:20.928900 26232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:20.928614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:45945 (local address 127.0.0.1:44006)
0809 15:33:20.928742 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:20.928824 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:45945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260809 15:33:20.929368 26315 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45945 } attempt: 2
I20260809 15:33:20.929783 26232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:20.929476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:45945 (local address 127.0.0.1:44010)
0809 15:33:20.929660 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:20.929707 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:45945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
W20260809 15:33:20.929953 26228 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.146.60:45945: Network error: Client connection negotiation failed: client connection to 127.11.146.60:45945: connect: Connection refused (error 111)
I20260809 15:33:20.930208 26319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:20.929948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:45945 (local address 127.0.0.1:44014)
0809 15:33:20.930071 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:20.930130 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:45945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260809 15:33:20.930934 26319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:20.930699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:45945 (local address 127.0.0.1:44030)
0809 15:33:20.930817 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:20.930868 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:45945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 15:33:20.931111 26315 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.146.60:45945: Network error: Client connection negotiation failed: client connection to 127.11.146.60:45945: connect: Connection refused (error 111)
W20260809 15:33:20.935711 26329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:20.935791 26333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:20.935719 26331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:20.935889 26322 server_base.cc:1034] running on GCE node
I20260809 15:33:20.936540 26322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:33:20.937494 26322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:33:20.938671 26322 hybrid_clock.cc:648] HybridClock initialized: now 1786289600938656 us; error 24 us; skew 500 ppm
Aug 09 15:33:20 dist-test-slave-1jjb krb5kdc[26139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289600, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:33:20.941334 26322 init.cc:377] Logged in from keytab as kudu/127.11.146.60@KRBTEST.COM (short username kudu)
I20260809 15:33:20.942098 26322 webserver.cc:460] Webserver started at http://127.11.146.60:42915/ using document root <none> and password file <none>
I20260809 15:33:20.942600 26322 fs_manager.cc:359] Metadata directory not provided
I20260809 15:33:20.942680 26322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:33:20.942883 26322 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:33:20.944741 26322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-2/data/instance:
uuid: "d9466f61d0ee459fb6881ed6780d7d1e"
format_stamp: "Formatted at 2026-08-09 15:33:20 on dist-test-slave-1jjb"
server_key: "ac3307ed4cdfd69b3e7e319176be453f"
server_key_iv: "ca789745bca1f4fbecb41ca93eae75a7"
server_key_version: "encryptionkey@0"
I20260809 15:33:20.945245 26322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-2/wal/instance:
uuid: "d9466f61d0ee459fb6881ed6780d7d1e"
format_stamp: "Formatted at 2026-08-09 15:33:20 on dist-test-slave-1jjb"
server_key: "ac3307ed4cdfd69b3e7e319176be453f"
server_key_iv: "ca789745bca1f4fbecb41ca93eae75a7"
server_key_version: "encryptionkey@0"
I20260809 15:33:20.948688 26322 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 15:33:20.950843 26340 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:20.951941 26322 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:33:20.952068 26322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-2/wal
uuid: "d9466f61d0ee459fb6881ed6780d7d1e"
format_stamp: "Formatted at 2026-08-09 15:33:20 on dist-test-slave-1jjb"
server_key: "ac3307ed4cdfd69b3e7e319176be453f"
server_key_iv: "ca789745bca1f4fbecb41ca93eae75a7"
server_key_version: "encryptionkey@0"
I20260809 15:33:20.952229 26322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:33:20.970320 26322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:33:20.972920 26322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:33:20.973095 26322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:33:20.979655 26322 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.60:45945
I20260809 15:33:20.979722 26399 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.60:45945 every 8 connection(s)
I20260809 15:33:20.980538 26322 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-2/data/info.pb
I20260809 15:33:20.981778 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 26322
I20260809 15:33:20.981876 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786289437399694-11848-0/minicluster-data/master-2/wal/instance
I20260809 15:33:20.982138 11848 external_mini_cluster.cc:1428] Setting key 86192dc766f5fcb114541bbb5c946f15
I20260809 15:33:20.983388 26400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:33:20.987651 26400 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44083 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 15:33:20 dist-test-slave-1jjb krb5kdc[26139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.60@KRBTEST.COM
Aug 09 15:33:20 dist-test-slave-1jjb krb5kdc[26139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289600, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.60@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:33:20.996273 26403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:20.983361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44032 (local address 127.11.146.60:45945)
0809 15:33:20.983759 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:20.983777 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:20.983814 (+ 37us) server_negotiation.cc:407] Connection header received
0809 15:33:20.984583 (+ 769us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:20.984603 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:20.984974 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:20.985302 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:20.985899 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:20.987249 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:20.988048 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:20.988689 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:20.988846 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:20.991867 (+ 3021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:20.991872 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:20.991880 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:20.991906 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:20.993605 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:20.994041 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:20.994047 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:20.994051 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:20.994152 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:20.994442 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:20.994445 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:20.994447 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:20.994804 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:20.995018 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:20.995295 (+ 277us) server_negotiation.cc:299] Negotiation successful
0809 15:33:20.995575 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":131,"threads_started":1}
I20260809 15:33:20.999678 26404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:20.989531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:44083 (local address 127.0.0.1:59898)
0809 15:33:20.989936 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:20.989971 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:20.990103 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:20.990395 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:20.990400 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:20.990756 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:33:20.990954 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:20.990962 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:20.991904 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:20.991909 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:20.992956 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:20.992991 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:20.993541 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:20.993546 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:20.993683 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:20.994245 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:33:20.994259 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:33:20.995772 (+ 1513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:33:20.997638 (+ 1866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:20.997646 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:20.997651 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:20.998015 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:20.998322 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:20.998326 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:20.998328 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:20.998424 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:20.998988 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:33:20.998995 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:33:20.999110 (+ 115us) client_negotiation.cc:769] Sending connection context
0809 15:33:20.999277 (+ 167us) client_negotiation.cc:240] Negotiation successful
0809 15:33:20.999471 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":189,"threads_started":1}
I20260809 15:33:20.999693 26231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:20.989570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59898 (local address 127.11.146.62:44083)
0809 15:33:20.989688 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:20.989692 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:20.990051 (+ 359us) server_negotiation.cc:407] Connection header received
0809 15:33:20.990212 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:20.990215 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:20.990267 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:20.990348 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:20.991094 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:20.991698 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:20.993148 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:20.993409 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:20.993539 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:20.995943 (+ 2404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:20.995948 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:20.995951 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:20.995988 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:20.997536 (+ 1548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:20.998126 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:20.998129 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:20.998131 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:20.998221 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:20.998550 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:20.998554 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:20.998556 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:20.998850 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:20.998963 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:20.999379 (+ 416us) server_negotiation.cc:299] Negotiation successful
0809 15:33:20.999511 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 15:33:21.000813 26400 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.61" port: 45997 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 15:33:20 dist-test-slave-1jjb krb5kdc[26139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
Aug 09 15:33:21 dist-test-slave-1jjb krb5kdc[26139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289600, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.60@KRBTEST.COM for kudu/127.11.146.61@KRBTEST.COM
I20260809 15:33:21.008289 26405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:20.998560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59910 (local address 127.11.146.62:44083)
0809 15:33:20.998867 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:20.998873 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:20.998884 (+ 11us) server_negotiation.cc:407] Connection header received
0809 15:33:20.998914 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:20.998916 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:20.998947 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:20.999037 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:20.999608 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:21.000356 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:21.001290 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:21.001600 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:21.001709 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:21.004641 (+ 2932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:21.004647 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:21.004650 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:21.004677 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:21.006504 (+ 1827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:21.006982 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:21.006985 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:21.006987 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:21.007083 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:21.007420 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:21.007423 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:21.007425 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:21.007660 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:21.007875 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:21.007979 (+ 104us) server_negotiation.cc:299] Negotiation successful
0809 15:33:21.008141 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247,"thread_start_us":116,"threads_started":1}
I20260809 15:33:21.009807 26321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:21.001374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46278 (local address 127.11.146.61:45997)
0809 15:33:21.001513 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:21.001517 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:21.001532 (+ 15us) server_negotiation.cc:407] Connection header received
0809 15:33:21.001600 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:21.001604 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:21.001656 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:21.001733 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:21.002286 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:21.002750 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:21.003746 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:21.003945 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:21.004019 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:21.006240 (+ 2221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:21.006245 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:21.006248 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:21.006296 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:21.007992 (+ 1696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:21.008499 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:21.008503 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:21.008504 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:21.008593 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:21.008925 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:21.008928 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:21.008930 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:21.009159 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:21.009264 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:21.009584 (+ 320us) server_negotiation.cc:299] Negotiation successful
0809 15:33:21.009705 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 15:33:21.010159 26404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:21.001260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:45997 (local address 127.0.0.1:46278)
0809 15:33:21.001426 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:21.001442 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:21.001524 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:21.001772 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:21.001775 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:21.001962 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:33:21.002114 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:21.002121 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:21.002865 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:21.002872 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:21.003569 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:21.003581 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:21.004043 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:21.004046 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:21.004200 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:21.004673 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:33:21.004691 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:33:21.006094 (+ 1403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:33:21.008138 (+ 2044us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:21.008141 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:21.008143 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:21.008417 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:21.008705 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:21.008707 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:21.008715 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:21.008788 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:21.009278 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:33:21.009282 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:33:21.009381 (+ 99us) client_negotiation.cc:769] Sending connection context
0809 15:33:21.009944 (+ 563us) client_negotiation.cc:240] Negotiation successful
0809 15:33:21.010063 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98}
I20260809 15:33:21.010823 26400 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45945 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 15:33:21 dist-test-slave-1jjb krb5kdc[26139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.61@KRBTEST.COM
Aug 09 15:33:21 dist-test-slave-1jjb krb5kdc[26139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289600, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.60@KRBTEST.COM for kudu/127.11.146.60@KRBTEST.COM
I20260809 15:33:21.018280 26406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:21.009415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46290 (local address 127.11.146.61:45997)
0809 15:33:21.009772 (+ 357us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:21.009779 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:21.009789 (+ 10us) server_negotiation.cc:407] Connection header received
0809 15:33:21.009816 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:21.009818 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:21.009871 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:21.009965 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:21.010776 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:21.011514 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:21.012298 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:21.012520 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:21.012619 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:21.014953 (+ 2334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:21.014959 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:21.014961 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:21.014986 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:21.016540 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:21.017037 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:21.017041 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:21.017044 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:21.017134 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:21.017418 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:21.017421 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:21.017422 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:21.017588 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:21.017715 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:21.017983 (+ 268us) server_negotiation.cc:299] Negotiation successful
0809 15:33:21.018093 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":131,"threads_started":1}
I20260809 15:33:21.019305 26404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:21.011246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:45945 (local address 127.0.0.1:44038)
0809 15:33:21.011345 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:21.011359 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:21.011430 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:21.011646 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:21.011648 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:21.011799 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:33:21.011860 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:21.011865 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:21.012620 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:21.012623 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:21.013119 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:21.013126 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:21.013582 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:21.013585 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:21.013657 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:21.014532 (+ 875us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:33:21.014543 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:33:21.015647 (+ 1104us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:33:21.017955 (+ 2308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:21.017958 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:21.017960 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:21.018188 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:21.018461 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:21.018464 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:21.018466 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:21.018536 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:21.018851 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:33:21.018854 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:33:21.018934 (+ 80us) client_negotiation.cc:769] Sending connection context
0809 15:33:21.019028 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 15:33:21.019153 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260809 15:33:21.019353 26403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:21.011363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44038 (local address 127.11.146.60:45945)
0809 15:33:21.011475 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:21.011480 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:21.011492 (+ 12us) server_negotiation.cc:407] Connection header received
0809 15:33:21.011520 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:21.011522 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:21.011553 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:21.011636 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:21.011963 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:21.012517 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:21.013224 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:21.013482 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:21.013584 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:21.015775 (+ 2191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:21.015778 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:21.015780 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:21.015801 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:21.017857 (+ 2056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:21.018276 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:21.018278 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:21.018280 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:21.018347 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:21.018608 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:21.018611 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:21.018613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:21.018764 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:21.018859 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:21.019081 (+ 222us) server_negotiation.cc:299] Negotiation successful
0809 15:33:21.019211 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":43}
I20260809 15:33:21.021396 11848 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:33:21.022317 26400 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9466f61d0ee459fb6881ed6780d7d1e: Bootstrap starting.
I20260809 15:33:21.022276 26315 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45945 } attempt: 3
I20260809 15:33:21.025261 26400 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d9466f61d0ee459fb6881ed6780d7d1e: Neither blocks nor log segments found. Creating new log.
I20260809 15:33:21.026180 26400 log.cc:824] T 00000000000000000000000000000000 P d9466f61d0ee459fb6881ed6780d7d1e: Log is configured to *not* fsync() on all Append() calls
Aug 09 15:33:21 dist-test-slave-1jjb krb5kdc[26139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289600, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.61@KRBTEST.COM for kudu/127.11.146.60@KRBTEST.COM
I20260809 15:33:21.028357 26400 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9466f61d0ee459fb6881ed6780d7d1e: No bootstrap required, opened a new log
I20260809 15:33:21.029104 26228 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45945 } attempt: 3
I20260809 15:33:21.032519 26319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:21.022644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:45945 (local address 127.0.0.1:44054)
0809 15:33:21.022841 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:21.022854 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:21.022921 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:21.023331 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:21.023335 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:21.023509 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:33:21.023623 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:21.023630 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:21.024541 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:21.024544 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:21.025291 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:21.025302 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:21.025955 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:21.025958 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:21.026035 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:21.026521 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:33:21.026534 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:33:21.028252 (+ 1718us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:33:21.030718 (+ 2466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:21.030721 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:21.030723 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:21.031058 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:21.031350 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:21.031354 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:21.031356 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:21.031436 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:21.031927 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:33:21.031930 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:33:21.032052 (+ 122us) client_negotiation.cc:769] Sending connection context
0809 15:33:21.032210 (+ 158us) client_negotiation.cc:240] Negotiation successful
0809 15:33:21.032333 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"mutex_wait_us":23}
I20260809 15:33:21.033052 26406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:21.024022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46292 (local address 127.11.146.61:45997)
0809 15:33:21.024146 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:21.024149 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:21.024161 (+ 12us) server_negotiation.cc:407] Connection header received
0809 15:33:21.024190 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:21.024192 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:21.024227 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:21.024291 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:21.025156 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:21.025851 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:21.027013 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:21.027331 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:21.027407 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:21.028995 (+ 1588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:21.028999 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:21.029001 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:21.029040 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:21.030962 (+ 1922us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:21.031440 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:21.031443 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:21.031445 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:21.031533 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:21.031829 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:21.031832 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:21.031834 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:21.032045 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:21.032179 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:21.032803 (+ 624us) server_negotiation.cc:299] Negotiation successful
0809 15:33:21.032911 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":31}
I20260809 15:33:21.033017 26400 raft_consensus.cc:348] T 00000000000000000000000000000000 P d9466f61d0ee459fb6881ed6780d7d1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b6a1274f48422ba29eaeda3ed66a6b" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44083 } } peers { permanent_uuid: "3609626462e04c06b0e86661d5d9d4a7" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 45997 } } peers { permanent_uuid: "d9466f61d0ee459fb6881ed6780d7d1e" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45945 } }
I20260809 15:33:21.033248 26400 raft_consensus.cc:374] T 00000000000000000000000000000000 P d9466f61d0ee459fb6881ed6780d7d1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:33:21.033282 26403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:21.023034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44054 (local address 127.11.146.60:45945)
0809 15:33:21.023121 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:21.023125 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:21.023136 (+ 11us) server_negotiation.cc:407] Connection header received
0809 15:33:21.023164 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:21.023166 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:21.023198 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:21.023304 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:21.023755 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:21.024419 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:21.025416 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:21.025725 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:21.025825 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:21.028383 (+ 2558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:21.028386 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:21.028388 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:21.028410 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:21.030588 (+ 2178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:21.031170 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:21.031173 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:21.031175 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:21.031255 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:21.031530 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:21.031533 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:21.031534 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:21.031777 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:21.031878 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:21.032763 (+ 885us) server_negotiation.cc:299] Negotiation successful
0809 15:33:21.033137 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 15:33:21.033303 26400 raft_consensus.cc:729] T 00000000000000000000000000000000 P d9466f61d0ee459fb6881ed6780d7d1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9466f61d0ee459fb6881ed6780d7d1e, State: Initialized, Role: FOLLOWER
I20260809 15:33:21.034349 26400 consensus_queue.cc:260] T 00000000000000000000000000000000 P d9466f61d0ee459fb6881ed6780d7d1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b6a1274f48422ba29eaeda3ed66a6b" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44083 } } peers { permanent_uuid: "3609626462e04c06b0e86661d5d9d4a7" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 45997 } } peers { permanent_uuid: "d9466f61d0ee459fb6881ed6780d7d1e" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45945 } }
I20260809 15:33:21.034806 26420 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9466f61d0ee459fb6881ed6780d7d1e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b6a1274f48422ba29eaeda3ed66a6b" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44083 } } peers { permanent_uuid: "3609626462e04c06b0e86661d5d9d4a7" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 45997 } } peers { permanent_uuid: "d9466f61d0ee459fb6881ed6780d7d1e" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45945 } } }
I20260809 15:33:21.034991 26420 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9466f61d0ee459fb6881ed6780d7d1e [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:33:21.035662 26400 sys_catalog.cc:564] T 00000000000000000000000000000000 P d9466f61d0ee459fb6881ed6780d7d1e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:33:21.036019 26315 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3609626462e04c06b0e86661d5d9d4a7: Bootstrap starting.
Aug 09 15:33:21 dist-test-slave-1jjb krb5kdc[26139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289600, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for kudu/127.11.146.60@KRBTEST.COM
I20260809 15:33:21.038990 26315 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3609626462e04c06b0e86661d5d9d4a7: Neither blocks nor log segments found. Creating new log.
I20260809 15:33:21.039883 26315 log.cc:824] T 00000000000000000000000000000000 P 3609626462e04c06b0e86661d5d9d4a7: Log is configured to *not* fsync() on all Append() calls
W20260809 15:33:21.042006 26433 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d9466f61d0ee459fb6881ed6780d7d1e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:33:21.042140 26433 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:33:21.042658 26232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:21.029490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:45945 (local address 127.0.0.1:44082)
0809 15:33:21.029833 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:21.029850 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:21.029922 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:21.034128 (+ 4206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:21.034131 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:21.034309 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:33:21.034400 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:21.034406 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:21.035355 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:21.035359 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:21.036165 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:21.036177 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:21.036794 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:21.036799 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:21.036928 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:21.037466 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:33:21.037484 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:33:21.038927 (+ 1443us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:33:21.040886 (+ 1959us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:21.040890 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:21.040892 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:21.041143 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:21.041478 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:21.041482 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:21.041483 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:21.041577 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:21.042061 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:33:21.042065 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:33:21.042206 (+ 141us) client_negotiation.cc:769] Sending connection context
0809 15:33:21.042340 (+ 134us) client_negotiation.cc:240] Negotiation successful
0809 15:33:21.042488 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262}
I20260809 15:33:21.043256 26403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:21.030048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44082 (local address 127.11.146.60:45945)
0809 15:33:21.033909 (+ 3861us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:21.033912 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:21.033925 (+ 13us) server_negotiation.cc:407] Connection header received
0809 15:33:21.033955 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:21.033957 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:21.033994 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:21.034508 (+ 514us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:21.034585 (+ 77us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:21.035238 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:21.036297 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:21.036650 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:21.037147 (+ 497us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:21.039032 (+ 1885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:21.039035 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:21.039038 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:21.039059 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:21.040760 (+ 1701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:21.041266 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:21.041269 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:21.041270 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:21.041341 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:21.041706 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:21.041711 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:21.041715 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:21.041917 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:21.042895 (+ 978us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:21.042972 (+ 77us) server_negotiation.cc:299] Negotiation successful
0809 15:33:21.043106 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3808,"thread_start_us":85,"threads_started":1}
I20260809 15:33:21.039647 26322 master_runner.cc:186] Error getting master registration for 127.11.146.62:44083: OK, instance_id { permanent_uuid: "44b6a1274f48422ba29eaeda3ed66a6b" instance_seqno: 1786289600566806 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 15:33:21.045639 26322 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 15:33:21.046363 26228 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b: Bootstrap starting.
I20260809 15:33:21.046693 26414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:21.024138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44066 (local address 127.11.146.60:45945)
0809 15:33:21.024999 (+ 861us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:21.025007 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:21.025020 (+ 13us) server_negotiation.cc:407] Connection header received
0809 15:33:21.025048 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:21.025051 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:21.025085 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:21.025171 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:21.027497 (+ 2326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:21.028257 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:21.031936 (+ 3679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:21.032311 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:21.032413 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:21.041446 (+ 9033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:21.041449 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:21.041451 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:21.041479 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:21.044612 (+ 3133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:21.045106 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:21.045113 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:21.045117 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:21.045216 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:21.045543 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:21.045546 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:21.045548 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:21.045747 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:21.045926 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:21.046413 (+ 487us) server_negotiation.cc:299] Negotiation successful
0809 15:33:21.046529 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":803,"thread_start_us":90,"threads_started":1}
I20260809 15:33:21.046723 26405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:21.024459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59924 (local address 127.11.146.62:44083)
0809 15:33:21.024565 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:21.024569 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:21.025446 (+ 877us) server_negotiation.cc:407] Connection header received
0809 15:33:21.026270 (+ 824us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:21.026274 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:21.026317 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:21.026388 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:21.029746 (+ 3358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:21.030593 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:21.032926 (+ 2333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:21.033288 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:21.033386 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:21.043176 (+ 9790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:21.043180 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:21.043183 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:21.043209 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:21.044905 (+ 1696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:21.045365 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:21.045369 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:21.045371 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:21.045471 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:21.045770 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:21.045773 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:21.045775 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:21.046039 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:21.046155 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:21.046480 (+ 325us) server_negotiation.cc:299] Negotiation successful
0809 15:33:21.046596 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 15:33:21.047331 26315 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3609626462e04c06b0e86661d5d9d4a7: No bootstrap required, opened a new log
I20260809 15:33:21.048864 26228 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b: Neither blocks nor log segments found. Creating new log.
I20260809 15:33:21.049695 26228 log.cc:824] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b: Log is configured to *not* fsync() on all Append() calls
I20260809 15:33:21.051034 26315 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3609626462e04c06b0e86661d5d9d4a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b6a1274f48422ba29eaeda3ed66a6b" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44083 } } peers { permanent_uuid: "3609626462e04c06b0e86661d5d9d4a7" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 45997 } } peers { permanent_uuid: "d9466f61d0ee459fb6881ed6780d7d1e" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45945 } }
I20260809 15:33:21.051187 26315 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3609626462e04c06b0e86661d5d9d4a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:33:21.051240 26315 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3609626462e04c06b0e86661d5d9d4a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3609626462e04c06b0e86661d5d9d4a7, State: Initialized, Role: FOLLOWER
I20260809 15:33:21.051653 26315 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3609626462e04c06b0e86661d5d9d4a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b6a1274f48422ba29eaeda3ed66a6b" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44083 } } peers { permanent_uuid: "3609626462e04c06b0e86661d5d9d4a7" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 45997 } } peers { permanent_uuid: "d9466f61d0ee459fb6881ed6780d7d1e" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45945 } }
I20260809 15:33:21.052062 26437 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3609626462e04c06b0e86661d5d9d4a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b6a1274f48422ba29eaeda3ed66a6b" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44083 } } peers { permanent_uuid: "3609626462e04c06b0e86661d5d9d4a7" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 45997 } } peers { permanent_uuid: "d9466f61d0ee459fb6881ed6780d7d1e" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45945 } } }
I20260809 15:33:21.052271 26437 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3609626462e04c06b0e86661d5d9d4a7 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:33:21.054299 26315 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3609626462e04c06b0e86661d5d9d4a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:33:21.058619 26228 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b: No bootstrap required, opened a new log
W20260809 15:33:21.059903 26451 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3609626462e04c06b0e86661d5d9d4a7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:33:21.059970 26451 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:33:21.061880 26228 raft_consensus.cc:348] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b6a1274f48422ba29eaeda3ed66a6b" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44083 } } peers { permanent_uuid: "3609626462e04c06b0e86661d5d9d4a7" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 45997 } } peers { permanent_uuid: "d9466f61d0ee459fb6881ed6780d7d1e" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45945 } }
I20260809 15:33:21.062021 26228 raft_consensus.cc:374] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:33:21.062048 26228 raft_consensus.cc:729] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44b6a1274f48422ba29eaeda3ed66a6b, State: Initialized, Role: FOLLOWER
I20260809 15:33:21.062414 26228 consensus_queue.cc:260] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b6a1274f48422ba29eaeda3ed66a6b" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44083 } } peers { permanent_uuid: "3609626462e04c06b0e86661d5d9d4a7" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 45997 } } peers { permanent_uuid: "d9466f61d0ee459fb6881ed6780d7d1e" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45945 } }
I20260809 15:33:21.062789 26453 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b6a1274f48422ba29eaeda3ed66a6b" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44083 } } peers { permanent_uuid: "3609626462e04c06b0e86661d5d9d4a7" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 45997 } } peers { permanent_uuid: "d9466f61d0ee459fb6881ed6780d7d1e" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45945 } } }
I20260809 15:33:21.062911 26453 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:33:21.063446 26228 sys_catalog.cc:564] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b [sys.catalog]: configured and running, proceeding with master startup.
W20260809 15:33:21.063572 26179 tablet.cc:2369] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:33:21.065346 26235 master_runner.cc:186] Error getting master registration for 127.11.146.62:44083: OK, instance_id { permanent_uuid: "44b6a1274f48422ba29eaeda3ed66a6b" instance_seqno: 1786289600566806 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 15:33:21.069527 26235 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 15:33:21.072628 26154 master_runner.cc:263] No leader master found from master 44b6a1274f48422ba29eaeda3ed66a6b
I20260809 15:33:21.072707 26154 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 15:33:21.076040 26465 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:33:21.076184 26465 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260809 15:33:21.224298 26349 tablet.cc:2369] T 00000000000000000000000000000000 P d9466f61d0ee459fb6881ed6780d7d1e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:33:21.227519 26453 raft_consensus.cc:482] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:33:21.227747 26453 raft_consensus.cc:504] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b6a1274f48422ba29eaeda3ed66a6b" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44083 } } peers { permanent_uuid: "3609626462e04c06b0e86661d5d9d4a7" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 45997 } } peers { permanent_uuid: "d9466f61d0ee459fb6881ed6780d7d1e" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45945 } }
I20260809 15:33:21.228724 26453 leader_election.cc:288] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3609626462e04c06b0e86661d5d9d4a7 (127.11.146.61:45997), d9466f61d0ee459fb6881ed6780d7d1e (127.11.146.60:45945)
I20260809 15:33:21.229300 26372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "44b6a1274f48422ba29eaeda3ed66a6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9466f61d0ee459fb6881ed6780d7d1e" is_pre_election: true
I20260809 15:33:21.229632 26372 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d9466f61d0ee459fb6881ed6780d7d1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44b6a1274f48422ba29eaeda3ed66a6b in term 0.
I20260809 15:33:21.230072 26172 leader_election.cc:302] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44b6a1274f48422ba29eaeda3ed66a6b, d9466f61d0ee459fb6881ed6780d7d1e; no voters:
I20260809 15:33:21.230191 26287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "44b6a1274f48422ba29eaeda3ed66a6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3609626462e04c06b0e86661d5d9d4a7" is_pre_election: true
I20260809 15:33:21.230357 26453 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:33:21.230432 26453 raft_consensus.cc:482] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:33:21.230472 26453 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:33:21.230487 26287 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3609626462e04c06b0e86661d5d9d4a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44b6a1274f48422ba29eaeda3ed66a6b in term 0.
I20260809 15:33:21.231885 26453 raft_consensus.cc:504] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b6a1274f48422ba29eaeda3ed66a6b" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44083 } } peers { permanent_uuid: "3609626462e04c06b0e86661d5d9d4a7" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 45997 } } peers { permanent_uuid: "d9466f61d0ee459fb6881ed6780d7d1e" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45945 } }
I20260809 15:33:21.232250 26453 leader_election.cc:288] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b [CANDIDATE]: Term 1 election: Requested vote from peers 3609626462e04c06b0e86661d5d9d4a7 (127.11.146.61:45997), d9466f61d0ee459fb6881ed6780d7d1e (127.11.146.60:45945)
I20260809 15:33:21.232859 26372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "44b6a1274f48422ba29eaeda3ed66a6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9466f61d0ee459fb6881ed6780d7d1e"
I20260809 15:33:21.232860 26287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "44b6a1274f48422ba29eaeda3ed66a6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3609626462e04c06b0e86661d5d9d4a7"
I20260809 15:33:21.232968 26287 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3609626462e04c06b0e86661d5d9d4a7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:33:21.234318 26287 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3609626462e04c06b0e86661d5d9d4a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44b6a1274f48422ba29eaeda3ed66a6b in term 1.
I20260809 15:33:21.234634 26172 leader_election.cc:302] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3609626462e04c06b0e86661d5d9d4a7, 44b6a1274f48422ba29eaeda3ed66a6b; no voters:
I20260809 15:33:21.234747 26372 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d9466f61d0ee459fb6881ed6780d7d1e [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:33:21.234864 26453 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:33:21.235075 26453 raft_consensus.cc:686] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b [term 1 LEADER]: Becoming Leader. State: Replica: 44b6a1274f48422ba29eaeda3ed66a6b, State: Running, Role: LEADER
I20260809 15:33:21.235390 26453 consensus_queue.cc:237] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b6a1274f48422ba29eaeda3ed66a6b" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44083 } } peers { permanent_uuid: "3609626462e04c06b0e86661d5d9d4a7" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 45997 } } peers { permanent_uuid: "d9466f61d0ee459fb6881ed6780d7d1e" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45945 } }
I20260809 15:33:21.235984 26372 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d9466f61d0ee459fb6881ed6780d7d1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44b6a1274f48422ba29eaeda3ed66a6b in term 1.
I20260809 15:33:21.237299 26453 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44b6a1274f48422ba29eaeda3ed66a6b. Latest consensus state: current_term: 1 leader_uuid: "44b6a1274f48422ba29eaeda3ed66a6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b6a1274f48422ba29eaeda3ed66a6b" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44083 } } peers { permanent_uuid: "3609626462e04c06b0e86661d5d9d4a7" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 45997 } } peers { permanent_uuid: "d9466f61d0ee459fb6881ed6780d7d1e" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45945 } } }
I20260809 15:33:21.237465 26453 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b [sys.catalog]: This master's current role is: LEADER
I20260809 15:33:21.237860 26469 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:33:21.238926 26469 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:33:21.243148 26372 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d9466f61d0ee459fb6881ed6780d7d1e [term 1 FOLLOWER]: Refusing update from remote peer 44b6a1274f48422ba29eaeda3ed66a6b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:33:21.243189 26287 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3609626462e04c06b0e86661d5d9d4a7 [term 1 FOLLOWER]: Refusing update from remote peer 44b6a1274f48422ba29eaeda3ed66a6b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:33:21.243754 26453 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3609626462e04c06b0e86661d5d9d4a7" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 45997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:33:21.243899 26467 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9466f61d0ee459fb6881ed6780d7d1e" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:33:21.247465 26437 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3609626462e04c06b0e86661d5d9d4a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44b6a1274f48422ba29eaeda3ed66a6b. Latest consensus state: current_term: 1 leader_uuid: "44b6a1274f48422ba29eaeda3ed66a6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b6a1274f48422ba29eaeda3ed66a6b" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44083 } } peers { permanent_uuid: "3609626462e04c06b0e86661d5d9d4a7" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 45997 } } peers { permanent_uuid: "d9466f61d0ee459fb6881ed6780d7d1e" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45945 } } }
I20260809 15:33:21.247578 26437 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3609626462e04c06b0e86661d5d9d4a7 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:33:21.247781 26420 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9466f61d0ee459fb6881ed6780d7d1e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44b6a1274f48422ba29eaeda3ed66a6b. Latest consensus state: current_term: 1 leader_uuid: "44b6a1274f48422ba29eaeda3ed66a6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b6a1274f48422ba29eaeda3ed66a6b" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44083 } } peers { permanent_uuid: "3609626462e04c06b0e86661d5d9d4a7" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 45997 } } peers { permanent_uuid: "d9466f61d0ee459fb6881ed6780d7d1e" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45945 } } }
I20260809 15:33:21.247937 26420 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9466f61d0ee459fb6881ed6780d7d1e [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:33:21.249821 26467 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "44b6a1274f48422ba29eaeda3ed66a6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b6a1274f48422ba29eaeda3ed66a6b" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44083 } } peers { permanent_uuid: "3609626462e04c06b0e86661d5d9d4a7" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 45997 } } peers { permanent_uuid: "d9466f61d0ee459fb6881ed6780d7d1e" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45945 } } }
I20260809 15:33:21.249949 26467 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b [sys.catalog]: This master's current role is: LEADER
I20260809 15:33:21.250025 26437 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3609626462e04c06b0e86661d5d9d4a7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "44b6a1274f48422ba29eaeda3ed66a6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b6a1274f48422ba29eaeda3ed66a6b" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44083 } } peers { permanent_uuid: "3609626462e04c06b0e86661d5d9d4a7" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 45997 } } peers { permanent_uuid: "d9466f61d0ee459fb6881ed6780d7d1e" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45945 } } }
I20260809 15:33:21.250133 26437 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3609626462e04c06b0e86661d5d9d4a7 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:33:21.251153 26467 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "44b6a1274f48422ba29eaeda3ed66a6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b6a1274f48422ba29eaeda3ed66a6b" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44083 } } peers { permanent_uuid: "3609626462e04c06b0e86661d5d9d4a7" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 45997 } } peers { permanent_uuid: "d9466f61d0ee459fb6881ed6780d7d1e" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45945 } } }
I20260809 15:33:21.251251 26467 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b [sys.catalog]: This master's current role is: LEADER
I20260809 15:33:21.252230 26420 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9466f61d0ee459fb6881ed6780d7d1e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "44b6a1274f48422ba29eaeda3ed66a6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44b6a1274f48422ba29eaeda3ed66a6b" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44083 } } peers { permanent_uuid: "3609626462e04c06b0e86661d5d9d4a7" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 45997 } } peers { permanent_uuid: "d9466f61d0ee459fb6881ed6780d7d1e" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 45945 } } }
I20260809 15:33:21.252331 26420 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9466f61d0ee459fb6881ed6780d7d1e [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:33:21.253471 26472 mvcc.cc:205] Tried to move back new op lower bound from 7316642206686326784 to 7316642206663495680. Current Snapshot: MvccSnapshot[applied={T|T < 7316642206686326784}]
I20260809 15:33:21.253715 26469 catalog_manager.cc:1347] Generated new cluster ID: 389d535cc84c4fa2909f229ec7c5f4d5
I20260809 15:33:21.253881 26469 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:33:21.253997 26473 mvcc.cc:205] Tried to move back new op lower bound from 7316642206686326784 to 7316642206663495680. Current Snapshot: MvccSnapshot[applied={T|T < 7316642206686326784}]
I20260809 15:33:21.271855 26469 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:33:21.273059 26469 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:33:21.286335 26469 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 44b6a1274f48422ba29eaeda3ed66a6b: Generated new TSK 0
I20260809 15:33:21.287147 26469 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:33:22.043588 26433 catalog_manager.cc:1259] Loaded cluster ID: 389d535cc84c4fa2909f229ec7c5f4d5
I20260809 15:33:22.043664 26433 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d9466f61d0ee459fb6881ed6780d7d1e: loading cluster ID for follower catalog manager: success
I20260809 15:33:22.045408 26433 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d9466f61d0ee459fb6881ed6780d7d1e: acquiring CA information for follower catalog manager: success
I20260809 15:33:22.046583 26433 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d9466f61d0ee459fb6881ed6780d7d1e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 15:33:22.061139 26451 catalog_manager.cc:1259] Loaded cluster ID: 389d535cc84c4fa2909f229ec7c5f4d5
I20260809 15:33:22.061198 26451 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3609626462e04c06b0e86661d5d9d4a7: loading cluster ID for follower catalog manager: success
I20260809 15:33:22.062745 26451 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3609626462e04c06b0e86661d5d9d4a7: acquiring CA information for follower catalog manager: success
I20260809 15:33:22.063946 26451 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3609626462e04c06b0e86661d5d9d4a7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 15:33:22.353909 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 26154
I20260809 15:33:22.363261 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 26235
I20260809 15:33:22.370460 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 26322
2026-08-09T15:33:22Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3157 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:33:22 dist-test-slave-1jjb krb5kdc[26485](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:33:22 dist-test-slave-1jjb krb5kdc[26485](info): set up 2 sockets
Aug 09 15:33:22 dist-test-slave-1jjb krb5kdc[26485](info): commencing operation
krb5kdc: starting...
W20260809 15:33:23.437897 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.045s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:33:23 dist-test-slave-1jjb krb5kdc[26485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289603, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:33:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:33:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.146.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
I20260809 15:33:23.563023 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:34391
--webserver_interface=127.11.146.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:42649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:34391
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:33:23.668769 26501 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:33:23.669014 26501 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:33:23.669094 26501 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:33:23.673074 26501 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:33:23.673151 26501 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:33:23.673189 26501 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:33:23.673243 26501 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:33:23.673285 26501 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:33:23.678107 26501 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:42649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:34391
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:34391
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26501
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:33:23.678936 26501 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:33:23.679807 26501 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:33:23.687942 26506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:23.688045 26501 server_base.cc:1034] running on GCE node
W20260809 15:33:23.687973 26509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:23.687942 26507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:23.688777 26501 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:33:23.689706 26501 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:33:23.690887 26501 hybrid_clock.cc:648] HybridClock initialized: now 1786289603690861 us; error 40 us; skew 500 ppm
Aug 09 15:33:23 dist-test-slave-1jjb krb5kdc[26485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289603, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:33:23.693840 26501 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:33:23.694686 26501 webserver.cc:460] Webserver started at http://127.11.146.62:43381/ using document root <none> and password file <none>
I20260809 15:33:23.695168 26501 fs_manager.cc:359] Metadata directory not provided
I20260809 15:33:23.695223 26501 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:33:23.695369 26501 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:33:23.697259 26501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "8f5610604f38467bb48cd9b50fba99e5"
format_stamp: "Formatted at 2026-08-09 15:33:23 on dist-test-slave-1jjb"
server_key: "221c4463a56b3f6f33314efe78b843b8"
server_key_iv: "34edfc3b06ca051b9a6a9d63a694717d"
server_key_version: "encryptionkey@0"
I20260809 15:33:23.697770 26501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "8f5610604f38467bb48cd9b50fba99e5"
format_stamp: "Formatted at 2026-08-09 15:33:23 on dist-test-slave-1jjb"
server_key: "221c4463a56b3f6f33314efe78b843b8"
server_key_iv: "34edfc3b06ca051b9a6a9d63a694717d"
server_key_version: "encryptionkey@0"
I20260809 15:33:23.701102 26501 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260809 15:33:23.703157 26516 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:23.704334 26501 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 15:33:23.704437 26501 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "8f5610604f38467bb48cd9b50fba99e5"
format_stamp: "Formatted at 2026-08-09 15:33:23 on dist-test-slave-1jjb"
server_key: "221c4463a56b3f6f33314efe78b843b8"
server_key_iv: "34edfc3b06ca051b9a6a9d63a694717d"
server_key_version: "encryptionkey@0"
I20260809 15:33:23.704520 26501 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:33:23.735430 26501 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:33:23.738149 26501 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:33:23.738293 26501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:33:23.745260 26501 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:34391
I20260809 15:33:23.745290 26573 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:34391 every 8 connection(s)
I20260809 15:33:23.746199 26501 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:33:23.748733 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 26501
I20260809 15:33:23.748821 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:33:23.748883 26576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:33:23.749161 11848 external_mini_cluster.cc:1428] Setting key 08366e498f411545191b64d452926992
I20260809 15:33:23.756053 26576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f5610604f38467bb48cd9b50fba99e5: Bootstrap starting.
Aug 09 15:33:23 dist-test-slave-1jjb krb5kdc[26485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289603, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:33:23.758386 26576 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8f5610604f38467bb48cd9b50fba99e5: Neither blocks nor log segments found. Creating new log.
I20260809 15:33:23.759280 26576 log.cc:824] T 00000000000000000000000000000000 P 8f5610604f38467bb48cd9b50fba99e5: Log is configured to *not* fsync() on all Append() calls
I20260809 15:33:23.761514 26576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f5610604f38467bb48cd9b50fba99e5: No bootstrap required, opened a new log
I20260809 15:33:23.763463 26579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:23.750464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58222 (local address 127.11.146.62:34391)
0809 15:33:23.750892 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:23.750910 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:23.750951 (+ 41us) server_negotiation.cc:407] Connection header received
0809 15:33:23.751691 (+ 740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:23.751715 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:23.752136 (+ 421us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:23.752482 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:23.753139 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:23.754649 (+ 1510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:23.755544 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:23.756233 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:23.756378 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:23.758704 (+ 2326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:23.758710 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:23.758724 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:23.758753 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:23.760593 (+ 1840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:23.761026 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:23.761031 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:23.761037 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:23.761167 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:23.761429 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:23.761432 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:23.761434 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:23.761910 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:23.762085 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:23.762323 (+ 238us) server_negotiation.cc:299] Negotiation successful
0809 15:33:23.762589 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":110,"threads_started":1}
I20260809 15:33:23.765733 26576 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8f5610604f38467bb48cd9b50fba99e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f5610604f38467bb48cd9b50fba99e5" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 34391 } }
I20260809 15:33:23.765986 26576 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8f5610604f38467bb48cd9b50fba99e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:33:23.766057 26576 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8f5610604f38467bb48cd9b50fba99e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f5610604f38467bb48cd9b50fba99e5, State: Initialized, Role: FOLLOWER
I20260809 15:33:23.766238 11848 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:33:23.766490 26576 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8f5610604f38467bb48cd9b50fba99e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f5610604f38467bb48cd9b50fba99e5" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 34391 } }
I20260809 15:33:23.766636 26576 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8f5610604f38467bb48cd9b50fba99e5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:33:23.766705 26576 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8f5610604f38467bb48cd9b50fba99e5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:33:23.766798 26576 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8f5610604f38467bb48cd9b50fba99e5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:33:23.767613 26576 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8f5610604f38467bb48cd9b50fba99e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f5610604f38467bb48cd9b50fba99e5" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 34391 } }
I20260809 15:33:23.767940 26576 leader_election.cc:302] T 00000000000000000000000000000000 P 8f5610604f38467bb48cd9b50fba99e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8f5610604f38467bb48cd9b50fba99e5; no voters:
I20260809 15:33:23.768271 26576 leader_election.cc:288] T 00000000000000000000000000000000 P 8f5610604f38467bb48cd9b50fba99e5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:33:23.768373 26581 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8f5610604f38467bb48cd9b50fba99e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:33:23.768589 26581 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8f5610604f38467bb48cd9b50fba99e5 [term 1 LEADER]: Becoming Leader. State: Replica: 8f5610604f38467bb48cd9b50fba99e5, State: Running, Role: LEADER
I20260809 15:33:23.768894 26581 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8f5610604f38467bb48cd9b50fba99e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f5610604f38467bb48cd9b50fba99e5" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 34391 } }
I20260809 15:33:23.769469 26576 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8f5610604f38467bb48cd9b50fba99e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:33:23.770448 26584 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f5610604f38467bb48cd9b50fba99e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8f5610604f38467bb48cd9b50fba99e5. Latest consensus state: current_term: 1 leader_uuid: "8f5610604f38467bb48cd9b50fba99e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f5610604f38467bb48cd9b50fba99e5" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 34391 } } }
I20260809 15:33:23.770584 26584 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f5610604f38467bb48cd9b50fba99e5 [sys.catalog]: This master's current role is: LEADER
I20260809 15:33:23.770885 26582 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f5610604f38467bb48cd9b50fba99e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8f5610604f38467bb48cd9b50fba99e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f5610604f38467bb48cd9b50fba99e5" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 34391 } } }
I20260809 15:33:23.770979 26582 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f5610604f38467bb48cd9b50fba99e5 [sys.catalog]: This master's current role is: LEADER
I20260809 15:33:23.771049 26592 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:33:23.773922 26592 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:33:23.778630 26592 catalog_manager.cc:1347] Generated new cluster ID: 4fe70d0e5ad14cf4aa4b0d73df7d205f
I20260809 15:33:23.778717 26592 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:33:23.802809 26592 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:33:23.803922 26592 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:33:23.815280 26592 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8f5610604f38467bb48cd9b50fba99e5: Generated new TSK 0
I20260809 15:33:23.815963 26592 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:33:23.821467 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 26501
2026-08-09T15:33:23Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1450 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:33:23 dist-test-slave-1jjb krb5kdc[26605](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:33:23 dist-test-slave-1jjb krb5kdc[26605](info): set up 2 sockets
Aug 09 15:33:23 dist-test-slave-1jjb krb5kdc[26605](info): commencing operation
krb5kdc: starting...
W20260809 15:33:24.975615 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.132s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:33:25 dist-test-slave-1jjb krb5kdc[26605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289605, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:33:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:33:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.146.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
I20260809 15:33:25.101337 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:41013
--webserver_interface=127.11.146.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:40683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:41013
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:33:25.208464 26623 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:33:25.208688 26623 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:33:25.208725 26623 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:33:25.212644 26623 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:33:25.212690 26623 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:33:25.212709 26623 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:33:25.212726 26623 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:33:25.212741 26623 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:33:25.217679 26623 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:40683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:41013
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:41013
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26623
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:33:25.218535 26623 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:33:25.219409 26623 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:33:25.227391 26628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:25.227478 26623 server_base.cc:1034] running on GCE node
W20260809 15:33:25.227397 26631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:25.227360 26629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:25.228279 26623 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:33:25.229372 26623 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:33:25.230566 26623 hybrid_clock.cc:648] HybridClock initialized: now 1786289605230538 us; error 37 us; skew 500 ppm
Aug 09 15:33:25 dist-test-slave-1jjb krb5kdc[26605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289605, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:33:25.237890 26623 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:33:25.238683 26623 webserver.cc:460] Webserver started at http://127.11.146.62:45047/ using document root <none> and password file <none>
I20260809 15:33:25.239198 26623 fs_manager.cc:359] Metadata directory not provided
I20260809 15:33:25.239288 26623 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:33:25.239545 26623 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:33:25.241549 26623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "c17b650e16f34cf093b93c1526b073cc"
format_stamp: "Formatted at 2026-08-09 15:33:25 on dist-test-slave-1jjb"
server_key: "aed64d6c44c0201a011d8acecb39ebfd"
server_key_iv: "024077951ee8c8af06c89324e53c166f"
server_key_version: "encryptionkey@0"
I20260809 15:33:25.242115 26623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "c17b650e16f34cf093b93c1526b073cc"
format_stamp: "Formatted at 2026-08-09 15:33:25 on dist-test-slave-1jjb"
server_key: "aed64d6c44c0201a011d8acecb39ebfd"
server_key_iv: "024077951ee8c8af06c89324e53c166f"
server_key_version: "encryptionkey@0"
I20260809 15:33:25.245651 26623 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.005s
I20260809 15:33:25.247812 26639 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:25.248910 26623 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20260809 15:33:25.249064 26623 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "c17b650e16f34cf093b93c1526b073cc"
format_stamp: "Formatted at 2026-08-09 15:33:25 on dist-test-slave-1jjb"
server_key: "aed64d6c44c0201a011d8acecb39ebfd"
server_key_iv: "024077951ee8c8af06c89324e53c166f"
server_key_version: "encryptionkey@0"
I20260809 15:33:25.249207 26623 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:33:25.264086 26623 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:33:25.266669 26623 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:33:25.266870 26623 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:33:25.273667 26623 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:41013
I20260809 15:33:25.273699 26696 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:41013 every 8 connection(s)
I20260809 15:33:25.274531 26623 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:33:25.277091 26698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:33:25.277221 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 26623
I20260809 15:33:25.277381 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:33:25.277642 11848 external_mini_cluster.cc:1428] Setting key 84fc67466eea0a302b37a0e4e113c1d7
I20260809 15:33:25.284227 26698 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc: Bootstrap starting.
I20260809 15:33:25.286841 26698 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc: Neither blocks nor log segments found. Creating new log.
Aug 09 15:33:25 dist-test-slave-1jjb krb5kdc[26605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289605, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:33:25.287683 26698 log.cc:824] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc: Log is configured to *not* fsync() on all Append() calls
I20260809 15:33:25.289721 26698 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc: No bootstrap required, opened a new log
I20260809 15:33:25.292696 26701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:25.278977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37260 (local address 127.11.146.62:41013)
0809 15:33:25.279376 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:25.279394 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:25.279436 (+ 42us) server_negotiation.cc:407] Connection header received
0809 15:33:25.280465 (+ 1029us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:25.280489 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:25.280881 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:25.281240 (+ 359us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:25.282134 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:25.283625 (+ 1491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:25.284750 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:25.285182 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:25.285298 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:25.287957 (+ 2659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:25.287963 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:25.287978 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:25.288016 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:25.289813 (+ 1797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:25.290406 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:25.290412 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:25.290416 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:25.290522 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:25.290834 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:25.290836 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:25.290837 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:25.291206 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:25.291346 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:25.291692 (+ 346us) server_negotiation.cc:299] Negotiation successful
0809 15:33:25.291951 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":110,"threads_started":1}
I20260809 15:33:25.293818 26698 raft_consensus.cc:348] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c17b650e16f34cf093b93c1526b073cc" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 41013 } }
I20260809 15:33:25.294086 26698 raft_consensus.cc:374] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:33:25.294191 26698 raft_consensus.cc:729] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c17b650e16f34cf093b93c1526b073cc, State: Initialized, Role: FOLLOWER
I20260809 15:33:25.294615 26698 consensus_queue.cc:260] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c17b650e16f34cf093b93c1526b073cc" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 41013 } }
I20260809 15:33:25.294775 26698 raft_consensus.cc:388] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:33:25.294885 26698 raft_consensus.cc:482] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:33:25.295017 26698 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:33:25.295924 26698 raft_consensus.cc:504] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c17b650e16f34cf093b93c1526b073cc" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 41013 } }
I20260809 15:33:25.296288 26698 leader_election.cc:302] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c17b650e16f34cf093b93c1526b073cc; no voters:
I20260809 15:33:25.296605 26698 leader_election.cc:288] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:33:25.296731 26704 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:33:25.296947 26704 raft_consensus.cc:686] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [term 1 LEADER]: Becoming Leader. State: Replica: c17b650e16f34cf093b93c1526b073cc, State: Running, Role: LEADER
I20260809 15:33:25.297288 26704 consensus_queue.cc:237] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c17b650e16f34cf093b93c1526b073cc" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 41013 } }
I20260809 15:33:25.297876 26698 sys_catalog.cc:564] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:33:25.299010 26705 sys_catalog.cc:455] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c17b650e16f34cf093b93c1526b073cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c17b650e16f34cf093b93c1526b073cc" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 41013 } } }
I20260809 15:33:25.299157 26705 sys_catalog.cc:458] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [sys.catalog]: This master's current role is: LEADER
I20260809 15:33:25.299521 26706 sys_catalog.cc:455] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader c17b650e16f34cf093b93c1526b073cc. Latest consensus state: current_term: 1 leader_uuid: "c17b650e16f34cf093b93c1526b073cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c17b650e16f34cf093b93c1526b073cc" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 41013 } } }
I20260809 15:33:25.300792 26706 sys_catalog.cc:458] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [sys.catalog]: This master's current role is: LEADER
W20260809 15:33:25.302822 26724 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:33:25.302909 26724 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:33:25.302986 26716 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:33:25.303668 26716 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:33:25.308787 26716 catalog_manager.cc:1347] Generated new cluster ID: 5abb418d22644b5baf03fec5007c2017
I20260809 15:33:25.308854 26716 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:33:25.327622 26716 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:33:25.328743 26716 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:33:25.336017 26716 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc: Generated new TSK 0
I20260809 15:33:25.336709 26716 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.146.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
I20260809 15:33:25.365279 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.1:0
--local_ip_for_outbound_sockets=127.11.146.1
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:41013
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:40683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:33:25.476401 26731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:33:25.476730 26731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:33:25.476812 26731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:33:25.481531 26731 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:33:25.481585 26731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:33:25.481676 26731 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.1
I20260809 15:33:25.486824 26731 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:40683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:41013
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26731
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.1
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:33:25.487769 26731 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:33:25.488826 26731 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:33:25.498214 26739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:25.498222 26741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:25.498222 26738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:25.498386 26731 server_base.cc:1034] running on GCE node
I20260809 15:33:25.499444 26731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:33:25.500057 26731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:33:25.501276 26731 hybrid_clock.cc:648] HybridClock initialized: now 1786289605501271 us; error 31 us; skew 500 ppm
Aug 09 15:33:25 dist-test-slave-1jjb krb5kdc[26605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289605, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:33:25.503867 26731 init.cc:377] Logged in from keytab as kudu/127.11.146.1@KRBTEST.COM (short username kudu)
I20260809 15:33:25.504750 26731 webserver.cc:460] Webserver started at http://127.11.146.1:35317/ using document root <none> and password file <none>
I20260809 15:33:25.505327 26731 fs_manager.cc:359] Metadata directory not provided
I20260809 15:33:25.505419 26731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:33:25.505637 26731 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:33:25.507522 26731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/data/instance:
uuid: "2306201969bb4da6abaf6a7a046475be"
format_stamp: "Formatted at 2026-08-09 15:33:25 on dist-test-slave-1jjb"
server_key: "db872b1f06bd243498a8380e58cba766"
server_key_iv: "8cecbc7a330feba0bff36ff21c31cea6"
server_key_version: "encryptionkey@0"
I20260809 15:33:25.508109 26731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance:
uuid: "2306201969bb4da6abaf6a7a046475be"
format_stamp: "Formatted at 2026-08-09 15:33:25 on dist-test-slave-1jjb"
server_key: "db872b1f06bd243498a8380e58cba766"
server_key_iv: "8cecbc7a330feba0bff36ff21c31cea6"
server_key_version: "encryptionkey@0"
I20260809 15:33:25.511668 26731 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 15:33:25.514016 26748 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:25.515125 26731 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:33:25.515262 26731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/wal
uuid: "2306201969bb4da6abaf6a7a046475be"
format_stamp: "Formatted at 2026-08-09 15:33:25 on dist-test-slave-1jjb"
server_key: "db872b1f06bd243498a8380e58cba766"
server_key_iv: "8cecbc7a330feba0bff36ff21c31cea6"
server_key_version: "encryptionkey@0"
I20260809 15:33:25.515362 26731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:33:25.533535 26731 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:33:25.535965 26731 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:33:25.536175 26731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:33:25.536707 26731 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:33:25.537495 26731 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:33:25.537568 26731 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:25.537634 26731 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:33:25.537684 26731 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:25.546959 26731 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.1:45695
I20260809 15:33:25.546989 26872 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.1:45695 every 8 connection(s)
I20260809 15:33:25.547799 26731 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
I20260809 15:33:25.551602 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 26731
I20260809 15:33:25.551779 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance
I20260809 15:33:25.552139 11848 external_mini_cluster.cc:1428] Setting key f1ad01352c970e1eb282122472e18d4c
Aug 09 15:33:25 dist-test-slave-1jjb krb5kdc[26605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289605, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.146.2@KRBTEST.COM; defaulting to no policy
I20260809 15:33:25.562659 26701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:25.549641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:43883 (local address 127.11.146.62:41013)
0809 15:33:25.549826 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:25.549831 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:25.550609 (+ 778us) server_negotiation.cc:407] Connection header received
0809 15:33:25.552066 (+ 1457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:25.552086 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:25.552148 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:25.552240 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:25.553569 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:25.554361 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:25.555473 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:25.555862 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:25.555954 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:25.558899 (+ 2945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:25.558902 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:25.558905 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:25.558956 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:25.560542 (+ 1586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:25.561062 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:25.561066 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:25.561068 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:25.561156 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:25.561498 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:25.561503 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:25.561505 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:25.561692 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:25.561802 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:25.562361 (+ 559us) server_negotiation.cc:299] Negotiation successful
0809 15:33:25.562486 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 15:33:25.563444 26875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:25.550027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.1:43883)
0809 15:33:25.550460 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:25.550500 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:25.551790 (+ 1290us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:25.552416 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:25.552423 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:25.552768 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:33:25.553401 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:25.553422 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:25.554496 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:25.554498 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:25.555335 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:25.555352 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:25.556035 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:25.556042 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:25.556300 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:25.556993 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:33:25.557019 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:33:25.558730 (+ 1711us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:33:25.560666 (+ 1936us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:25.560672 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:25.560687 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:25.560954 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:25.561249 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:25.561254 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:25.561256 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:25.561399 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:25.561801 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:33:25.561809 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:33:25.562104 (+ 295us) client_negotiation.cc:769] Sending connection context
0809 15:33:25.562309 (+ 205us) client_negotiation.cc:240] Negotiation successful
0809 15:33:25.562623 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":110,"threads_started":1}
I20260809 15:33:25.564751 26873 heartbeater.cc:347] Connected to a master server at 127.11.146.62:41013
I20260809 15:33:25.565016 26873 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.2@KRBTEST.COM" created.
I20260809 15:33:25.565572 26873 heartbeater.cc:511] Master 127.11.146.62:41013 requested a full tablet report, sending...
I20260809 15:33:25.567193 26656 ts_manager.cc:194] Registered new tserver with Master: 2306201969bb4da6abaf6a7a046475be (127.11.146.1:45695)
I20260809 15:33:25.568849 26656 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.1@KRBTEST.COM'} at 127.11.146.1:43883
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
I20260809 15:33:25.582418 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.2:0
--local_ip_for_outbound_sockets=127.11.146.2
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:41013
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:40683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:33:25.689699 26879 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:33:25.689920 26879 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:33:25.689958 26879 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:33:25.693696 26879 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:33:25.693739 26879 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:33:25.693790 26879 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.2
I20260809 15:33:25.698951 26879 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:40683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:41013
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26879
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.2
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:33:25.700192 26879 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:33:25.701131 26879 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 15:33:25.710760 26879 server_base.cc:1034] running on GCE node
W20260809 15:33:25.710695 26886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:25.710690 26889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:25.710722 26887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:25.711339 26879 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:33:25.711939 26879 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:33:25.713122 26879 hybrid_clock.cc:648] HybridClock initialized: now 1786289605713109 us; error 28 us; skew 500 ppm
Aug 09 15:33:25 dist-test-slave-1jjb krb5kdc[26605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289605, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:33:25.715747 26879 init.cc:377] Logged in from keytab as kudu/127.11.146.2@KRBTEST.COM (short username kudu)
I20260809 15:33:25.716519 26879 webserver.cc:460] Webserver started at http://127.11.146.2:38705/ using document root <none> and password file <none>
I20260809 15:33:25.717006 26879 fs_manager.cc:359] Metadata directory not provided
I20260809 15:33:25.717061 26879 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:33:25.717211 26879 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:33:25.719014 26879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/data/instance:
uuid: "f51d6d6285714da7bd487db9657b142d"
format_stamp: "Formatted at 2026-08-09 15:33:25 on dist-test-slave-1jjb"
server_key: "495efb9f9c99b2bd348fffac2c9900e0"
server_key_iv: "a777a44484bf966d104d67365033346b"
server_key_version: "encryptionkey@0"
I20260809 15:33:25.719659 26879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance:
uuid: "f51d6d6285714da7bd487db9657b142d"
format_stamp: "Formatted at 2026-08-09 15:33:25 on dist-test-slave-1jjb"
server_key: "495efb9f9c99b2bd348fffac2c9900e0"
server_key_iv: "a777a44484bf966d104d67365033346b"
server_key_version: "encryptionkey@0"
I20260809 15:33:25.723176 26879 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 15:33:25.725591 26897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:25.726732 26879 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:33:25.726843 26879 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/wal
uuid: "f51d6d6285714da7bd487db9657b142d"
format_stamp: "Formatted at 2026-08-09 15:33:25 on dist-test-slave-1jjb"
server_key: "495efb9f9c99b2bd348fffac2c9900e0"
server_key_iv: "a777a44484bf966d104d67365033346b"
server_key_version: "encryptionkey@0"
I20260809 15:33:25.726943 26879 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:33:25.741677 26879 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:33:25.744432 26879 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:33:25.744611 26879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:33:25.745146 26879 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:33:25.745955 26879 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:33:25.746047 26879 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:25.746107 26879 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:33:25.746143 26879 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:25.755115 26879 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.2:39847
I20260809 15:33:25.755153 27021 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.2:39847 every 8 connection(s)
I20260809 15:33:25.755872 26879 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
I20260809 15:33:25.758524 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 26879
I20260809 15:33:25.758636 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance
I20260809 15:33:25.758934 11848 external_mini_cluster.cc:1428] Setting key 6374d1b5b6b398971ea5d58606b32aca
Aug 09 15:33:25 dist-test-slave-1jjb krb5kdc[26605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289605, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:33:25.770455 26701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:25.757509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:54397 (local address 127.11.146.62:41013)
0809 15:33:25.757653 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:25.757656 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:25.758447 (+ 791us) server_negotiation.cc:407] Connection header received
0809 15:33:25.759999 (+ 1552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:25.760001 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:25.760043 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:25.760168 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:25.761615 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:25.762167 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:25.763508 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:25.763913 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:25.764029 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:25.766698 (+ 2669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:25.766701 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:25.766703 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:25.766724 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:25.768459 (+ 1735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:25.768944 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:25.768952 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:25.768953 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:25.769027 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:25.769411 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:25.769415 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:25.769417 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:25.769592 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:25.769699 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:25.770168 (+ 469us) server_negotiation.cc:299] Negotiation successful
0809 15:33:25.770289 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
WARNING: no policy specified for kudu/127.11.146.3@KRBTEST.COM; defaulting to no policy
I20260809 15:33:25.771145 27026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:25.757820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.2:54397)
0809 15:33:25.758286 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:25.758335 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:25.759736 (+ 1401us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:25.760319 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:25.760325 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:25.760766 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:33:25.761454 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:25.761477 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:25.762293 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:25.762299 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:25.763383 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:25.763393 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:25.764054 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:25.764057 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:25.764252 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:25.764792 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:33:25.764807 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:33:25.766546 (+ 1739us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:33:25.768586 (+ 2040us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:25.768591 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:25.768600 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:25.768832 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:25.769131 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:25.769135 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:25.769137 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:25.769260 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:25.769697 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:33:25.769704 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:33:25.769940 (+ 236us) client_negotiation.cc:769] Sending connection context
0809 15:33:25.770110 (+ 170us) client_negotiation.cc:240] Negotiation successful
0809 15:33:25.770406 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":108,"threads_started":1}
I20260809 15:33:25.772218 27022 heartbeater.cc:347] Connected to a master server at 127.11.146.62:41013
I20260809 15:33:25.772492 27022 heartbeater.cc:464] Registering TS with master...
I20260809 15:33:25.772931 27022 heartbeater.cc:511] Master 127.11.146.62:41013 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.3@KRBTEST.COM" created.
I20260809 15:33:25.773985 26656 ts_manager.cc:194] Registered new tserver with Master: f51d6d6285714da7bd487db9657b142d (127.11.146.2:39847)
I20260809 15:33:25.774552 26656 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.2@KRBTEST.COM'} at 127.11.146.2:54397
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
I20260809 15:33:25.787416 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.3:0
--local_ip_for_outbound_sockets=127.11.146.3
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:41013
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:40683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:33:25.895641 27031 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:33:25.895848 27031 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:33:25.895912 27031 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:33:25.900180 27031 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:33:25.900229 27031 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:33:25.900321 27031 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.3
I20260809 15:33:25.905279 27031 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:40683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:41013
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27031
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.3
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:33:25.906126 27031 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:33:25.907226 27031 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 15:33:25.916396 27031 server_base.cc:1034] running on GCE node
W20260809 15:33:25.916352 27036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:25.916330 27039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:25.916360 27037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:25.917002 27031 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:33:25.917604 27031 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:33:25.918776 27031 hybrid_clock.cc:648] HybridClock initialized: now 1786289605918757 us; error 28 us; skew 500 ppm
Aug 09 15:33:25 dist-test-slave-1jjb krb5kdc[26605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289605, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:33:25.921521 27031 init.cc:377] Logged in from keytab as kudu/127.11.146.3@KRBTEST.COM (short username kudu)
I20260809 15:33:25.922302 27031 webserver.cc:460] Webserver started at http://127.11.146.3:38839/ using document root <none> and password file <none>
I20260809 15:33:25.922845 27031 fs_manager.cc:359] Metadata directory not provided
I20260809 15:33:25.922928 27031 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:33:25.923136 27031 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:33:25.925127 27031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/data/instance:
uuid: "51040d1fb1d540febbab40a8735812c0"
format_stamp: "Formatted at 2026-08-09 15:33:25 on dist-test-slave-1jjb"
server_key: "72814d9d36c2c26db0793e7683c81dcf"
server_key_iv: "99eb95fa554b15c4609a904883a8e217"
server_key_version: "encryptionkey@0"
I20260809 15:33:25.925670 27031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance:
uuid: "51040d1fb1d540febbab40a8735812c0"
format_stamp: "Formatted at 2026-08-09 15:33:25 on dist-test-slave-1jjb"
server_key: "72814d9d36c2c26db0793e7683c81dcf"
server_key_iv: "99eb95fa554b15c4609a904883a8e217"
server_key_version: "encryptionkey@0"
I20260809 15:33:25.929124 27031 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260809 15:33:25.931398 27046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:25.932576 27031 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 15:33:25.932698 27031 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/wal
uuid: "51040d1fb1d540febbab40a8735812c0"
format_stamp: "Formatted at 2026-08-09 15:33:25 on dist-test-slave-1jjb"
server_key: "72814d9d36c2c26db0793e7683c81dcf"
server_key_iv: "99eb95fa554b15c4609a904883a8e217"
server_key_version: "encryptionkey@0"
I20260809 15:33:25.932806 27031 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:33:25.950243 27031 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:33:25.953058 27031 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:33:25.953238 27031 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:33:25.953809 27031 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:33:25.954567 27031 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:33:25.954632 27031 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:25.954717 27031 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:33:25.954768 27031 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:25.963099 27031 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.3:38201
I20260809 15:33:25.963145 27173 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.3:38201 every 8 connection(s)
I20260809 15:33:25.963892 27031 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
Aug 09 15:33:25 dist-test-slave-1jjb krb5kdc[26605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289605, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:33:25.973325 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 27031
I20260809 15:33:25.973453 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance
I20260809 15:33:25.973716 11848 external_mini_cluster.cc:1428] Setting key 58ab67b71ce8e8479a53145ca9e237e5
I20260809 15:33:25.976657 26701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:25.965461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:60885 (local address 127.11.146.62:41013)
0809 15:33:25.965617 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:25.965621 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:25.966353 (+ 732us) server_negotiation.cc:407] Connection header received
0809 15:33:25.967572 (+ 1219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:25.967576 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:25.967631 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:25.967727 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:25.968736 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:25.969267 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:25.970383 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:25.970604 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:25.970709 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:25.972969 (+ 2260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:25.972973 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:25.972975 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:25.972998 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:25.974619 (+ 1621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:25.975209 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:25.975212 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:25.975214 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:25.975299 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:25.975638 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:25.975642 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:25.975643 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:25.975888 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:25.975966 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:25.976456 (+ 490us) server_negotiation.cc:299] Negotiation successful
0809 15:33:25.976548 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 15:33:25.977357 27176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:25.965816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.3:60885)
0809 15:33:25.966222 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:25.966256 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:25.967363 (+ 1107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:25.967875 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:25.967881 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:25.968192 (+ 311us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:33:25.968599 (+ 407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:25.968611 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:25.969396 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:25.969405 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:25.970246 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:25.970256 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:25.970760 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:25.970764 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:25.970921 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:25.971420 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:33:25.971435 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:33:25.972797 (+ 1362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:33:25.974734 (+ 1937us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:25.974739 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:25.974751 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:25.975113 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:25.975427 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:25.975429 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:25.975431 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:25.975549 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:25.975997 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:33:25.976001 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:33:25.976258 (+ 257us) client_negotiation.cc:769] Sending connection context
0809 15:33:25.976409 (+ 151us) client_negotiation.cc:240] Negotiation successful
0809 15:33:25.976628 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":110,"threads_started":1}
I20260809 15:33:25.978497 27174 heartbeater.cc:347] Connected to a master server at 127.11.146.62:41013
I20260809 15:33:25.978704 27174 heartbeater.cc:464] Registering TS with master...
I20260809 15:33:25.979121 27174 heartbeater.cc:511] Master 127.11.146.62:41013 requested a full tablet report, sending...
I20260809 15:33:25.980152 26656 ts_manager.cc:194] Registered new tserver with Master: 51040d1fb1d540febbab40a8735812c0 (127.11.146.3:38201)
I20260809 15:33:25.980656 26656 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.3@KRBTEST.COM'} at 127.11.146.3:60885
I20260809 15:33:25.987360 11848 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:33:25.996265 26701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:25.989193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37266 (local address 127.11.146.62:41013)
0809 15:33:25.989457 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:25.989461 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:25.989649 (+ 188us) server_negotiation.cc:407] Connection header received
0809 15:33:25.989733 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:25.989735 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:25.989773 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:25.989854 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:25.990500 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:25.990999 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:25.991829 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:25.992042 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:25.992226 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:25.993504 (+ 1278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:25.993507 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:25.993509 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:25.993532 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:25.994808 (+ 1276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:25.995172 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:25.995174 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:25.995175 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:25.995245 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:25.995471 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:25.995473 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:25.995474 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:25.995660 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:25.995758 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:25.995944 (+ 186us) server_negotiation.cc:299] Negotiation successful
0809 15:33:25.996026 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158}
I20260809 15:33:25.999048 26656 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37266:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:33:26.002118 26656 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:33:26.016525 27188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:26.010646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33312 (local address 127.11.146.1:45695)
0809 15:33:26.011007 (+ 361us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:26.011020 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:26.011275 (+ 255us) server_negotiation.cc:407] Connection header received
0809 15:33:26.011344 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:26.011348 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:26.011522 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:26.011658 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:33:26.012036 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:26.013266 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:26.014990 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:26.015795 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:26.015921 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:26.016108 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:26.016268 (+ 160us) server_negotiation.cc:299] Negotiation successful
0809 15:33:26.016370 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251,"thread_start_us":134,"threads_started":1}
I20260809 15:33:26.016518 27185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:26.010128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:45695 (local address 127.0.0.1:33312)
0809 15:33:26.011060 (+ 932us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:26.011085 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:26.011152 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:26.011686 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:26.011692 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:26.011715 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:33:26.011902 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:26.011908 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:26.013754 (+ 1846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:26.013757 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:26.014868 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:26.014878 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:26.015926 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:26.015930 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:26.016039 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:26.016107 (+ 68us) client_negotiation.cc:769] Sending connection context
0809 15:33:26.016226 (+ 119us) client_negotiation.cc:240] Negotiation successful
0809 15:33:26.016371 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":866,"mutex_wait_us":52,"thread_start_us":83,"threads_started":1}
I20260809 15:33:26.016861 27190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:26.011317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51250 (local address 127.11.146.2:39847)
0809 15:33:26.012023 (+ 706us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:26.012039 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:26.012100 (+ 61us) server_negotiation.cc:407] Connection header received
0809 15:33:26.012187 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:26.012191 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:26.012322 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:26.012471 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:33:26.012690 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:26.013471 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:26.015110 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:26.015901 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:26.015992 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:26.016122 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:26.016594 (+ 472us) server_negotiation.cc:299] Negotiation successful
0809 15:33:26.016691 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":568,"thread_start_us":148,"threads_started":1}
I20260809 15:33:26.016935 27189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:26.010728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:39847 (local address 127.0.0.1:51250)
0809 15:33:26.011700 (+ 972us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:26.011712 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:26.011791 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:26.012449 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:26.012452 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:26.012469 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:33:26.012574 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:26.012580 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:26.013624 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:26.013628 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:26.014984 (+ 1356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:26.014995 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:26.016183 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:26.016207 (+ 24us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:26.016307 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:26.016338 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 15:33:26.016421 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 15:33:26.016491 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":916,"mutex_wait_us":39,"thread_start_us":111,"threads_started":1}
I20260809 15:33:26.017858 27187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:26.010146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57738 (local address 127.11.146.3:38201)
0809 15:33:26.010464 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:26.010477 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:26.011011 (+ 534us) server_negotiation.cc:407] Connection header received
0809 15:33:26.011332 (+ 321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:26.011338 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:26.011532 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:26.011644 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:33:26.012144 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:26.013266 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:26.015514 (+ 2248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:26.016248 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:26.016343 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:26.016471 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:26.017637 (+ 1166us) server_negotiation.cc:299] Negotiation successful
0809 15:33:26.017731 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":99,"threads_started":1}
I20260809 15:33:26.018165 27186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:26.010013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:38201 (local address 127.0.0.1:57738)
0809 15:33:26.010868 (+ 855us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:26.010916 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:26.011131 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:26.011861 (+ 730us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:26.011864 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:26.011883 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:33:26.011997 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:26.012003 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:26.013410 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:26.013413 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:26.015393 (+ 1980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:26.015401 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:26.016534 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:26.016541 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:26.017463 (+ 922us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:26.017488 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 15:33:26.017989 (+ 501us) client_negotiation.cc:240] Negotiation successful
0809 15:33:26.018060 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":667,"mutex_wait_us":872,"thread_start_us":83,"threads_started":1}
I20260809 15:33:26.019841 26945 tablet_service.cc:1467] Processing CreateTablet for tablet 81cff9e771bd4aaaaab9ca83a5fdc5b7 (DEFAULT_TABLE table=test-table [id=c63304dd0ab240359ebbab969f2bb28b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:33:26.019873 26802 tablet_service.cc:1467] Processing CreateTablet for tablet 81cff9e771bd4aaaaab9ca83a5fdc5b7 (DEFAULT_TABLE table=test-table [id=c63304dd0ab240359ebbab969f2bb28b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:33:26.021003 26802 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81cff9e771bd4aaaaab9ca83a5fdc5b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:33:26.021005 26945 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81cff9e771bd4aaaaab9ca83a5fdc5b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:33:26.020831 27100 tablet_service.cc:1467] Processing CreateTablet for tablet 81cff9e771bd4aaaaab9ca83a5fdc5b7 (DEFAULT_TABLE table=test-table [id=c63304dd0ab240359ebbab969f2bb28b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:33:26.021703 27100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81cff9e771bd4aaaaab9ca83a5fdc5b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:33:26.027082 27191 tablet_bootstrap.cc:492] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P f51d6d6285714da7bd487db9657b142d: Bootstrap starting.
I20260809 15:33:26.028267 27192 tablet_bootstrap.cc:492] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be: Bootstrap starting.
I20260809 15:33:26.028993 27193 tablet_bootstrap.cc:492] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 51040d1fb1d540febbab40a8735812c0: Bootstrap starting.
I20260809 15:33:26.030298 27192 tablet_bootstrap.cc:654] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be: Neither blocks nor log segments found. Creating new log.
I20260809 15:33:26.030795 27191 tablet_bootstrap.cc:654] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P f51d6d6285714da7bd487db9657b142d: Neither blocks nor log segments found. Creating new log.
I20260809 15:33:26.031198 27193 tablet_bootstrap.cc:654] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 51040d1fb1d540febbab40a8735812c0: Neither blocks nor log segments found. Creating new log.
I20260809 15:33:26.031652 27192 log.cc:824] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be: Log is configured to *not* fsync() on all Append() calls
I20260809 15:33:26.032038 27191 log.cc:824] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P f51d6d6285714da7bd487db9657b142d: Log is configured to *not* fsync() on all Append() calls
I20260809 15:33:26.032241 27193 log.cc:824] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 51040d1fb1d540febbab40a8735812c0: Log is configured to *not* fsync() on all Append() calls
I20260809 15:33:26.033571 27192 tablet_bootstrap.cc:492] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be: No bootstrap required, opened a new log
I20260809 15:33:26.033772 27192 ts_tablet_manager.cc:1397] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 15:33:26.033985 27191 tablet_bootstrap.cc:492] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P f51d6d6285714da7bd487db9657b142d: No bootstrap required, opened a new log
I20260809 15:33:26.034196 27191 ts_tablet_manager.cc:1397] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P f51d6d6285714da7bd487db9657b142d: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260809 15:33:26.036806 27192 raft_consensus.cc:348] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51040d1fb1d540febbab40a8735812c0" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38201 } } peers { permanent_uuid: "2306201969bb4da6abaf6a7a046475be" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45695 } } peers { permanent_uuid: "f51d6d6285714da7bd487db9657b142d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39847 } }
I20260809 15:33:26.037096 27192 raft_consensus.cc:374] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:33:26.037151 27192 raft_consensus.cc:729] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2306201969bb4da6abaf6a7a046475be, State: Initialized, Role: FOLLOWER
I20260809 15:33:26.037416 27193 tablet_bootstrap.cc:492] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 51040d1fb1d540febbab40a8735812c0: No bootstrap required, opened a new log
I20260809 15:33:26.037631 27193 ts_tablet_manager.cc:1397] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 51040d1fb1d540febbab40a8735812c0: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.004s
I20260809 15:33:26.037458 27191 raft_consensus.cc:348] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P f51d6d6285714da7bd487db9657b142d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51040d1fb1d540febbab40a8735812c0" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38201 } } peers { permanent_uuid: "2306201969bb4da6abaf6a7a046475be" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45695 } } peers { permanent_uuid: "f51d6d6285714da7bd487db9657b142d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39847 } }
I20260809 15:33:26.037708 27191 raft_consensus.cc:374] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P f51d6d6285714da7bd487db9657b142d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:33:26.037768 27191 raft_consensus.cc:729] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P f51d6d6285714da7bd487db9657b142d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f51d6d6285714da7bd487db9657b142d, State: Initialized, Role: FOLLOWER
I20260809 15:33:26.037707 27192 consensus_queue.cc:260] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51040d1fb1d540febbab40a8735812c0" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38201 } } peers { permanent_uuid: "2306201969bb4da6abaf6a7a046475be" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45695 } } peers { permanent_uuid: "f51d6d6285714da7bd487db9657b142d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39847 } }
I20260809 15:33:26.038215 27191 consensus_queue.cc:260] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P f51d6d6285714da7bd487db9657b142d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51040d1fb1d540febbab40a8735812c0" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38201 } } peers { permanent_uuid: "2306201969bb4da6abaf6a7a046475be" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45695 } } peers { permanent_uuid: "f51d6d6285714da7bd487db9657b142d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39847 } }
I20260809 15:33:26.038746 27192 ts_tablet_manager.cc:1428] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be: Time spent starting tablet: real 0.005s user 0.002s sys 0.003s
I20260809 15:33:26.039089 26873 heartbeater.cc:503] Master 127.11.146.62:41013 was elected leader, sending a full tablet report...
I20260809 15:33:26.039155 27191 ts_tablet_manager.cc:1428] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P f51d6d6285714da7bd487db9657b142d: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 15:33:26.040203 27022 heartbeater.cc:503] Master 127.11.146.62:41013 was elected leader, sending a full tablet report...
I20260809 15:33:26.041584 27193 raft_consensus.cc:348] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 51040d1fb1d540febbab40a8735812c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51040d1fb1d540febbab40a8735812c0" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38201 } } peers { permanent_uuid: "2306201969bb4da6abaf6a7a046475be" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45695 } } peers { permanent_uuid: "f51d6d6285714da7bd487db9657b142d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39847 } }
I20260809 15:33:26.041857 27193 raft_consensus.cc:374] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 51040d1fb1d540febbab40a8735812c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:33:26.041953 27193 raft_consensus.cc:729] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 51040d1fb1d540febbab40a8735812c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51040d1fb1d540febbab40a8735812c0, State: Initialized, Role: FOLLOWER
I20260809 15:33:26.042358 27193 consensus_queue.cc:260] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 51040d1fb1d540febbab40a8735812c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51040d1fb1d540febbab40a8735812c0" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38201 } } peers { permanent_uuid: "2306201969bb4da6abaf6a7a046475be" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45695 } } peers { permanent_uuid: "f51d6d6285714da7bd487db9657b142d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39847 } }
I20260809 15:33:26.042997 27174 heartbeater.cc:503] Master 127.11.146.62:41013 was elected leader, sending a full tablet report...
I20260809 15:33:26.043324 27193 ts_tablet_manager.cc:1428] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 51040d1fb1d540febbab40a8735812c0: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
W20260809 15:33:26.048905 26874 tablet.cc:2369] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 15:33:26.214777 27175 tablet.cc:2369] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 51040d1fb1d540febbab40a8735812c0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 15:33:26.256982 27024 tablet.cc:2369] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P f51d6d6285714da7bd487db9657b142d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:33:26.280465 27197 raft_consensus.cc:482] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:33:26.280673 27197 raft_consensus.cc:504] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51040d1fb1d540febbab40a8735812c0" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38201 } } peers { permanent_uuid: "2306201969bb4da6abaf6a7a046475be" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45695 } } peers { permanent_uuid: "f51d6d6285714da7bd487db9657b142d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39847 } }
I20260809 15:33:26.281849 27197 leader_election.cc:288] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51040d1fb1d540febbab40a8735812c0 (127.11.146.3:38201), f51d6d6285714da7bd487db9657b142d (127.11.146.2:39847)
I20260809 15:33:26.287029 27204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:26.282101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:39847 (local address 127.11.146.1:48851)
0809 15:33:26.282678 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:26.282689 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:26.282802 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:26.283178 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:26.283180 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:26.283196 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:33:26.283273 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:26.283277 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:26.284141 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:26.284145 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:26.285471 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:26.285485 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:26.286458 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:26.286461 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:26.286606 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:26.286632 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 15:33:26.286754 (+ 122us) client_negotiation.cc:240] Negotiation successful
0809 15:33:26.286860 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"mutex_wait_us":29,"thread_start_us":100,"threads_started":1}
I20260809 15:33:26.287185 27190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:26.282421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:48851 (local address 127.11.146.2:39847)
0809 15:33:26.282538 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:26.282543 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:26.282766 (+ 223us) server_negotiation.cc:407] Connection header received
0809 15:33:26.282927 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:26.282930 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:26.282984 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:26.283035 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:33:26.283420 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:26.283973 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:26.285625 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:26.286215 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:26.286306 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:26.286359 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:26.286834 (+ 475us) server_negotiation.cc:299] Negotiation successful
0809 15:33:26.286985 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 15:33:26.287533 27187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:26.282300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:43287 (local address 127.11.146.3:38201)
0809 15:33:26.282443 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:26.282448 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:26.282463 (+ 15us) server_negotiation.cc:407] Connection header received
0809 15:33:26.282672 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:26.282676 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:26.282729 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:26.282813 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:33:26.283109 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:26.283919 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:26.285959 (+ 2040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:26.286810 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:26.286945 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:26.286991 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:26.287305 (+ 314us) server_negotiation.cc:299] Negotiation successful
0809 15:33:26.287423 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 15:33:26.287863 27203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:26.282046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:38201 (local address 127.11.146.1:43287)
0809 15:33:26.282372 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:26.282388 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:26.282494 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:26.282849 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:26.282852 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:26.282869 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:33:26.282996 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:26.283005 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:26.284054 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:26.284057 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:26.285768 (+ 1711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:26.285779 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:26.287053 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:26.287057 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:26.287159 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:26.287181 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 15:33:26.287672 (+ 491us) client_negotiation.cc:240] Negotiation successful
0809 15:33:26.287747 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"mutex_wait_us":232,"thread_start_us":87,"threads_started":1}
I20260809 15:33:26.287804 26967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81cff9e771bd4aaaaab9ca83a5fdc5b7" candidate_uuid: "2306201969bb4da6abaf6a7a046475be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f51d6d6285714da7bd487db9657b142d" is_pre_election: true
I20260809 15:33:26.288166 26967 raft_consensus.cc:2454] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P f51d6d6285714da7bd487db9657b142d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2306201969bb4da6abaf6a7a046475be in term 0.
I20260809 15:33:26.288609 27123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81cff9e771bd4aaaaab9ca83a5fdc5b7" candidate_uuid: "2306201969bb4da6abaf6a7a046475be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51040d1fb1d540febbab40a8735812c0" is_pre_election: true
I20260809 15:33:26.288686 26750 leader_election.cc:302] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2306201969bb4da6abaf6a7a046475be, f51d6d6285714da7bd487db9657b142d; no voters:
I20260809 15:33:26.288900 27123 raft_consensus.cc:2454] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 51040d1fb1d540febbab40a8735812c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2306201969bb4da6abaf6a7a046475be in term 0.
I20260809 15:33:26.288990 27197 raft_consensus.cc:2781] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:33:26.289088 27197 raft_consensus.cc:482] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:33:26.289142 27197 raft_consensus.cc:3037] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:33:26.290217 27197 raft_consensus.cc:504] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51040d1fb1d540febbab40a8735812c0" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38201 } } peers { permanent_uuid: "2306201969bb4da6abaf6a7a046475be" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45695 } } peers { permanent_uuid: "f51d6d6285714da7bd487db9657b142d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39847 } }
I20260809 15:33:26.290560 27197 leader_election.cc:288] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be [CANDIDATE]: Term 1 election: Requested vote from peers 51040d1fb1d540febbab40a8735812c0 (127.11.146.3:38201), f51d6d6285714da7bd487db9657b142d (127.11.146.2:39847)
I20260809 15:33:26.290894 27123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81cff9e771bd4aaaaab9ca83a5fdc5b7" candidate_uuid: "2306201969bb4da6abaf6a7a046475be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51040d1fb1d540febbab40a8735812c0"
I20260809 15:33:26.290953 26967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81cff9e771bd4aaaaab9ca83a5fdc5b7" candidate_uuid: "2306201969bb4da6abaf6a7a046475be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f51d6d6285714da7bd487db9657b142d"
I20260809 15:33:26.291009 27123 raft_consensus.cc:3037] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 51040d1fb1d540febbab40a8735812c0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:33:26.291096 26967 raft_consensus.cc:3037] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P f51d6d6285714da7bd487db9657b142d [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:33:26.292037 27123 raft_consensus.cc:2454] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 51040d1fb1d540febbab40a8735812c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2306201969bb4da6abaf6a7a046475be in term 1.
I20260809 15:33:26.292164 26967 raft_consensus.cc:2454] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P f51d6d6285714da7bd487db9657b142d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2306201969bb4da6abaf6a7a046475be in term 1.
I20260809 15:33:26.292399 26749 leader_election.cc:302] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2306201969bb4da6abaf6a7a046475be, 51040d1fb1d540febbab40a8735812c0; no voters:
I20260809 15:33:26.292574 27197 raft_consensus.cc:2781] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:33:26.292850 27197 raft_consensus.cc:686] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be [term 1 LEADER]: Becoming Leader. State: Replica: 2306201969bb4da6abaf6a7a046475be, State: Running, Role: LEADER
I20260809 15:33:26.293175 27197 consensus_queue.cc:237] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51040d1fb1d540febbab40a8735812c0" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38201 } } peers { permanent_uuid: "2306201969bb4da6abaf6a7a046475be" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45695 } } peers { permanent_uuid: "f51d6d6285714da7bd487db9657b142d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39847 } }
I20260809 15:33:26.296358 26655 catalog_manager.cc:5495] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be reported cstate change: term changed from 0 to 1, leader changed from <none> to 2306201969bb4da6abaf6a7a046475be (127.11.146.1). New cstate: current_term: 1 leader_uuid: "2306201969bb4da6abaf6a7a046475be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51040d1fb1d540febbab40a8735812c0" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2306201969bb4da6abaf6a7a046475be" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f51d6d6285714da7bd487db9657b142d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39847 } health_report { overall_health: UNKNOWN } } }
I20260809 15:33:26.375612 27188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:26.372192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33328 (local address 127.11.146.1:45695)
0809 15:33:26.372338 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:26.372341 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:26.372370 (+ 29us) server_negotiation.cc:407] Connection header received
0809 15:33:26.372463 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:26.372465 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:26.372520 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:26.372602 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:33:26.372874 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:26.373370 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:26.374248 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:26.374474 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:26.374560 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:26.374816 (+ 256us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:33:26.375211 (+ 395us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:33:26.375297 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:26.375455 (+ 158us) server_negotiation.cc:299] Negotiation successful
0809 15:33:26.375507 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 15:33:26.381572 26967 raft_consensus.cc:1261] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P f51d6d6285714da7bd487db9657b142d [term 1 FOLLOWER]: Refusing update from remote peer 2306201969bb4da6abaf6a7a046475be: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:33:26.381570 27123 raft_consensus.cc:1261] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 51040d1fb1d540febbab40a8735812c0 [term 1 FOLLOWER]: Refusing update from remote peer 2306201969bb4da6abaf6a7a046475be: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:33:26.382328 27197 consensus_queue.cc:1035] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be [LEADER]: Connected to new peer: Peer: permanent_uuid: "51040d1fb1d540febbab40a8735812c0" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:33:26.382539 27205 consensus_queue.cc:1035] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be [LEADER]: Connected to new peer: Peer: permanent_uuid: "f51d6d6285714da7bd487db9657b142d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:33:26.391764 27210 mvcc.cc:205] Tried to move back new op lower bound from 7316642227731087360 to 7316642227379138560. Current Snapshot: MvccSnapshot[applied={T|T < 7316642227731087360}]
I20260809 15:33:26.396916 26656 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37266:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:33:26.397089 26656 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37266:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:33:26.399675 26656 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc: Sending DeleteTablet for 3 replicas of tablet 81cff9e771bd4aaaaab9ca83a5fdc5b7
I20260809 15:33:26.400624 26802 tablet_service.cc:1514] Processing DeleteTablet for tablet 81cff9e771bd4aaaaab9ca83a5fdc5b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:33:26 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:33312
I20260809 15:33:26.400596 26945 tablet_service.cc:1514] Processing DeleteTablet for tablet 81cff9e771bd4aaaaab9ca83a5fdc5b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:33:26 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:51250
I20260809 15:33:26.400637 27100 tablet_service.cc:1514] Processing DeleteTablet for tablet 81cff9e771bd4aaaaab9ca83a5fdc5b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:33:26 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:57738
I20260809 15:33:26.401227 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 26731
I20260809 15:33:26.401252 27218 tablet_replica.cc:330] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be: stopping tablet replica
I20260809 15:33:26.404970 27220 tablet_replica.cc:330] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 51040d1fb1d540febbab40a8735812c0: stopping tablet replica
I20260809 15:33:26.405293 27220 raft_consensus.cc:2229] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 51040d1fb1d540febbab40a8735812c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:33:26.405601 27220 raft_consensus.cc:2258] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 51040d1fb1d540febbab40a8735812c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:33:26.406000 27219 tablet_replica.cc:330] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P f51d6d6285714da7bd487db9657b142d: stopping tablet replica
I20260809 15:33:26.406304 27219 raft_consensus.cc:2229] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P f51d6d6285714da7bd487db9657b142d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:33:26.406615 27219 raft_consensus.cc:2258] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P f51d6d6285714da7bd487db9657b142d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:33:26.407133 27220 ts_tablet_manager.cc:1905] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 51040d1fb1d540febbab40a8735812c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:33:26.408011 27219 ts_tablet_manager.cc:1905] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P f51d6d6285714da7bd487db9657b142d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:33:26.409374 27220 ts_tablet_manager.cc:1918] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 51040d1fb1d540febbab40a8735812c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:33:26.409457 27220 log.cc:1196] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 51040d1fb1d540febbab40a8735812c0: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/wal/wals/81cff9e771bd4aaaaab9ca83a5fdc5b7
I20260809 15:33:26.409699 27220 ts_tablet_manager.cc:1939] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 51040d1fb1d540febbab40a8735812c0: Deleting consensus metadata
I20260809 15:33:26.410720 26640 catalog_manager.cc:4841] TS 51040d1fb1d540febbab40a8735812c0 (127.11.146.3:38201): tablet 81cff9e771bd4aaaaab9ca83a5fdc5b7 (table test-table [id=c63304dd0ab240359ebbab969f2bb28b]) successfully deleted
I20260809 15:33:26.411765 27219 ts_tablet_manager.cc:1918] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P f51d6d6285714da7bd487db9657b142d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:33:26.411875 27219 log.cc:1196] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P f51d6d6285714da7bd487db9657b142d: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/wal/wals/81cff9e771bd4aaaaab9ca83a5fdc5b7
I20260809 15:33:26.412238 27219 ts_tablet_manager.cc:1939] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P f51d6d6285714da7bd487db9657b142d: Deleting consensus metadata
W20260809 15:33:26.412783 26641 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.146.1:45695 (error 108)
I20260809 15:33:26.413072 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 26879
I20260809 15:33:26.414117 27186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:26.413552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:45695 (local address 127.0.0.1:33338)
0809 15:33:26.413935 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:26.414015 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.1:45695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":268}
W20260809 15:33:26.414253 26641 catalog_manager.cc:4584] TS 2306201969bb4da6abaf6a7a046475be (127.11.146.1:45695): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 81cff9e771bd4aaaaab9ca83a5fdc5b7: Network error: Client connection negotiation failed: client connection to 127.11.146.1:45695: connect: Connection refused (error 111)
I20260809 15:33:26.421363 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 27031
I20260809 15:33:26.421689 27186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:26.421385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:39847 (local address 127.0.0.1:51254)
0809 15:33:26.421528 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:26.421594 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.2:39847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 15:33:26.427763 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 26623
I20260809 15:33:26.435631 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:41013
--webserver_interface=127.11.146.62
--webserver_port=45047
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:40683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:41013
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:33:26.543286 27222 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:33:26.543507 27222 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:33:26.543543 27222 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:33:26.547278 27222 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:33:26.547323 27222 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:33:26.547340 27222 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:33:26.547355 27222 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:33:26.547374 27222 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:33:26.552160 27222 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:40683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:41013
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:41013
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=45047
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27222
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:33:26.552953 27222 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:33:26.553778 27222 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:33:26.571419 27232 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:26.571496 27230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:26.571419 27229 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:26.571632 27222 server_base.cc:1034] running on GCE node
I20260809 15:33:26.572345 27222 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:33:26.573414 27222 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:33:26.574604 27222 hybrid_clock.cc:648] HybridClock initialized: now 1786289606574576 us; error 47 us; skew 500 ppm
Aug 09 15:33:26 dist-test-slave-1jjb krb5kdc[26605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289606, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:33:26.577419 27222 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:33:26.578261 27222 webserver.cc:460] Webserver started at http://127.11.146.62:45047/ using document root <none> and password file <none>
I20260809 15:33:26.578781 27222 fs_manager.cc:359] Metadata directory not provided
I20260809 15:33:26.578886 27222 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:33:26.582477 27222 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:33:26.584553 27241 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:26.585686 27222 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:33:26.585824 27222 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "c17b650e16f34cf093b93c1526b073cc"
format_stamp: "Formatted at 2026-08-09 15:33:25 on dist-test-slave-1jjb"
server_key: "aed64d6c44c0201a011d8acecb39ebfd"
server_key_iv: "024077951ee8c8af06c89324e53c166f"
server_key_version: "encryptionkey@0"
I20260809 15:33:26.586396 27222 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:33:26.598498 27222 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:33:26.601740 27222 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:33:26.601938 27222 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:33:26.609032 27222 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:41013
I20260809 15:33:26.609323 27296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:41013 every 8 connection(s)
I20260809 15:33:26.610109 27222 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:33:26.612102 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 27222
I20260809 15:33:26.612656 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.1:45695
--local_ip_for_outbound_sockets=127.11.146.1
--tserver_master_addrs=127.11.146.62:41013
--webserver_port=35317
--webserver_interface=127.11.146.1
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:40683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:33:26.615199 27297 sys_catalog.cc:263] Verifying existing consensus state
I20260809 15:33:26.616955 27297 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc: Bootstrap starting.
I20260809 15:33:26.633541 27297 log.cc:824] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc: Log is configured to *not* fsync() on all Append() calls
I20260809 15:33:26.642156 27297 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 15:33:26.642503 27297 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc: Bootstrap complete.
I20260809 15:33:26.646538 27297 raft_consensus.cc:348] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c17b650e16f34cf093b93c1526b073cc" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 41013 } }
I20260809 15:33:26.646893 27297 raft_consensus.cc:729] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c17b650e16f34cf093b93c1526b073cc, State: Initialized, Role: FOLLOWER
I20260809 15:33:26.647332 27297 consensus_queue.cc:260] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c17b650e16f34cf093b93c1526b073cc" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 41013 } }
I20260809 15:33:26.647440 27297 raft_consensus.cc:388] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:33:26.647528 27297 raft_consensus.cc:482] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:33:26.647665 27297 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [term 1 FOLLOWER]: Advancing to term 2
I20260809 15:33:26.649534 27297 raft_consensus.cc:504] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c17b650e16f34cf093b93c1526b073cc" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 41013 } }
I20260809 15:33:26.649861 27297 leader_election.cc:302] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c17b650e16f34cf093b93c1526b073cc; no voters:
I20260809 15:33:26.650143 27297 leader_election.cc:288] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 15:33:26.650266 27302 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [term 2 FOLLOWER]: Leader election won for term 2
I20260809 15:33:26.650521 27302 raft_consensus.cc:686] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [term 2 LEADER]: Becoming Leader. State: Replica: c17b650e16f34cf093b93c1526b073cc, State: Running, Role: LEADER
I20260809 15:33:26.650817 27302 consensus_queue.cc:237] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c17b650e16f34cf093b93c1526b073cc" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 41013 } }
I20260809 15:33:26.651310 27297 sys_catalog.cc:564] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:33:26.651741 27302 sys_catalog.cc:455] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader c17b650e16f34cf093b93c1526b073cc. Latest consensus state: current_term: 2 leader_uuid: "c17b650e16f34cf093b93c1526b073cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c17b650e16f34cf093b93c1526b073cc" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 41013 } } }
I20260809 15:33:26.651862 27302 sys_catalog.cc:458] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [sys.catalog]: This master's current role is: LEADER
I20260809 15:33:26.652490 27303 sys_catalog.cc:455] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c17b650e16f34cf093b93c1526b073cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c17b650e16f34cf093b93c1526b073cc" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 41013 } } }
I20260809 15:33:26.652591 27303 sys_catalog.cc:458] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [sys.catalog]: This master's current role is: LEADER
I20260809 15:33:26.653156 27306 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:33:26.657874 27306 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:33:26.658512 27306 catalog_manager.cc:1259] Loaded cluster ID: 5abb418d22644b5baf03fec5007c2017
I20260809 15:33:26.658574 27306 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:33:26.659899 27306 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260809 15:33:26.664307 27306 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260809 15:33:26.668983 27306 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:33:26.669692 27306 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc: Loaded TSK: 0
I20260809 15:33:26.670816 27306 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 15:33:26.726379 27299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:33:26.726689 27299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:33:26.726790 27299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:33:26.730746 27299 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:33:26.730792 27299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:33:26.730880 27299 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.1
I20260809 15:33:26.736372 27299 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:40683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.1:45695
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.146.1
--webserver_port=35317
--tserver_master_addrs=127.11.146.62:41013
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27299
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.1
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:33:26.737258 27299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:33:26.738152 27299 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:33:26.747084 27329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:26.747087 27328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:26.747294 27299 server_base.cc:1034] running on GCE node
W20260809 15:33:26.747402 27331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:26.747716 27299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:33:26.748327 27299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:33:26.749508 27299 hybrid_clock.cc:648] HybridClock initialized: now 1786289606749487 us; error 37 us; skew 500 ppm
Aug 09 15:33:26 dist-test-slave-1jjb krb5kdc[26605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289606, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:33:26.752405 27299 init.cc:377] Logged in from keytab as kudu/127.11.146.1@KRBTEST.COM (short username kudu)
I20260809 15:33:26.753396 27299 webserver.cc:460] Webserver started at http://127.11.146.1:35317/ using document root <none> and password file <none>
I20260809 15:33:26.753902 27299 fs_manager.cc:359] Metadata directory not provided
I20260809 15:33:26.754029 27299 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:33:26.757619 27299 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:33:26.759614 27339 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:26.760833 27299 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:33:26.760967 27299 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/wal
uuid: "2306201969bb4da6abaf6a7a046475be"
format_stamp: "Formatted at 2026-08-09 15:33:25 on dist-test-slave-1jjb"
server_key: "db872b1f06bd243498a8380e58cba766"
server_key_iv: "8cecbc7a330feba0bff36ff21c31cea6"
server_key_version: "encryptionkey@0"
I20260809 15:33:26.761441 27299 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:33:26.774807 27299 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:33:26.777915 27299 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:33:26.778111 27299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:33:26.778690 27299 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:33:26.779680 27348 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 15:33:26.783461 27299 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 15:33:26.783524 27299 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20260809 15:33:26.783586 27299 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 15:33:26.785159 27299 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 15:33:26.785215 27299 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260809 15:33:26.785470 27348 tablet_bootstrap.cc:492] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be: Bootstrap starting.
I20260809 15:33:26.796131 27299 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.1:45695
I20260809 15:33:26.796202 27466 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.1:45695 every 8 connection(s)
I20260809 15:33:26.797374 27299 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
I20260809 15:33:26.800266 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 27299
I20260809 15:33:26.800734 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.2:39847
--local_ip_for_outbound_sockets=127.11.146.2
--tserver_master_addrs=127.11.146.62:41013
--webserver_port=38705
--webserver_interface=127.11.146.2
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:40683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:33:26.806488 27348 log.cc:824] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be: Log is configured to *not* fsync() on all Append() calls
Aug 09 15:33:26 dist-test-slave-1jjb krb5kdc[26605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289606, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:33:26.814445 27348 tablet_bootstrap.cc:492] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 15:33:26.814900 27348 tablet_bootstrap.cc:492] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be: Bootstrap complete.
I20260809 15:33:26.816256 27348 ts_tablet_manager.cc:1397] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be: Time spent bootstrapping tablet: real 0.031s user 0.019s sys 0.011s
I20260809 15:33:26.817077 27470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:26.799435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.1:52731)
0809 15:33:26.800109 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:26.800188 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:26.801392 (+ 1204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:26.803717 (+ 2325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:26.803725 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:26.804206 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:33:26.804662 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:26.804675 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:26.805951 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:26.805954 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:26.806872 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:26.806885 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:26.808007 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:26.808011 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:26.808222 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:26.808961 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:33:26.808981 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:33:26.811013 (+ 2032us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:33:26.813542 (+ 2529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:26.813551 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:26.813567 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:26.813938 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:26.814374 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:26.814379 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:26.814381 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:26.814553 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:26.815254 (+ 701us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:33:26.815260 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:33:26.815540 (+ 280us) client_negotiation.cc:769] Sending connection context
0809 15:33:26.815732 (+ 192us) client_negotiation.cc:240] Negotiation successful
0809 15:33:26.816050 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":153,"threads_started":1}
I20260809 15:33:26.817101 27469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:26.799430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:52731 (local address 127.11.146.62:41013)
0809 15:33:26.802787 (+ 3357us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:26.802801 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:26.802836 (+ 35us) server_negotiation.cc:407] Connection header received
0809 15:33:26.803026 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:26.803035 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:26.803353 (+ 318us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:26.803669 (+ 316us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:26.804862 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:26.805795 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:26.807052 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:26.807849 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:26.808051 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:26.811226 (+ 3175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:26.811233 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:26.811247 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:26.811280 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:26.813409 (+ 2129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:26.814082 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:26.814088 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:26.814094 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:26.814268 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:26.814654 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:26.814660 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:26.814664 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:26.815134 (+ 470us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:26.815272 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:26.815883 (+ 611us) server_negotiation.cc:299] Negotiation successful
0809 15:33:26.816231 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3234,"thread_start_us":90,"threads_started":1}
I20260809 15:33:26.818938 27348 raft_consensus.cc:348] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51040d1fb1d540febbab40a8735812c0" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38201 } } peers { permanent_uuid: "2306201969bb4da6abaf6a7a046475be" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45695 } } peers { permanent_uuid: "f51d6d6285714da7bd487db9657b142d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39847 } }
I20260809 15:33:26.819429 27348 raft_consensus.cc:729] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2306201969bb4da6abaf6a7a046475be, State: Initialized, Role: FOLLOWER
I20260809 15:33:26.819906 27348 consensus_queue.cc:260] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51040d1fb1d540febbab40a8735812c0" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38201 } } peers { permanent_uuid: "2306201969bb4da6abaf6a7a046475be" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45695 } } peers { permanent_uuid: "f51d6d6285714da7bd487db9657b142d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39847 } }
I20260809 15:33:26.820261 27467 heartbeater.cc:347] Connected to a master server at 127.11.146.62:41013
I20260809 15:33:26.820482 27467 heartbeater.cc:464] Registering TS with master...
I20260809 15:33:26.820897 27348 ts_tablet_manager.cc:1428] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260809 15:33:26.820972 27467 heartbeater.cc:511] Master 127.11.146.62:41013 requested a full tablet report, sending...
I20260809 15:33:26.823192 27259 ts_manager.cc:194] Registered new tserver with Master: 2306201969bb4da6abaf6a7a046475be (127.11.146.1:45695)
I20260809 15:33:26.826421 27259 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.1@KRBTEST.COM'} at 127.11.146.1:52731
I20260809 15:33:26.828886 27467 heartbeater.cc:503] Master 127.11.146.62:41013 was elected leader, sending a full tablet report...
Aug 09 15:33:26 dist-test-slave-1jjb krb5kdc[26605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289606, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for kudu/127.11.146.1@KRBTEST.COM
I20260809 15:33:26.835558 27476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:26.825896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:45695 (local address 127.0.0.1:33348)
0809 15:33:26.826403 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:26.826522 (+ 119us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:26.826644 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:26.827096 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:26.827103 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:26.827524 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:33:26.827618 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:26.827624 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:26.828630 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:26.828634 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:26.829392 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:26.829403 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:26.829956 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:26.829960 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:26.830079 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:26.830618 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:33:26.830630 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:33:26.832040 (+ 1410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:33:26.833843 (+ 1803us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:26.833853 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:26.833862 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:26.834087 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:26.834388 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:26.834391 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:26.834393 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:26.834479 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:26.834928 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:33:26.834934 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:33:26.835061 (+ 127us) client_negotiation.cc:769] Sending connection context
0809 15:33:26.835194 (+ 133us) client_negotiation.cc:240] Negotiation successful
0809 15:33:26.835388 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":95,"threads_started":1}
I20260809 15:33:26.835574 27478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:26.825975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33348 (local address 127.11.146.1:45695)
0809 15:33:26.826669 (+ 694us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:26.826680 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:26.826700 (+ 20us) server_negotiation.cc:407] Connection header received
0809 15:33:26.826760 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:26.826764 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:26.826933 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:26.827052 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:26.827746 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:26.828519 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:26.829506 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:26.829837 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:26.829952 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:26.832204 (+ 2252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:26.832213 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:26.832221 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:26.832241 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:26.833727 (+ 1486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:26.834202 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:26.834210 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:26.834216 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:26.834290 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:26.834588 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:26.834591 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:26.834593 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:26.834806 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:26.834953 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:26.835284 (+ 331us) server_negotiation.cc:299] Negotiation successful
0809 15:33:26.835435 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":607,"thread_start_us":87,"threads_started":1}
I20260809 15:33:26.836717 27393 tablet_service.cc:1514] Processing DeleteTablet for tablet 81cff9e771bd4aaaaab9ca83a5fdc5b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:33:26 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:33348
I20260809 15:33:26.837594 27479 tablet_replica.cc:330] stopping tablet replica
I20260809 15:33:26.837867 27479 raft_consensus.cc:2229] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:33:26.838094 27479 raft_consensus.cc:2258] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:33:26.838966 27479 ts_tablet_manager.cc:1905] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:33:26.842234 27479 ts_tablet_manager.cc:1918] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:33:26.842386 27479 log.cc:1196] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/wal/wals/81cff9e771bd4aaaaab9ca83a5fdc5b7
I20260809 15:33:26.842645 27479 ts_tablet_manager.cc:1939] T 81cff9e771bd4aaaaab9ca83a5fdc5b7 P 2306201969bb4da6abaf6a7a046475be: Deleting consensus metadata
I20260809 15:33:26.844177 27243 catalog_manager.cc:4841] TS 2306201969bb4da6abaf6a7a046475be (127.11.146.1:45695): tablet 81cff9e771bd4aaaaab9ca83a5fdc5b7 (table test-table [id=c63304dd0ab240359ebbab969f2bb28b]) successfully deleted
W20260809 15:33:26.916354 27471 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:33:26.916564 27471 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:33:26.916604 27471 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:33:26.920502 27471 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:33:26.920547 27471 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:33:26.920647 27471 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.2
I20260809 15:33:26.925619 27471 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:40683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.2:39847
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.146.2
--webserver_port=38705
--tserver_master_addrs=127.11.146.62:41013
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27471
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.2
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:33:26.926512 27471 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:33:26.927429 27471 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:33:26.936688 27486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:26.936740 27489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:26.936712 27485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:26.936895 27471 server_base.cc:1034] running on GCE node
I20260809 15:33:26.937353 27471 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:33:26.937963 27471 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:33:26.939141 27471 hybrid_clock.cc:648] HybridClock initialized: now 1786289606939119 us; error 30 us; skew 500 ppm
Aug 09 15:33:26 dist-test-slave-1jjb krb5kdc[26605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289606, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:33:26.941845 27471 init.cc:377] Logged in from keytab as kudu/127.11.146.2@KRBTEST.COM (short username kudu)
I20260809 15:33:26.942620 27471 webserver.cc:460] Webserver started at http://127.11.146.2:38705/ using document root <none> and password file <none>
I20260809 15:33:26.943167 27471 fs_manager.cc:359] Metadata directory not provided
I20260809 15:33:26.943277 27471 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:33:26.946863 27471 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:33:26.948825 27496 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:26.949959 27471 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:33:26.950088 27471 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/wal
uuid: "f51d6d6285714da7bd487db9657b142d"
format_stamp: "Formatted at 2026-08-09 15:33:25 on dist-test-slave-1jjb"
server_key: "495efb9f9c99b2bd348fffac2c9900e0"
server_key_iv: "a777a44484bf966d104d67365033346b"
server_key_version: "encryptionkey@0"
I20260809 15:33:26.950587 27471 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:33:26.965400 27471 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:33:26.968005 27471 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:33:26.968214 27471 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:33:26.968750 27471 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:33:26.969543 27471 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:33:26.969611 27471 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:26.969678 27471 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:33:26.969731 27471 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:26.978200 27471 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.2:39847
I20260809 15:33:26.978229 27624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.2:39847 every 8 connection(s)
I20260809 15:33:26.979183 27471 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
Aug 09 15:33:26 dist-test-slave-1jjb krb5kdc[26605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289606, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:33:26.989069 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 27471
I20260809 15:33:26.989480 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.3:38201
--local_ip_for_outbound_sockets=127.11.146.3
--tserver_master_addrs=127.11.146.62:41013
--webserver_port=38839
--webserver_interface=127.11.146.3
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:40683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:33:26.992443 27469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:26.980966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:50145 (local address 127.11.146.62:41013)
0809 15:33:26.981130 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:26.981135 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:26.981949 (+ 814us) server_negotiation.cc:407] Connection header received
0809 15:33:26.983138 (+ 1189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:26.983141 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:26.983190 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:26.983261 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:26.984374 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:26.984877 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:26.985936 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:26.986153 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:26.986228 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:26.988556 (+ 2328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:26.988560 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:26.988562 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:26.988585 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:26.990192 (+ 1607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:26.990728 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:26.990735 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:26.990740 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:26.990842 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:26.991155 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:26.991162 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:26.991166 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:26.991425 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:26.991512 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:26.992155 (+ 643us) server_negotiation.cc:299] Negotiation successful
0809 15:33:26.992281 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 15:33:26.993443 27627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:26.981376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.2:50145)
0809 15:33:26.981798 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:26.981837 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:26.982949 (+ 1112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:26.983417 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:26.983425 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:26.983732 (+ 307us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:33:26.984245 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:26.984260 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:26.984982 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:26.984985 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:26.985835 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:26.985844 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:26.986277 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:26.986280 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:26.986422 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:26.986903 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:33:26.986929 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:33:26.988405 (+ 1476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:33:26.990355 (+ 1950us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:26.990360 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:26.990374 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:26.990627 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:26.990942 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:26.990944 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:26.990945 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:26.991064 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:26.991540 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:33:26.991548 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:33:26.991845 (+ 297us) client_negotiation.cc:769] Sending connection context
0809 15:33:26.992057 (+ 212us) client_negotiation.cc:240] Negotiation successful
0809 15:33:26.992455 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":110,"threads_started":1}
I20260809 15:33:26.994650 27625 heartbeater.cc:347] Connected to a master server at 127.11.146.62:41013
I20260809 15:33:26.994901 27625 heartbeater.cc:464] Registering TS with master...
I20260809 15:33:26.995494 27625 heartbeater.cc:511] Master 127.11.146.62:41013 requested a full tablet report, sending...
I20260809 15:33:26.996647 27259 ts_manager.cc:194] Registered new tserver with Master: f51d6d6285714da7bd487db9657b142d (127.11.146.2:39847)
I20260809 15:33:26.997205 27259 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.2@KRBTEST.COM'} at 127.11.146.2:50145
W20260809 15:33:27.100503 27628 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:33:27.100761 27628 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:33:27.100831 27628 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:33:27.104768 27628 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:33:27.104813 27628 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:33:27.104913 27628 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.3
I20260809 15:33:27.109695 27628 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:40683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.3:38201
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.146.3
--webserver_port=38839
--tserver_master_addrs=127.11.146.62:41013
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27628
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.3
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:33:27.110616 27628 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:33:27.111548 27628 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:33:27.120656 27633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:27.120726 27634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:27.120787 27628 server_base.cc:1034] running on GCE node
W20260809 15:33:27.120643 27636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:27.121269 27628 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:33:27.121869 27628 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:33:27.123072 27628 hybrid_clock.cc:648] HybridClock initialized: now 1786289607123058 us; error 22 us; skew 500 ppm
Aug 09 15:33:27 dist-test-slave-1jjb krb5kdc[26605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289607, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:33:27.125721 27628 init.cc:377] Logged in from keytab as kudu/127.11.146.3@KRBTEST.COM (short username kudu)
I20260809 15:33:27.126552 27628 webserver.cc:460] Webserver started at http://127.11.146.3:38839/ using document root <none> and password file <none>
I20260809 15:33:27.127087 27628 fs_manager.cc:359] Metadata directory not provided
I20260809 15:33:27.127199 27628 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:33:27.130800 27628 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:33:27.132756 27643 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:27.133891 27628 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:33:27.134004 27628 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/wal
uuid: "51040d1fb1d540febbab40a8735812c0"
format_stamp: "Formatted at 2026-08-09 15:33:25 on dist-test-slave-1jjb"
server_key: "72814d9d36c2c26db0793e7683c81dcf"
server_key_iv: "99eb95fa554b15c4609a904883a8e217"
server_key_version: "encryptionkey@0"
I20260809 15:33:27.134472 27628 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:33:27.165611 27628 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:33:27.168803 27628 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:33:27.168951 27628 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:33:27.169448 27628 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:33:27.170207 27628 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:33:27.170252 27628 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:27.170291 27628 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:33:27.170311 27628 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:27.179163 27628 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.3:38201
I20260809 15:33:27.179232 27772 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.3:38201 every 8 connection(s)
I20260809 15:33:27.180189 27628 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
I20260809 15:33:27.187502 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 27628
Aug 09 15:33:27 dist-test-slave-1jjb krb5kdc[26605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289607, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:33:27.194317 27469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:27.181847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:39263 (local address 127.11.146.62:41013)
0809 15:33:27.181979 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:27.181982 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:27.182694 (+ 712us) server_negotiation.cc:407] Connection header received
0809 15:33:27.184051 (+ 1357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:27.184054 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:27.184138 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:27.184253 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:27.185335 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:27.185843 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:27.186963 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:27.187232 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:27.187340 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:27.190372 (+ 3032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:27.190376 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:27.190379 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:27.190417 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:27.192117 (+ 1700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:27.192606 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:27.192611 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:27.192612 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:27.192699 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:27.193037 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:27.193041 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:27.193043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:27.193281 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:27.193379 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:27.193968 (+ 589us) server_negotiation.cc:299] Negotiation successful
0809 15:33:27.194158 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 15:33:27.195066 27775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:27.182153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.3:39263)
0809 15:33:27.182561 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:27.182598 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:27.183852 (+ 1254us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:27.184422 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:27.184429 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:27.184762 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:33:27.185198 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:27.185210 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:27.185972 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:27.185975 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:27.186832 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:27.186841 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:27.187378 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:27.187382 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:27.187548 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:27.188441 (+ 893us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:33:27.188460 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:33:27.190197 (+ 1737us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:33:27.192222 (+ 2025us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:27.192228 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:27.192241 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:27.192502 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:27.192798 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:27.192801 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:27.192803 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:27.192943 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:27.193387 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:33:27.193394 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:33:27.193682 (+ 288us) client_negotiation.cc:769] Sending connection context
0809 15:33:27.193922 (+ 240us) client_negotiation.cc:240] Negotiation successful
0809 15:33:27.194233 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":110,"threads_started":1}
I20260809 15:33:27.196118 27777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:27.188175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37282 (local address 127.11.146.62:41013)
0809 15:33:27.188413 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:27.188417 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:27.188567 (+ 150us) server_negotiation.cc:407] Connection header received
0809 15:33:27.188699 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:27.188701 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:27.188764 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:27.188855 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:27.189699 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:27.190293 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:27.191165 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:27.191400 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:27.191512 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:27.192836 (+ 1324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:27.192840 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:27.192842 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:27.192867 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:27.194304 (+ 1437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:27.194770 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:27.194775 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:27.194776 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:27.194863 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:27.195150 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:27.195153 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:27.195155 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:27.195382 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:27.195608 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:27.195826 (+ 218us) server_negotiation.cc:299] Negotiation successful
0809 15:33:27.195952 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":110,"threads_started":1}
I20260809 15:33:27.196307 27773 heartbeater.cc:347] Connected to a master server at 127.11.146.62:41013
I20260809 15:33:27.196579 27773 heartbeater.cc:464] Registering TS with master...
I20260809 15:33:27.197160 27773 heartbeater.cc:511] Master 127.11.146.62:41013 requested a full tablet report, sending...
I20260809 15:33:27.198139 27259 ts_manager.cc:194] Registered new tserver with Master: 51040d1fb1d540febbab40a8735812c0 (127.11.146.3:38201)
I20260809 15:33:27.198688 27259 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.3@KRBTEST.COM'} at 127.11.146.3:39263
I20260809 15:33:27.209370 11848 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:33:27.213047 27777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:27.209952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37296 (local address 127.11.146.62:41013)
0809 15:33:27.210065 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:27.210068 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:27.210204 (+ 136us) server_negotiation.cc:407] Connection header received
0809 15:33:27.210321 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:27.210323 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:27.210399 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:27.210479 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:33:27.210640 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:27.211098 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:27.211876 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:27.212139 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:27.212216 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:27.212456 (+ 240us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:33:27.212765 (+ 309us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:33:27.212849 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:27.212915 (+ 66us) server_negotiation.cc:299] Negotiation successful
0809 15:33:27.212961 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 15:33:27.213601 27259 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:37296:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:33:27.216811 27259 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:33:27.223897 27393 tablet_service.cc:1467] Processing CreateTablet for tablet 3d6927272c9647edb21b6a599d041b78 (DEFAULT_TABLE table=test-table [id=f1288ae1841a481bb7fb536e68db4b95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:33:27.224591 27393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d6927272c9647edb21b6a599d041b78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:33:27.227537 27348 tablet_bootstrap.cc:492] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be: Bootstrap starting.
I20260809 15:33:27.228045 27476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:27.222902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:39847 (local address 127.0.0.1:51256)
0809 15:33:27.223060 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:27.223074 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:27.223149 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:27.224241 (+ 1092us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:27.224246 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:27.224268 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:33:27.224362 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:27.224369 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:27.225692 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:27.225696 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:27.226762 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:27.226772 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:27.227637 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:27.227641 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:27.227732 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:27.227779 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 15:33:27.227835 (+ 56us) client_negotiation.cc:240] Negotiation successful
0809 15:33:27.227922 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90}
I20260809 15:33:27.228448 27348 tablet_bootstrap.cc:654] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be: Neither blocks nor log segments found. Creating new log.
I20260809 15:33:27.228879 27783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:27.223115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51256 (local address 127.11.146.2:39847)
0809 15:33:27.223731 (+ 616us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:27.223743 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:27.223768 (+ 25us) server_negotiation.cc:407] Connection header received
0809 15:33:27.223844 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:27.223849 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:27.224053 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:27.224245 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:33:27.224523 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:27.225548 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:27.226898 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:27.227491 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:27.228361 (+ 870us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:27.228541 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:27.228597 (+ 56us) server_negotiation.cc:299] Negotiation successful
0809 15:33:27.228712 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":514,"thread_start_us":157,"threads_started":1}
I20260809 15:33:27.229816 27784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:27.223315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:38201 (local address 127.0.0.1:57752)
0809 15:33:27.224347 (+ 1032us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:27.224361 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:27.224467 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:27.225049 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:27.225052 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:27.225072 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:33:27.225158 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:27.225165 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:27.226463 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:27.226469 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:27.227578 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:27.227589 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:27.229377 (+ 1788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:27.229381 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:27.229479 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:27.229505 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 15:33:27.229589 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 15:33:27.229665 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":974,"thread_start_us":109,"threads_started":1}
I20260809 15:33:27.230067 27348 tablet_bootstrap.cc:492] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be: No bootstrap required, opened a new log
I20260809 15:33:27.230156 27348 ts_tablet_manager.cc:1397] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 15:33:27.230405 27786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:27.223497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57752 (local address 127.11.146.3:38201)
0809 15:33:27.223793 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:27.223803 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:27.224455 (+ 652us) server_negotiation.cc:407] Connection header received
0809 15:33:27.224590 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:27.224595 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:27.224783 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:27.224953 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:33:27.225252 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:27.226311 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:27.227716 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:27.228993 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:27.229156 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:27.229291 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:27.230173 (+ 882us) server_negotiation.cc:299] Negotiation successful
0809 15:33:27.230287 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":112,"threads_started":1}
I20260809 15:33:27.230585 27348 raft_consensus.cc:348] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f51d6d6285714da7bd487db9657b142d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39847 } } peers { permanent_uuid: "51040d1fb1d540febbab40a8735812c0" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38201 } } peers { permanent_uuid: "2306201969bb4da6abaf6a7a046475be" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45695 } }
I20260809 15:33:27.230701 27348 raft_consensus.cc:374] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:33:27.230737 27348 raft_consensus.cc:729] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2306201969bb4da6abaf6a7a046475be, State: Initialized, Role: FOLLOWER
I20260809 15:33:27.230860 27348 consensus_queue.cc:260] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f51d6d6285714da7bd487db9657b142d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39847 } } peers { permanent_uuid: "51040d1fb1d540febbab40a8735812c0" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38201 } } peers { permanent_uuid: "2306201969bb4da6abaf6a7a046475be" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45695 } }
I20260809 15:33:27.231109 27348 ts_tablet_manager.cc:1428] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 15:33:27.231998 27550 tablet_service.cc:1467] Processing CreateTablet for tablet 3d6927272c9647edb21b6a599d041b78 (DEFAULT_TABLE table=test-table [id=f1288ae1841a481bb7fb536e68db4b95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:33:27.232965 27550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d6927272c9647edb21b6a599d041b78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:33:27.233397 27700 tablet_service.cc:1467] Processing CreateTablet for tablet 3d6927272c9647edb21b6a599d041b78 (DEFAULT_TABLE table=test-table [id=f1288ae1841a481bb7fb536e68db4b95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:33:27.234344 27700 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d6927272c9647edb21b6a599d041b78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:33:27.239519 27788 tablet_bootstrap.cc:492] T 3d6927272c9647edb21b6a599d041b78 P f51d6d6285714da7bd487db9657b142d: Bootstrap starting.
I20260809 15:33:27.240700 27789 tablet_bootstrap.cc:492] T 3d6927272c9647edb21b6a599d041b78 P 51040d1fb1d540febbab40a8735812c0: Bootstrap starting.
I20260809 15:33:27.242033 27788 tablet_bootstrap.cc:654] T 3d6927272c9647edb21b6a599d041b78 P f51d6d6285714da7bd487db9657b142d: Neither blocks nor log segments found. Creating new log.
I20260809 15:33:27.242837 27788 log.cc:824] T 3d6927272c9647edb21b6a599d041b78 P f51d6d6285714da7bd487db9657b142d: Log is configured to *not* fsync() on all Append() calls
I20260809 15:33:27.243135 27789 tablet_bootstrap.cc:654] T 3d6927272c9647edb21b6a599d041b78 P 51040d1fb1d540febbab40a8735812c0: Neither blocks nor log segments found. Creating new log.
I20260809 15:33:27.243862 27789 log.cc:824] T 3d6927272c9647edb21b6a599d041b78 P 51040d1fb1d540febbab40a8735812c0: Log is configured to *not* fsync() on all Append() calls
I20260809 15:33:27.244721 27788 tablet_bootstrap.cc:492] T 3d6927272c9647edb21b6a599d041b78 P f51d6d6285714da7bd487db9657b142d: No bootstrap required, opened a new log
I20260809 15:33:27.244900 27788 ts_tablet_manager.cc:1397] T 3d6927272c9647edb21b6a599d041b78 P f51d6d6285714da7bd487db9657b142d: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 15:33:27.245661 27789 tablet_bootstrap.cc:492] T 3d6927272c9647edb21b6a599d041b78 P 51040d1fb1d540febbab40a8735812c0: No bootstrap required, opened a new log
I20260809 15:33:27.245848 27789 ts_tablet_manager.cc:1397] T 3d6927272c9647edb21b6a599d041b78 P 51040d1fb1d540febbab40a8735812c0: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 15:33:27.247998 27788 raft_consensus.cc:348] T 3d6927272c9647edb21b6a599d041b78 P f51d6d6285714da7bd487db9657b142d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f51d6d6285714da7bd487db9657b142d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39847 } } peers { permanent_uuid: "51040d1fb1d540febbab40a8735812c0" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38201 } } peers { permanent_uuid: "2306201969bb4da6abaf6a7a046475be" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45695 } }
I20260809 15:33:27.248250 27788 raft_consensus.cc:374] T 3d6927272c9647edb21b6a599d041b78 P f51d6d6285714da7bd487db9657b142d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:33:27.248322 27788 raft_consensus.cc:729] T 3d6927272c9647edb21b6a599d041b78 P f51d6d6285714da7bd487db9657b142d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f51d6d6285714da7bd487db9657b142d, State: Initialized, Role: FOLLOWER
I20260809 15:33:27.248749 27788 consensus_queue.cc:260] T 3d6927272c9647edb21b6a599d041b78 P f51d6d6285714da7bd487db9657b142d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f51d6d6285714da7bd487db9657b142d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39847 } } peers { permanent_uuid: "51040d1fb1d540febbab40a8735812c0" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38201 } } peers { permanent_uuid: "2306201969bb4da6abaf6a7a046475be" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45695 } }
I20260809 15:33:27.248778 27789 raft_consensus.cc:348] T 3d6927272c9647edb21b6a599d041b78 P 51040d1fb1d540febbab40a8735812c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f51d6d6285714da7bd487db9657b142d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39847 } } peers { permanent_uuid: "51040d1fb1d540febbab40a8735812c0" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38201 } } peers { permanent_uuid: "2306201969bb4da6abaf6a7a046475be" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45695 } }
I20260809 15:33:27.249028 27789 raft_consensus.cc:374] T 3d6927272c9647edb21b6a599d041b78 P 51040d1fb1d540febbab40a8735812c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:33:27.249099 27789 raft_consensus.cc:729] T 3d6927272c9647edb21b6a599d041b78 P 51040d1fb1d540febbab40a8735812c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51040d1fb1d540febbab40a8735812c0, State: Initialized, Role: FOLLOWER
I20260809 15:33:27.249343 27625 heartbeater.cc:503] Master 127.11.146.62:41013 was elected leader, sending a full tablet report...
I20260809 15:33:27.249497 27789 consensus_queue.cc:260] T 3d6927272c9647edb21b6a599d041b78 P 51040d1fb1d540febbab40a8735812c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f51d6d6285714da7bd487db9657b142d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39847 } } peers { permanent_uuid: "51040d1fb1d540febbab40a8735812c0" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38201 } } peers { permanent_uuid: "2306201969bb4da6abaf6a7a046475be" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45695 } }
I20260809 15:33:27.249608 27788 ts_tablet_manager.cc:1428] T 3d6927272c9647edb21b6a599d041b78 P f51d6d6285714da7bd487db9657b142d: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 15:33:27.250082 27773 heartbeater.cc:503] Master 127.11.146.62:41013 was elected leader, sending a full tablet report...
I20260809 15:33:27.250419 27789 ts_tablet_manager.cc:1428] T 3d6927272c9647edb21b6a599d041b78 P 51040d1fb1d540febbab40a8735812c0: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
W20260809 15:33:27.298655 27468 tablet.cc:2369] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 15:33:27.431177 27774 tablet.cc:2369] T 3d6927272c9647edb21b6a599d041b78 P 51040d1fb1d540febbab40a8735812c0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 15:33:27.480922 27626 tablet.cc:2369] T 3d6927272c9647edb21b6a599d041b78 P f51d6d6285714da7bd487db9657b142d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:33:27.597330 27474 raft_consensus.cc:482] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:33:27.597544 27474 raft_consensus.cc:504] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f51d6d6285714da7bd487db9657b142d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39847 } } peers { permanent_uuid: "51040d1fb1d540febbab40a8735812c0" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38201 } } peers { permanent_uuid: "2306201969bb4da6abaf6a7a046475be" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45695 } }
I20260809 15:33:27.598691 27474 leader_election.cc:288] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f51d6d6285714da7bd487db9657b142d (127.11.146.2:39847), 51040d1fb1d540febbab40a8735812c0 (127.11.146.3:38201)
I20260809 15:33:27.604269 27786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:27.599187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:35199 (local address 127.11.146.3:38201)
0809 15:33:27.599349 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:27.599354 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:27.599376 (+ 22us) server_negotiation.cc:407] Connection header received
0809 15:33:27.599543 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:27.599546 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:27.599602 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:27.599697 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:33:27.600120 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:27.600930 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:27.602866 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:27.603505 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:27.603649 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:27.603703 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:27.604053 (+ 350us) server_negotiation.cc:299] Negotiation successful
0809 15:33:27.604142 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 15:33:27.604269 27783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:27.598996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:55305 (local address 127.11.146.2:39847)
0809 15:33:27.599134 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:27.599140 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:27.599347 (+ 207us) server_negotiation.cc:407] Connection header received
0809 15:33:27.599543 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:27.599547 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:27.599602 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:27.599698 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:33:27.600124 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:27.600930 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:27.602866 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:27.603505 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:27.603649 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:27.603703 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:27.604053 (+ 350us) server_negotiation.cc:299] Negotiation successful
0809 15:33:27.604142 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 15:33:27.604310 27797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:27.598844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:39847 (local address 127.11.146.1:55305)
0809 15:33:27.599235 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:27.599250 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:27.599390 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:27.599719 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:27.599722 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:27.599742 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:33:27.599965 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:27.599972 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:27.601060 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:27.601064 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:27.602712 (+ 1648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:27.602724 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:27.603650 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:27.603654 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:27.603841 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:27.603936 (+ 95us) client_negotiation.cc:769] Sending connection context
0809 15:33:27.604015 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 15:33:27.604136 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"mutex_wait_us":312,"spinlock_wait_cycles":6400,"thread_start_us":147,"threads_started":1}
I20260809 15:33:27.604310 27796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:27.598988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:38201 (local address 127.11.146.1:35199)
0809 15:33:27.599296 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:27.599310 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:27.599426 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:27.599719 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:27.599722 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:27.599757 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:33:27.599965 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:27.599972 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:27.601060 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:27.601064 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:27.602712 (+ 1648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:27.602724 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:27.603651 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:27.603654 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:27.603841 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:27.603937 (+ 96us) client_negotiation.cc:769] Sending connection context
0809 15:33:27.604015 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 15:33:27.604136 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"mutex_wait_us":347,"spinlock_wait_cycles":51584,"thread_start_us":95,"threads_started":1}
I20260809 15:33:27.605162 27575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d6927272c9647edb21b6a599d041b78" candidate_uuid: "2306201969bb4da6abaf6a7a046475be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f51d6d6285714da7bd487db9657b142d" is_pre_election: true
I20260809 15:33:27.605466 27575 raft_consensus.cc:2454] T 3d6927272c9647edb21b6a599d041b78 P f51d6d6285714da7bd487db9657b142d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2306201969bb4da6abaf6a7a046475be in term 0.
I20260809 15:33:27.605433 27722 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d6927272c9647edb21b6a599d041b78" candidate_uuid: "2306201969bb4da6abaf6a7a046475be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51040d1fb1d540febbab40a8735812c0" is_pre_election: true
I20260809 15:33:27.605753 27722 raft_consensus.cc:2454] T 3d6927272c9647edb21b6a599d041b78 P 51040d1fb1d540febbab40a8735812c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2306201969bb4da6abaf6a7a046475be in term 0.
I20260809 15:33:27.605952 27341 leader_election.cc:302] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2306201969bb4da6abaf6a7a046475be, f51d6d6285714da7bd487db9657b142d; no voters:
I20260809 15:33:27.606251 27474 raft_consensus.cc:2781] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:33:27.606351 27474 raft_consensus.cc:482] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:33:27.606383 27474 raft_consensus.cc:3037] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:33:27.607420 27474 raft_consensus.cc:504] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f51d6d6285714da7bd487db9657b142d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39847 } } peers { permanent_uuid: "51040d1fb1d540febbab40a8735812c0" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38201 } } peers { permanent_uuid: "2306201969bb4da6abaf6a7a046475be" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45695 } }
I20260809 15:33:27.607802 27474 leader_election.cc:288] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [CANDIDATE]: Term 1 election: Requested vote from peers f51d6d6285714da7bd487db9657b142d (127.11.146.2:39847), 51040d1fb1d540febbab40a8735812c0 (127.11.146.3:38201)
I20260809 15:33:27.608173 27575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d6927272c9647edb21b6a599d041b78" candidate_uuid: "2306201969bb4da6abaf6a7a046475be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f51d6d6285714da7bd487db9657b142d"
I20260809 15:33:27.608278 27722 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d6927272c9647edb21b6a599d041b78" candidate_uuid: "2306201969bb4da6abaf6a7a046475be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51040d1fb1d540febbab40a8735812c0"
I20260809 15:33:27.608290 27575 raft_consensus.cc:3037] T 3d6927272c9647edb21b6a599d041b78 P f51d6d6285714da7bd487db9657b142d [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:33:27.608374 27722 raft_consensus.cc:3037] T 3d6927272c9647edb21b6a599d041b78 P 51040d1fb1d540febbab40a8735812c0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:33:27.609391 27575 raft_consensus.cc:2454] T 3d6927272c9647edb21b6a599d041b78 P f51d6d6285714da7bd487db9657b142d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2306201969bb4da6abaf6a7a046475be in term 1.
I20260809 15:33:27.609627 27722 raft_consensus.cc:2454] T 3d6927272c9647edb21b6a599d041b78 P 51040d1fb1d540febbab40a8735812c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2306201969bb4da6abaf6a7a046475be in term 1.
I20260809 15:33:27.609659 27341 leader_election.cc:302] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2306201969bb4da6abaf6a7a046475be, f51d6d6285714da7bd487db9657b142d; no voters:
I20260809 15:33:27.609956 27474 raft_consensus.cc:2781] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:33:27.610138 27474 raft_consensus.cc:686] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [term 1 LEADER]: Becoming Leader. State: Replica: 2306201969bb4da6abaf6a7a046475be, State: Running, Role: LEADER
I20260809 15:33:27.610388 27474 consensus_queue.cc:237] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f51d6d6285714da7bd487db9657b142d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39847 } } peers { permanent_uuid: "51040d1fb1d540febbab40a8735812c0" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38201 } } peers { permanent_uuid: "2306201969bb4da6abaf6a7a046475be" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45695 } }
I20260809 15:33:27.613469 27258 catalog_manager.cc:5495] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be reported cstate change: term changed from 0 to 1, leader changed from <none> to 2306201969bb4da6abaf6a7a046475be (127.11.146.1). New cstate: current_term: 1 leader_uuid: "2306201969bb4da6abaf6a7a046475be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f51d6d6285714da7bd487db9657b142d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51040d1fb1d540febbab40a8735812c0" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2306201969bb4da6abaf6a7a046475be" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45695 } health_report { overall_health: HEALTHY } } }
I20260809 15:33:27.685364 27801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:27.681545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33350 (local address 127.11.146.1:45695)
0809 15:33:27.681839 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:27.681848 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:27.681880 (+ 32us) server_negotiation.cc:407] Connection header received
0809 15:33:27.681973 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:27.681976 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:27.682047 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:27.682182 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:33:27.682438 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:27.682954 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:27.683802 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:27.684036 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:27.684142 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:27.684489 (+ 347us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:33:27.684925 (+ 436us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:33:27.685029 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:27.685164 (+ 135us) server_negotiation.cc:299] Negotiation successful
0809 15:33:27.685216 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":229,"thread_start_us":134,"threads_started":1}
I20260809 15:33:27.689404 27575 raft_consensus.cc:1261] T 3d6927272c9647edb21b6a599d041b78 P f51d6d6285714da7bd487db9657b142d [term 1 FOLLOWER]: Refusing update from remote peer 2306201969bb4da6abaf6a7a046475be: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:33:27.689435 27722 raft_consensus.cc:1261] T 3d6927272c9647edb21b6a599d041b78 P 51040d1fb1d540febbab40a8735812c0 [term 1 FOLLOWER]: Refusing update from remote peer 2306201969bb4da6abaf6a7a046475be: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:33:27.690122 27474 consensus_queue.cc:1035] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [LEADER]: Connected to new peer: Peer: permanent_uuid: "f51d6d6285714da7bd487db9657b142d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:33:27.690353 27798 consensus_queue.cc:1035] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [LEADER]: Connected to new peer: Peer: permanent_uuid: "51040d1fb1d540febbab40a8735812c0" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:33:27.697754 27804 mvcc.cc:205] Tried to move back new op lower bound from 7316642233089028096 to 7316642232774455296. Current Snapshot: MvccSnapshot[applied={T|T < 7316642233089028096}]
I20260809 15:33:27.705245 27259 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:37296:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:33:27.705410 27259 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:37296:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:33:27.707660 27259 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc: Sending DeleteTablet for 3 replicas of tablet 3d6927272c9647edb21b6a599d041b78
I20260809 15:33:27.708374 27700 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d6927272c9647edb21b6a599d041b78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:33:27 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:57752
I20260809 15:33:27.708524 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 27299
I20260809 15:33:27.708511 27550 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d6927272c9647edb21b6a599d041b78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:33:27 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:51256
I20260809 15:33:27.710630 27813 tablet_replica.cc:330] T 3d6927272c9647edb21b6a599d041b78 P 51040d1fb1d540febbab40a8735812c0: stopping tablet replica
I20260809 15:33:27.710911 27813 raft_consensus.cc:2229] T 3d6927272c9647edb21b6a599d041b78 P 51040d1fb1d540febbab40a8735812c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:33:27.711218 27813 raft_consensus.cc:2258] T 3d6927272c9647edb21b6a599d041b78 P 51040d1fb1d540febbab40a8735812c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:33:27.712867 27813 ts_tablet_manager.cc:1905] T 3d6927272c9647edb21b6a599d041b78 P 51040d1fb1d540febbab40a8735812c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:33:27.712931 27814 tablet_replica.cc:330] T 3d6927272c9647edb21b6a599d041b78 P f51d6d6285714da7bd487db9657b142d: stopping tablet replica
I20260809 15:33:27.713210 27814 raft_consensus.cc:2229] T 3d6927272c9647edb21b6a599d041b78 P f51d6d6285714da7bd487db9657b142d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:33:27.713486 27814 raft_consensus.cc:2258] T 3d6927272c9647edb21b6a599d041b78 P f51d6d6285714da7bd487db9657b142d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:33:27.714956 27814 ts_tablet_manager.cc:1905] T 3d6927272c9647edb21b6a599d041b78 P f51d6d6285714da7bd487db9657b142d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:33:27.715281 27813 ts_tablet_manager.cc:1918] T 3d6927272c9647edb21b6a599d041b78 P 51040d1fb1d540febbab40a8735812c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:33:27.715392 27813 log.cc:1196] T 3d6927272c9647edb21b6a599d041b78 P 51040d1fb1d540febbab40a8735812c0: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/wal/wals/3d6927272c9647edb21b6a599d041b78
I20260809 15:33:27.715687 27813 ts_tablet_manager.cc:1939] T 3d6927272c9647edb21b6a599d041b78 P 51040d1fb1d540febbab40a8735812c0: Deleting consensus metadata
I20260809 15:33:27.716804 27242 catalog_manager.cc:4841] TS 51040d1fb1d540febbab40a8735812c0 (127.11.146.3:38201): tablet 3d6927272c9647edb21b6a599d041b78 (table test-table [id=f1288ae1841a481bb7fb536e68db4b95]) successfully deleted
I20260809 15:33:27.718298 27814 ts_tablet_manager.cc:1918] T 3d6927272c9647edb21b6a599d041b78 P f51d6d6285714da7bd487db9657b142d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:33:27.718398 27814 log.cc:1196] T 3d6927272c9647edb21b6a599d041b78 P f51d6d6285714da7bd487db9657b142d: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/wal/wals/3d6927272c9647edb21b6a599d041b78
I20260809 15:33:27.718719 27814 ts_tablet_manager.cc:1939] T 3d6927272c9647edb21b6a599d041b78 P f51d6d6285714da7bd487db9657b142d: Deleting consensus metadata
I20260809 15:33:27.720016 27243 catalog_manager.cc:4841] TS f51d6d6285714da7bd487db9657b142d (127.11.146.2:39847): tablet 3d6927272c9647edb21b6a599d041b78 (table test-table [id=f1288ae1841a481bb7fb536e68db4b95]) successfully deleted
W20260809 15:33:27.720724 27243 connection.cc:535] client connection to 127.11.146.1:45695 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 15:33:27.720865 27243 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 15:33:27.721621 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 27471
I20260809 15:33:27.721752 27784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:27.721463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:45695 (local address 127.0.0.1:33358)
0809 15:33:27.721590 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:27.721646 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.1:45695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 15:33:27.722519 27243 catalog_manager.cc:4584] TS 2306201969bb4da6abaf6a7a046475be (127.11.146.1:45695): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3d6927272c9647edb21b6a599d041b78: Network error: Client connection negotiation failed: client connection to 127.11.146.1:45695: connect: Connection refused (error 111)
I20260809 15:33:27.728807 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 27628
I20260809 15:33:27.735819 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 27222
I20260809 15:33:27.743585 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:41013
--webserver_interface=127.11.146.62
--webserver_port=45047
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:40683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:41013
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:33:27.851857 27816 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:33:27.852103 27816 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:33:27.852141 27816 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:33:27.855913 27816 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:33:27.855958 27816 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:33:27.855976 27816 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:33:27.855993 27816 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:33:27.856006 27816 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:33:27.861070 27816 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:40683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:41013
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:41013
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=45047
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27816
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:33:27.861966 27816 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:33:27.862884 27816 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:33:27.871104 27821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:27.871169 27822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:27.871099 27825 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:27.871387 27816 server_base.cc:1034] running on GCE node
I20260809 15:33:27.872044 27816 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:33:27.873044 27816 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:33:27.874230 27816 hybrid_clock.cc:648] HybridClock initialized: now 1786289607874211 us; error 35 us; skew 500 ppm
Aug 09 15:33:27 dist-test-slave-1jjb krb5kdc[26605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289607, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:33:27.876940 27816 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:33:27.877701 27816 webserver.cc:460] Webserver started at http://127.11.146.62:45047/ using document root <none> and password file <none>
I20260809 15:33:27.878207 27816 fs_manager.cc:359] Metadata directory not provided
I20260809 15:33:27.878296 27816 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:33:27.881815 27816 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:33:27.883812 27833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:27.884989 27816 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:33:27.885121 27816 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "c17b650e16f34cf093b93c1526b073cc"
format_stamp: "Formatted at 2026-08-09 15:33:25 on dist-test-slave-1jjb"
server_key: "aed64d6c44c0201a011d8acecb39ebfd"
server_key_iv: "024077951ee8c8af06c89324e53c166f"
server_key_version: "encryptionkey@0"
I20260809 15:33:27.885635 27816 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:33:27.904732 27816 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:33:27.907405 27816 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:33:27.907588 27816 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:33:27.914389 27816 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:41013
I20260809 15:33:27.914508 27895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:41013 every 8 connection(s)
I20260809 15:33:27.915396 27816 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:33:27.919822 27896 sys_catalog.cc:263] Verifying existing consensus state
I20260809 15:33:27.920025 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 27816
I20260809 15:33:27.920466 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.1:45695
--local_ip_for_outbound_sockets=127.11.146.1
--tserver_master_addrs=127.11.146.62:41013
--webserver_port=35317
--webserver_interface=127.11.146.1
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:40683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:33:27.921614 27896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc: Bootstrap starting.
I20260809 15:33:27.945079 27896 log.cc:824] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc: Log is configured to *not* fsync() on all Append() calls
I20260809 15:33:27.958871 27896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 15:33:27.959262 27896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc: Bootstrap complete.
I20260809 15:33:27.964996 27896 raft_consensus.cc:348] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c17b650e16f34cf093b93c1526b073cc" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 41013 } }
I20260809 15:33:27.965493 27896 raft_consensus.cc:729] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: c17b650e16f34cf093b93c1526b073cc, State: Initialized, Role: FOLLOWER
I20260809 15:33:27.966027 27896 consensus_queue.cc:260] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c17b650e16f34cf093b93c1526b073cc" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 41013 } }
I20260809 15:33:27.966164 27896 raft_consensus.cc:388] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:33:27.966229 27896 raft_consensus.cc:482] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:33:27.966320 27896 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [term 2 FOLLOWER]: Advancing to term 3
I20260809 15:33:27.968602 27896 raft_consensus.cc:504] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c17b650e16f34cf093b93c1526b073cc" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 41013 } }
I20260809 15:33:27.968940 27896 leader_election.cc:302] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c17b650e16f34cf093b93c1526b073cc; no voters:
I20260809 15:33:27.969326 27896 leader_election.cc:288] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 15:33:27.969512 27902 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [term 3 FOLLOWER]: Leader election won for term 3
I20260809 15:33:27.969777 27902 raft_consensus.cc:686] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [term 3 LEADER]: Becoming Leader. State: Replica: c17b650e16f34cf093b93c1526b073cc, State: Running, Role: LEADER
I20260809 15:33:27.970111 27902 consensus_queue.cc:237] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c17b650e16f34cf093b93c1526b073cc" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 41013 } }
I20260809 15:33:27.970551 27896 sys_catalog.cc:564] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:33:27.971645 27904 sys_catalog.cc:455] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader c17b650e16f34cf093b93c1526b073cc. Latest consensus state: current_term: 3 leader_uuid: "c17b650e16f34cf093b93c1526b073cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c17b650e16f34cf093b93c1526b073cc" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 41013 } } }
I20260809 15:33:27.971805 27904 sys_catalog.cc:458] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [sys.catalog]: This master's current role is: LEADER
I20260809 15:33:27.971657 27903 sys_catalog.cc:455] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "c17b650e16f34cf093b93c1526b073cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c17b650e16f34cf093b93c1526b073cc" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 41013 } } }
I20260809 15:33:27.972180 27903 sys_catalog.cc:458] T 00000000000000000000000000000000 P c17b650e16f34cf093b93c1526b073cc [sys.catalog]: This master's current role is: LEADER
I20260809 15:33:27.972219 27911 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:33:27.977123 27911 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:33:27.977810 27911 catalog_manager.cc:1259] Loaded cluster ID: 5abb418d22644b5baf03fec5007c2017
I20260809 15:33:27.977873 27911 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260809 15:33:27.978850 27911 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fbeed0589ad google::LogMessage::Fail() at ??:0
@ 0x7fbeed05b88a google::LogMessage::SendToLog() at ??:0
@ 0x7fbeed0584de google::LogMessage::Flush() at ??:0
@ 0x7fbeed059a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fbef799bfdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7fbef799cd2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fbef7999579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7fbef79dd640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fbeef2aa3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fbeef2aac83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7fbeef2ac3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fbeef29b512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fbef08df6db start_thread at ??:0
@ 0x7fbeebb5661f clone at ??:0
W20260809 15:33:28.074419 27898 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:33:28.074635 27898 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:33:28.074679 27898 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:33:28.078557 27898 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:33:28.078606 27898 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:33:28.078685 27898 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.1
I20260809 15:33:28.083575 27898 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:40683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.1:45695
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.146.1
--webserver_port=35317
--tserver_master_addrs=127.11.146.62:41013
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27898
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.1
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:33:28.084581 27898 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:33:28.085523 27898 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:33:28.096323 27947 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:28.096449 27944 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:28.096311 27945 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:28.096710 27898 server_base.cc:1034] running on GCE node
I20260809 15:33:28.097270 27898 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:33:28.097862 27898 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:33:28.099076 27898 hybrid_clock.cc:648] HybridClock initialized: now 1786289608099046 us; error 45 us; skew 500 ppm
Aug 09 15:33:28 dist-test-slave-1jjb krb5kdc[26605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289608, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:33:28.102003 27898 init.cc:377] Logged in from keytab as kudu/127.11.146.1@KRBTEST.COM (short username kudu)
I20260809 15:33:28.102890 27898 webserver.cc:460] Webserver started at http://127.11.146.1:35317/ using document root <none> and password file <none>
I20260809 15:33:28.103456 27898 fs_manager.cc:359] Metadata directory not provided
I20260809 15:33:28.103547 27898 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:33:28.107515 27898 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:33:28.109839 27954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:28.111069 27898 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:33:28.111212 27898 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/wal
uuid: "2306201969bb4da6abaf6a7a046475be"
format_stamp: "Formatted at 2026-08-09 15:33:25 on dist-test-slave-1jjb"
server_key: "db872b1f06bd243498a8380e58cba766"
server_key_iv: "8cecbc7a330feba0bff36ff21c31cea6"
server_key_version: "encryptionkey@0"
I20260809 15:33:28.111769 27898 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:33:28.134352 27898 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:33:28.137545 27898 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:33:28.137733 27898 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:33:28.138278 27898 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:33:28.139425 27962 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 15:33:28.146701 27898 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 15:33:28.146790 27898 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.008s user 0.000s sys 0.000s
I20260809 15:33:28.146872 27898 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 15:33:28.148545 27898 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 15:33:28.148608 27898 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.002s sys 0.000s
I20260809 15:33:28.148906 27962 tablet_bootstrap.cc:492] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be: Bootstrap starting.
I20260809 15:33:28.158882 27898 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.1:45695
I20260809 15:33:28.159122 28085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.1:45695 every 8 connection(s)
I20260809 15:33:28.159914 27898 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
I20260809 15:33:28.169302 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 27898
I20260809 15:33:28.169736 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.2:39847
--local_ip_for_outbound_sockets=127.11.146.2
--tserver_master_addrs=127.11.146.62:41013
--webserver_port=38705
--webserver_interface=127.11.146.2
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:40683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:33:28.170851 27962 log.cc:824] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be: Log is configured to *not* fsync() on all Append() calls
I20260809 15:33:28.179865 27962 tablet_bootstrap.cc:492] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 15:33:28.180313 27962 tablet_bootstrap.cc:492] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be: Bootstrap complete.
I20260809 15:33:28.181710 27962 ts_tablet_manager.cc:1397] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be: Time spent bootstrapping tablet: real 0.033s user 0.012s sys 0.019s
I20260809 15:33:28.184927 27962 raft_consensus.cc:348] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f51d6d6285714da7bd487db9657b142d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39847 } } peers { permanent_uuid: "51040d1fb1d540febbab40a8735812c0" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38201 } } peers { permanent_uuid: "2306201969bb4da6abaf6a7a046475be" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45695 } }
I20260809 15:33:28.185509 27962 raft_consensus.cc:729] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2306201969bb4da6abaf6a7a046475be, State: Initialized, Role: FOLLOWER
I20260809 15:33:28.186058 27962 consensus_queue.cc:260] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f51d6d6285714da7bd487db9657b142d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39847 } } peers { permanent_uuid: "51040d1fb1d540febbab40a8735812c0" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38201 } } peers { permanent_uuid: "2306201969bb4da6abaf6a7a046475be" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45695 } }
I20260809 15:33:28.187117 27962 ts_tablet_manager.cc:1428] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be: Time spent starting tablet: real 0.005s user 0.005s sys 0.001s
W20260809 15:33:28.205693 28089 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:33:28.161818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.1:55779)
0809 15:33:28.162301 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:28.162353 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:28.163157 (+ 804us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:28.204787 (+ 41630us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":140,"threads_started":1}
W20260809 15:33:28.206339 28086 heartbeater.cc:644] Failed to heartbeat to 127.11.146.62:41013 (0 consecutive failures): Network error: Failed to ping master at 127.11.146.62:41013: Client connection negotiation failed: client connection to 127.11.146.62:41013: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 15:33:28.207095 28089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:28.206809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.1:55995)
0809 15:33:28.206962 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:28.207033 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260809 15:33:28.207763 28089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:28.207547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.1:51161)
0809 15:33:28.207657 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:28.207705 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 15:33:28.207958 28086 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 15:33:28.287177 28091 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:33:28.287396 28091 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:33:28.287500 28091 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:33:28.292514 28091 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:33:28.292577 28091 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:33:28.292677 28091 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.2
I20260809 15:33:28.297951 28091 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:40683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.2:39847
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.146.2
--webserver_port=38705
--tserver_master_addrs=127.11.146.62:41013
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28091
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.2
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:33:28.298885 28091 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:33:28.299829 28091 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:33:28.309028 28101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:28.309019 28097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:28.309120 28098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:28.309304 28091 server_base.cc:1034] running on GCE node
I20260809 15:33:28.309773 28091 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:33:28.310428 28091 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:33:28.311609 28091 hybrid_clock.cc:648] HybridClock initialized: now 1786289608311576 us; error 45 us; skew 500 ppm
Aug 09 15:33:28 dist-test-slave-1jjb krb5kdc[26605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289608, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:33:28.314451 28091 init.cc:377] Logged in from keytab as kudu/127.11.146.2@KRBTEST.COM (short username kudu)
I20260809 15:33:28.315266 28091 webserver.cc:460] Webserver started at http://127.11.146.2:38705/ using document root <none> and password file <none>
I20260809 15:33:28.315790 28091 fs_manager.cc:359] Metadata directory not provided
I20260809 15:33:28.315850 28091 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:33:28.319355 28091 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260809 15:33:28.321331 28109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:28.322543 28091 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:33:28.322680 28091 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/wal
uuid: "f51d6d6285714da7bd487db9657b142d"
format_stamp: "Formatted at 2026-08-09 15:33:25 on dist-test-slave-1jjb"
server_key: "495efb9f9c99b2bd348fffac2c9900e0"
server_key_iv: "a777a44484bf966d104d67365033346b"
server_key_version: "encryptionkey@0"
I20260809 15:33:28.323189 28091 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:33:28.354080 28091 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:33:28.357254 28091 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:33:28.357460 28091 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:33:28.358040 28091 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:33:28.358827 28091 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:33:28.358896 28091 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:28.358986 28091 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:33:28.359035 28091 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:28.368278 28091 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.2:39847
I20260809 15:33:28.368309 28237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.2:39847 every 8 connection(s)
I20260809 15:33:28.369266 28091 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
I20260809 15:33:28.371634 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 28091
I20260809 15:33:28.372035 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.3:38201
--local_ip_for_outbound_sockets=127.11.146.3
--tserver_master_addrs=127.11.146.62:41013
--webserver_port=38839
--webserver_interface=127.11.146.3
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:40683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:33:28.373167 28240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:28.371257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.2:59219)
0809 15:33:28.371710 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:28.371839 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":134,"threads_started":1}
W20260809 15:33:28.373615 28238 heartbeater.cc:644] Failed to heartbeat to 127.11.146.62:41013 (0 consecutive failures): Network error: Failed to ping master at 127.11.146.62:41013: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
I20260809 15:33:28.374293 28240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:28.374015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.2:36559)
0809 15:33:28.374150 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:28.374214 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260809 15:33:28.374951 28240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:28.374710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.2:47345)
0809 15:33:28.374831 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:28.374887 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 15:33:28.375141 28238 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 15:33:28.499887 28241 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:33:28.500164 28241 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:33:28.500241 28241 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:33:28.504285 28241 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:33:28.504360 28241 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:33:28.504446 28241 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.3
I20260809 15:33:28.509403 28241 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:40683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.3:38201
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.146.3
--webserver_port=38839
--tserver_master_addrs=127.11.146.62:41013
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28241
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.3
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:33:28.510367 28241 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:33:28.511353 28241 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:33:28.520638 28251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:28.520679 28248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:28.520684 28249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:28.520983 28241 server_base.cc:1034] running on GCE node
I20260809 15:33:28.521447 28241 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:33:28.522060 28241 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:33:28.523258 28241 hybrid_clock.cc:648] HybridClock initialized: now 1786289608523240 us; error 28 us; skew 500 ppm
Aug 09 15:33:28 dist-test-slave-1jjb krb5kdc[26605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289608, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:33:28.526043 28241 init.cc:377] Logged in from keytab as kudu/127.11.146.3@KRBTEST.COM (short username kudu)
I20260809 15:33:28.526945 28241 webserver.cc:460] Webserver started at http://127.11.146.3:38839/ using document root <none> and password file <none>
I20260809 15:33:28.527483 28241 fs_manager.cc:359] Metadata directory not provided
I20260809 15:33:28.527577 28241 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:33:28.531289 28241 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260809 15:33:28.533319 28260 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:28.534451 28241 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:33:28.534591 28241 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/wal
uuid: "51040d1fb1d540febbab40a8735812c0"
format_stamp: "Formatted at 2026-08-09 15:33:25 on dist-test-slave-1jjb"
server_key: "72814d9d36c2c26db0793e7683c81dcf"
server_key_iv: "99eb95fa554b15c4609a904883a8e217"
server_key_version: "encryptionkey@0"
I20260809 15:33:28.535096 28241 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:33:28.556283 28241 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:33:28.558916 28241 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:33:28.559110 28241 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:33:28.559651 28241 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:33:28.560508 28241 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:33:28.560578 28241 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:28.560652 28241 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:33:28.560694 28241 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:28.569387 28241 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.3:38201
I20260809 15:33:28.569429 28386 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.3:38201 every 8 connection(s)
I20260809 15:33:28.570353 28241 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
I20260809 15:33:28.574117 28389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:28.572480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.3:49233)
0809 15:33:28.572907 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:28.573022 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":126,"threads_started":1}
W20260809 15:33:28.574612 28387 heartbeater.cc:644] Failed to heartbeat to 127.11.146.62:41013 (0 consecutive failures): Network error: Failed to ping master at 127.11.146.62:41013: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
I20260809 15:33:28.575191 28389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:28.574998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.3:59049)
0809 15:33:28.575097 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:28.575140 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 15:33:28.575790 28389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:28.575620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.3:34503)
0809 15:33:28.575707 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:28.575745 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260809 15:33:28.575959 28387 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 15:33:28.580356 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 28241
I20260809 15:33:29.208927 28391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:29.208541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.1:49913)
0809 15:33:29.208769 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:29.208820 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":65,"threads_started":1}
I20260809 15:33:29.376227 28392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:29.375731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.2:44529)
0809 15:33:29.375981 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:29.376030 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":63,"threads_started":1}
I20260809 15:33:29.576881 28393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:29.576500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.3:56659)
0809 15:33:29.576731 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:29.576790 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":85,"threads_started":1}
I20260809 15:33:29.948258 28396 raft_consensus.cc:482] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:33:29.948459 28396 raft_consensus.cc:504] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f51d6d6285714da7bd487db9657b142d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39847 } } peers { permanent_uuid: "51040d1fb1d540febbab40a8735812c0" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38201 } } peers { permanent_uuid: "2306201969bb4da6abaf6a7a046475be" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45695 } }
I20260809 15:33:29.949772 28396 leader_election.cc:288] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f51d6d6285714da7bd487db9657b142d (127.11.146.2:39847), 51040d1fb1d540febbab40a8735812c0 (127.11.146.3:38201)
Aug 09 15:33:29 dist-test-slave-1jjb krb5kdc[26605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289608, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for kudu/127.11.146.3@KRBTEST.COM
Aug 09 15:33:29 dist-test-slave-1jjb krb5kdc[26605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289608, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for kudu/127.11.146.2@KRBTEST.COM
I20260809 15:33:29.963951 28397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:29.949941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:39847 (local address 127.11.146.1:58175)
0809 15:33:29.950201 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:29.950216 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:29.950328 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:29.952014 (+ 1686us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:29.952021 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:29.952640 (+ 619us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:33:29.953106 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:29.953120 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:29.954497 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:29.954503 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:29.955398 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:29.955409 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:29.956141 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:29.956145 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:29.956386 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:29.957115 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:33:29.957133 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:33:29.959163 (+ 2030us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:33:29.961668 (+ 2505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:29.961672 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:29.961674 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:29.961968 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:29.962308 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:29.962311 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:29.962313 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:29.962419 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:29.963029 (+ 610us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:33:29.963032 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:33:29.963177 (+ 145us) client_negotiation.cc:769] Sending connection context
0809 15:33:29.963385 (+ 208us) client_negotiation.cc:240] Negotiation successful
0809 15:33:29.963699 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":177,"spinlock_wait_cycles":14592,"thread_start_us":77,"threads_started":1}
I20260809 15:33:29.963975 28399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:29.950244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:58175 (local address 127.11.146.2:39847)
0809 15:33:29.950602 (+ 358us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:29.950615 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:29.950651 (+ 36us) server_negotiation.cc:407] Connection header received
0809 15:33:29.951335 (+ 684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:29.951341 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:29.951660 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:29.951932 (+ 272us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:29.953290 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:29.954340 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:29.955550 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:29.955991 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:29.956174 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:29.959345 (+ 3171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:29.959349 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:29.959359 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:29.959385 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:29.961521 (+ 2136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:29.962079 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:29.962085 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:29.962090 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:29.962207 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:29.962525 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:29.962527 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:29.962529 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:29.962916 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:29.963047 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:29.963524 (+ 477us) server_negotiation.cc:299] Negotiation successful
0809 15:33:29.963785 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":238,"thread_start_us":95,"threads_started":1}
I20260809 15:33:29.963979 28400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:29.950257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:53671 (local address 127.11.146.3:38201)
0809 15:33:29.950675 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:29.950696 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:29.950731 (+ 35us) server_negotiation.cc:407] Connection header received
0809 15:33:29.951422 (+ 691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:29.951429 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:29.951706 (+ 277us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:29.952013 (+ 307us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:29.953304 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:29.954349 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:29.955527 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:29.955996 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:29.956212 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:29.959074 (+ 2862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:29.959080 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:29.959091 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:29.959119 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:29.961077 (+ 1958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:29.961680 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:29.961687 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:29.961693 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:29.961874 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:29.962295 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:29.962299 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:29.962301 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:29.962763 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:29.962908 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:29.963497 (+ 589us) server_negotiation.cc:299] Negotiation successful
0809 15:33:29.963775 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":95,"threads_started":1}
I20260809 15:33:29.963989 28398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:29.950010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:38201 (local address 127.11.146.1:53671)
0809 15:33:29.950316 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:29.950363 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:29.950453 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:29.952016 (+ 1563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:29.952021 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:29.952637 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:33:29.953105 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:29.953119 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:29.954502 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:29.954505 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:29.955395 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:29.955404 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:29.956169 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:29.956173 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:29.956378 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:29.957164 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:33:29.957177 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:33:29.958818 (+ 1641us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:33:29.961208 (+ 2390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:29.961217 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:29.961232 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:29.961562 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:29.961987 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:29.961989 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:29.961990 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:29.962173 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:29.962918 (+ 745us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:33:29.962925 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:33:29.963178 (+ 253us) client_negotiation.cc:769] Sending connection context
0809 15:33:29.963330 (+ 152us) client_negotiation.cc:240] Negotiation successful
0809 15:33:29.963787 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"mutex_wait_us":297,"spinlock_wait_cycles":13440,"thread_start_us":97,"threads_started":1}
W20260809 15:33:29.966662 27955 leader_election.cc:341] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 51040d1fb1d540febbab40a8735812c0 (127.11.146.3:38201): Not found: Tablet not found: 3d6927272c9647edb21b6a599d041b78
W20260809 15:33:29.966820 27956 leader_election.cc:341] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f51d6d6285714da7bd487db9657b142d (127.11.146.2:39847): Not found: Tablet not found: 3d6927272c9647edb21b6a599d041b78
I20260809 15:33:29.966915 27955 leader_election.cc:302] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2306201969bb4da6abaf6a7a046475be; no voters: 51040d1fb1d540febbab40a8735812c0, f51d6d6285714da7bd487db9657b142d
I20260809 15:33:29.967218 28396 raft_consensus.cc:2726] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 15:33:30.209960 28398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:30.209654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.1:55523)
0809 15:33:30.209786 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:30.209872 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260809 15:33:30.377269 28401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:30.376914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.2:52155)
0809 15:33:30.377131 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:30.377178 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":65,"threads_started":1}
I20260809 15:33:30.577838 28402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:30.577485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.3:38585)
0809 15:33:30.577707 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:30.577758 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":67,"threads_started":1}
I20260809 15:33:31.211141 28403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:31.210732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.1:36477)
0809 15:33:31.210991 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:31.211041 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":70,"threads_started":1}
I20260809 15:33:31.378391 28404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:31.377982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.2:39965)
0809 15:33:31.378223 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:31.378277 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":72,"threads_started":1}
I20260809 15:33:31.578922 28405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:31.578536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.3:57817)
0809 15:33:31.578788 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:31.578838 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":73,"threads_started":1}
I20260809 15:33:31.585537 28406 raft_consensus.cc:482] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:33:31.585646 28406 raft_consensus.cc:504] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f51d6d6285714da7bd487db9657b142d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39847 } } peers { permanent_uuid: "51040d1fb1d540febbab40a8735812c0" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38201 } } peers { permanent_uuid: "2306201969bb4da6abaf6a7a046475be" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45695 } }
I20260809 15:33:31.586012 28406 leader_election.cc:288] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f51d6d6285714da7bd487db9657b142d (127.11.146.2:39847), 51040d1fb1d540febbab40a8735812c0 (127.11.146.3:38201)
W20260809 15:33:31.586776 27955 leader_election.cc:341] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 51040d1fb1d540febbab40a8735812c0 (127.11.146.3:38201): Not found: Tablet not found: 3d6927272c9647edb21b6a599d041b78
W20260809 15:33:31.586884 27956 leader_election.cc:341] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f51d6d6285714da7bd487db9657b142d (127.11.146.2:39847): Not found: Tablet not found: 3d6927272c9647edb21b6a599d041b78
I20260809 15:33:31.587011 27956 leader_election.cc:302] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2306201969bb4da6abaf6a7a046475be; no voters: 51040d1fb1d540febbab40a8735812c0, f51d6d6285714da7bd487db9657b142d
I20260809 15:33:31.587147 28406 raft_consensus.cc:2726] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 15:33:32.212359 28407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:32.211890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.1:42865)
0809 15:33:32.212201 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:32.212268 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":89,"threads_started":1}
I20260809 15:33:32.379485 28408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:32.379125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.2:46703)
0809 15:33:32.379349 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:32.379405 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":70,"threads_started":1}
I20260809 15:33:32.580152 28409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:32.579640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.3:54249)
0809 15:33:32.579940 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:32.580007 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":107,"threads_started":1}
I20260809 15:33:33.213692 28410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:33.213230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.1:50041)
0809 15:33:33.213542 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:33.213595 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":72,"threads_started":1}
I20260809 15:33:33.357424 28411 raft_consensus.cc:482] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:33:33.357553 28411 raft_consensus.cc:504] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f51d6d6285714da7bd487db9657b142d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39847 } } peers { permanent_uuid: "51040d1fb1d540febbab40a8735812c0" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38201 } } peers { permanent_uuid: "2306201969bb4da6abaf6a7a046475be" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45695 } }
I20260809 15:33:33.358002 28411 leader_election.cc:288] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f51d6d6285714da7bd487db9657b142d (127.11.146.2:39847), 51040d1fb1d540febbab40a8735812c0 (127.11.146.3:38201)
W20260809 15:33:33.358800 27955 leader_election.cc:341] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 51040d1fb1d540febbab40a8735812c0 (127.11.146.3:38201): Not found: Tablet not found: 3d6927272c9647edb21b6a599d041b78
W20260809 15:33:33.358886 27956 leader_election.cc:341] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f51d6d6285714da7bd487db9657b142d (127.11.146.2:39847): Not found: Tablet not found: 3d6927272c9647edb21b6a599d041b78
I20260809 15:33:33.358944 27956 leader_election.cc:302] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2306201969bb4da6abaf6a7a046475be; no voters: 51040d1fb1d540febbab40a8735812c0, f51d6d6285714da7bd487db9657b142d
I20260809 15:33:33.359141 28411 raft_consensus.cc:2726] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 15:33:33.380705 28412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:33.380296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.2:42867)
0809 15:33:33.380579 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:33.380629 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":119,"threads_started":1}
I20260809 15:33:33.581233 28413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:33.580871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.3:40061)
0809 15:33:33.581101 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:33.581151 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":71,"threads_started":1}
I20260809 15:33:34.214910 28414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:34.214468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.1:33885)
0809 15:33:34.214763 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:34.214815 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":87,"threads_started":1}
I20260809 15:33:34.381721 28416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:34.381332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.2:35487)
0809 15:33:34.381586 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:34.381637 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":91,"threads_started":1}
I20260809 15:33:34.582314 28417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:34.581938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.3:43479)
0809 15:33:34.582176 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:34.582227 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":79,"threads_started":1}
I20260809 15:33:35.060875 28418 raft_consensus.cc:482] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:33:35.061020 28418 raft_consensus.cc:504] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f51d6d6285714da7bd487db9657b142d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39847 } } peers { permanent_uuid: "51040d1fb1d540febbab40a8735812c0" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38201 } } peers { permanent_uuid: "2306201969bb4da6abaf6a7a046475be" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45695 } }
I20260809 15:33:35.061478 28418 leader_election.cc:288] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f51d6d6285714da7bd487db9657b142d (127.11.146.2:39847), 51040d1fb1d540febbab40a8735812c0 (127.11.146.3:38201)
W20260809 15:33:35.062299 27956 leader_election.cc:341] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f51d6d6285714da7bd487db9657b142d (127.11.146.2:39847): Not found: Tablet not found: 3d6927272c9647edb21b6a599d041b78
W20260809 15:33:35.062465 27955 leader_election.cc:341] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 51040d1fb1d540febbab40a8735812c0 (127.11.146.3:38201): Not found: Tablet not found: 3d6927272c9647edb21b6a599d041b78
I20260809 15:33:35.062644 27955 leader_election.cc:302] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2306201969bb4da6abaf6a7a046475be; no voters: 51040d1fb1d540febbab40a8735812c0, f51d6d6285714da7bd487db9657b142d
I20260809 15:33:35.062819 28418 raft_consensus.cc:2726] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 15:33:35.216195 28420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:35.215725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.1:45005)
0809 15:33:35.215978 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:35.216032 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":71,"threads_started":1}
I20260809 15:33:35.382838 28421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:35.382433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.2:49539)
0809 15:33:35.382714 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:35.382762 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":71,"threads_started":1}
I20260809 15:33:35.583449 28423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:35.582962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.3:48825)
0809 15:33:35.583309 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:35.583365 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":97,"threads_started":1}
I20260809 15:33:36.217330 28424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:36.216924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.1:43135)
0809 15:33:36.217168 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:36.217224 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":71,"threads_started":1}
I20260809 15:33:36.384053 28425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:36.383574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.2:42957)
0809 15:33:36.383879 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:36.383966 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":121,"threads_started":1}
I20260809 15:33:36.584613 28426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:36.584232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.3:46145)
0809 15:33:36.584484 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:36.584533 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":77,"threads_started":1}
I20260809 15:33:37.218441 28427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:37.218033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.1:37711)
0809 15:33:37.218293 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:37.218343 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":105,"threads_started":1}
I20260809 15:33:37.385166 28428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:37.384729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.2:50089)
0809 15:33:37.385011 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:37.385072 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":97,"threads_started":1}
I20260809 15:33:37.395483 28430 raft_consensus.cc:482] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:33:37.395620 28430 raft_consensus.cc:504] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f51d6d6285714da7bd487db9657b142d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39847 } } peers { permanent_uuid: "51040d1fb1d540febbab40a8735812c0" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38201 } } peers { permanent_uuid: "2306201969bb4da6abaf6a7a046475be" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45695 } }
I20260809 15:33:37.396054 28430 leader_election.cc:288] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f51d6d6285714da7bd487db9657b142d (127.11.146.2:39847), 51040d1fb1d540febbab40a8735812c0 (127.11.146.3:38201)
W20260809 15:33:37.396792 27956 leader_election.cc:341] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f51d6d6285714da7bd487db9657b142d (127.11.146.2:39847): Not found: Tablet not found: 3d6927272c9647edb21b6a599d041b78
W20260809 15:33:37.396970 27955 leader_election.cc:341] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 51040d1fb1d540febbab40a8735812c0 (127.11.146.3:38201): Not found: Tablet not found: 3d6927272c9647edb21b6a599d041b78
I20260809 15:33:37.397065 27955 leader_election.cc:302] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2306201969bb4da6abaf6a7a046475be; no voters: 51040d1fb1d540febbab40a8735812c0, f51d6d6285714da7bd487db9657b142d
I20260809 15:33:37.397207 28430 raft_consensus.cc:2726] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 15:33:37.585675 28431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:37.585311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.3:49379)
0809 15:33:37.585546 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:37.585597 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":77,"threads_started":1}
I20260809 15:33:38.219648 28433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:38.219249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.1:57169)
0809 15:33:38.219501 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:38.219554 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":100,"threads_started":1}
I20260809 15:33:38.386222 28434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:38.385813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.2:56875)
0809 15:33:38.386085 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:38.386139 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":68,"threads_started":1}
I20260809 15:33:38.586853 28435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:38.586439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.3:46301)
0809 15:33:38.586681 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:38.586737 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":73,"threads_started":1}
I20260809 15:33:39.215497 28436 raft_consensus.cc:482] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:33:39.215646 28436 raft_consensus.cc:504] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f51d6d6285714da7bd487db9657b142d" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 39847 } } peers { permanent_uuid: "51040d1fb1d540febbab40a8735812c0" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38201 } } peers { permanent_uuid: "2306201969bb4da6abaf6a7a046475be" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45695 } }
I20260809 15:33:39.216096 28436 leader_election.cc:288] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f51d6d6285714da7bd487db9657b142d (127.11.146.2:39847), 51040d1fb1d540febbab40a8735812c0 (127.11.146.3:38201)
W20260809 15:33:39.216861 27955 leader_election.cc:341] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 51040d1fb1d540febbab40a8735812c0 (127.11.146.3:38201): Not found: Tablet not found: 3d6927272c9647edb21b6a599d041b78
W20260809 15:33:39.216964 27956 leader_election.cc:341] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f51d6d6285714da7bd487db9657b142d (127.11.146.2:39847): Not found: Tablet not found: 3d6927272c9647edb21b6a599d041b78
I20260809 15:33:39.217029 27956 leader_election.cc:302] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2306201969bb4da6abaf6a7a046475be; no voters: 51040d1fb1d540febbab40a8735812c0, f51d6d6285714da7bd487db9657b142d
I20260809 15:33:39.217159 28436 raft_consensus.cc:2726] T 3d6927272c9647edb21b6a599d041b78 P 2306201969bb4da6abaf6a7a046475be [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 15:33:39.220676 28439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:39.220310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.1:59813)
0809 15:33:39.220525 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:39.220597 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":56,"threads_started":1}
I20260809 15:33:39.387280 28441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:39.386923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.2:59131)
0809 15:33:39.387151 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:39.387198 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":66,"threads_started":1}
I20260809 15:33:39.587951 28442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:39.587608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.3:59347)
0809 15:33:39.587824 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:39.587873 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":67,"threads_started":1}
I20260809 15:33:40.221745 28443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:40.221379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.1:40525)
0809 15:33:40.221603 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:40.221652 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":71,"threads_started":1}
I20260809 15:33:40.388593 28444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:40.388059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.2:40129)
0809 15:33:40.388452 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:40.388504 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":173,"threads_started":1}
I20260809 15:33:40.589195 28445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:40.588646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.3:33525)
0809 15:33:40.589004 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:40.589076 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":90,"threads_started":1}
I20260809 15:33:41.222862 28446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:41.222450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.1:42499)
0809 15:33:41.222721 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:41.222772 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":104,"threads_started":1}
I20260809 15:33:41.389710 28447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:41.389292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.2:57991)
0809 15:33:41.389572 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:41.389624 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":84,"threads_started":1}
I20260809 15:33:41.590365 28448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:41.589977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.3:40909)
0809 15:33:41.590226 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:41.590279 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":76,"threads_started":1}
I20260809 15:33:42.223989 28449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:42.223559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.1:46521)
0809 15:33:42.223828 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:42.223889 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":73,"threads_started":1}
I20260809 15:33:42.390774 28451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:42.390372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.2:60267)
0809 15:33:42.390628 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:42.390681 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":77,"threads_started":1}
I20260809 15:33:42.591447 28452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:42.591076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.3:51413)
0809 15:33:42.591310 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:42.591361 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":79,"threads_started":1}
I20260809 15:33:43.225405 28453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:43.225013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.1:49111)
0809 15:33:43.225259 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:43.225312 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":81,"threads_started":1}
I20260809 15:33:43.391983 28454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:43.391589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.2:43045)
0809 15:33:43.391828 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:43.391877 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":83,"threads_started":1}
I20260809 15:33:43.581365 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 27898
I20260809 15:33:43.592614 28455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:43.592228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:41013 (local address 127.11.146.3:45403)
0809 15:33:43.592483 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:43.592532 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:41013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":90,"threads_started":1}
I20260809 15:33:43.593797 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 28091
I20260809 15:33:43.601359 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 28241
2026-08-09T15:33:43Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19781 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:33:43 dist-test-slave-1jjb krb5kdc[28459](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:33:43 dist-test-slave-1jjb krb5kdc[28459](info): set up 2 sockets
Aug 09 15:33:43 dist-test-slave-1jjb krb5kdc[28459](info): commencing operation
krb5kdc: starting...
W20260809 15:33:44.676538 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.051s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:33:44 dist-test-slave-1jjb krb5kdc[28459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289624, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:33:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:33:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.146.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
I20260809 15:33:44.799500 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:43907
--webserver_interface=127.11.146.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:45395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:43907
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:33:44.908519 28474 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:33:44.908758 28474 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:33:44.908797 28474 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:33:44.912817 28474 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 15:33:44.912878 28474 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 15:33:44.912894 28474 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 15:33:44.912907 28474 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:33:44.912925 28474 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:33:44.912942 28474 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:33:44.912957 28474 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:33:44.912972 28474 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:33:44.917972 28474 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:45395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:43907
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:43907
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28474
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:33:44.918843 28474 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:33:44.919764 28474 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 15:33:44.928260 28474 server_base.cc:1034] running on GCE node
W20260809 15:33:44.928314 28481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:44.928356 28480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:44.928682 28484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:44.929252 28474 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:33:44.930279 28474 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:33:44.931468 28474 hybrid_clock.cc:648] HybridClock initialized: now 1786289624931453 us; error 27 us; skew 500 ppm
Aug 09 15:33:44 dist-test-slave-1jjb krb5kdc[28459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289624, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:33:44.934300 28474 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:33:44.935185 28474 webserver.cc:460] Webserver started at http://127.11.146.62:33511/ using document root <none> and password file <none>
I20260809 15:33:44.935847 28474 fs_manager.cc:359] Metadata directory not provided
I20260809 15:33:44.935940 28474 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:33:44.936229 28474 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:33:44.938282 28474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "eb738e2dbb294df1bfa4d23f04e490e5"
format_stamp: "Formatted at 2026-08-09 15:33:44 on dist-test-slave-1jjb"
server_key: "f055ffd663695050491ef8ef93cec8b4"
server_key_iv: "9ffe9bc600ba56e05bfe21b3ff0e5f7a"
server_key_version: "encryptionkey@0"
I20260809 15:33:44.938884 28474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "eb738e2dbb294df1bfa4d23f04e490e5"
format_stamp: "Formatted at 2026-08-09 15:33:44 on dist-test-slave-1jjb"
server_key: "f055ffd663695050491ef8ef93cec8b4"
server_key_iv: "9ffe9bc600ba56e05bfe21b3ff0e5f7a"
server_key_version: "encryptionkey@0"
I20260809 15:33:44.942618 28474 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.002s
I20260809 15:33:44.944948 28491 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:44.946098 28474 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:33:44.946234 28474 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "eb738e2dbb294df1bfa4d23f04e490e5"
format_stamp: "Formatted at 2026-08-09 15:33:44 on dist-test-slave-1jjb"
server_key: "f055ffd663695050491ef8ef93cec8b4"
server_key_iv: "9ffe9bc600ba56e05bfe21b3ff0e5f7a"
server_key_version: "encryptionkey@0"
I20260809 15:33:44.946338 28474 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:33:44.958171 28474 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:33:44.961301 28474 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:33:44.961503 28474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:33:44.969110 28474 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:43907
I20260809 15:33:44.969373 28546 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:43907 every 8 connection(s)
I20260809 15:33:44.970084 28474 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:33:44.972762 28547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:33:44.975698 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 28474
I20260809 15:33:44.975829 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:33:44.976186 11848 external_mini_cluster.cc:1428] Setting key da7fd5fc49437a7a6334d2c5b9e4e29e
I20260809 15:33:44.978536 28547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5: Bootstrap starting.
I20260809 15:33:44.980996 28547 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5: Neither blocks nor log segments found. Creating new log.
I20260809 15:33:44.981807 28547 log.cc:824] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5: Log is configured to *not* fsync() on all Append() calls
I20260809 15:33:44.983814 28547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5: No bootstrap required, opened a new log
Aug 09 15:33:44 dist-test-slave-1jjb krb5kdc[28459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289624, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:33:44.987378 28547 raft_consensus.cc:348] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb738e2dbb294df1bfa4d23f04e490e5" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43907 } }
I20260809 15:33:44.987613 28547 raft_consensus.cc:374] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:33:44.987694 28547 raft_consensus.cc:729] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb738e2dbb294df1bfa4d23f04e490e5, State: Initialized, Role: FOLLOWER
I20260809 15:33:44.988267 28547 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb738e2dbb294df1bfa4d23f04e490e5" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43907 } }
I20260809 15:33:44.988440 28547 raft_consensus.cc:388] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:33:44.988526 28547 raft_consensus.cc:482] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:33:44.988668 28547 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:33:44.989725 28547 raft_consensus.cc:504] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb738e2dbb294df1bfa4d23f04e490e5" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43907 } }
I20260809 15:33:44.990072 28547 leader_election.cc:302] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eb738e2dbb294df1bfa4d23f04e490e5; no voters:
I20260809 15:33:44.990374 28547 leader_election.cc:288] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:33:44.990471 28553 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:33:44.990691 28553 raft_consensus.cc:686] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [term 1 LEADER]: Becoming Leader. State: Replica: eb738e2dbb294df1bfa4d23f04e490e5, State: Running, Role: LEADER
I20260809 15:33:44.990723 28551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:44.977530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53182 (local address 127.11.146.62:43907)
0809 15:33:44.977941 (+ 411us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:44.977970 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:44.978006 (+ 36us) server_negotiation.cc:407] Connection header received
0809 15:33:44.978686 (+ 680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:44.978714 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:44.979154 (+ 440us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:44.979425 (+ 271us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:44.980381 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:44.981446 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:44.982605 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:44.983044 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:44.983162 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:44.985875 (+ 2713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:44.985880 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:44.985894 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:44.985919 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:44.987645 (+ 1726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:44.988176 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:44.988181 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:44.988185 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:44.988290 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:44.988600 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:44.988605 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:44.988607 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:44.989028 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:44.989211 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:44.989518 (+ 307us) server_negotiation.cc:299] Negotiation successful
0809 15:33:44.989807 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":137,"threads_started":1}
I20260809 15:33:44.991458 28553 consensus_queue.cc:237] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb738e2dbb294df1bfa4d23f04e490e5" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43907 } }
I20260809 15:33:44.991608 28547 sys_catalog.cc:564] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:33:44.993475 28554 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eb738e2dbb294df1bfa4d23f04e490e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb738e2dbb294df1bfa4d23f04e490e5" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43907 } } }
I20260809 15:33:44.993604 28554 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [sys.catalog]: This master's current role is: LEADER
I20260809 15:33:44.994148 28556 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb738e2dbb294df1bfa4d23f04e490e5. Latest consensus state: current_term: 1 leader_uuid: "eb738e2dbb294df1bfa4d23f04e490e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb738e2dbb294df1bfa4d23f04e490e5" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43907 } } }
I20260809 15:33:44.994253 28556 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [sys.catalog]: This master's current role is: LEADER
W20260809 15:33:44.996611 28573 catalog_manager.cc:1558] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:33:44.996675 28573 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:33:44.996752 28575 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:33:44.997457 28575 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:33:45.002799 28575 catalog_manager.cc:1347] Generated new cluster ID: 83e1f3d81f5c401cb7a610b3c5a16c84
I20260809 15:33:45.002858 28575 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:33:45.045177 28575 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:33:45.046537 28575 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:33:45.051127 28575 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5: Generated new TSK 0
I20260809 15:33:45.051859 28575 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.146.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
I20260809 15:33:45.090871 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.1:0
--local_ip_for_outbound_sockets=127.11.146.1
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:43907
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:45395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:33:45.203826 28581 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:33:45.204066 28581 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:33:45.204129 28581 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:33:45.208180 28581 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:33:45.208236 28581 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:33:45.208357 28581 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.1
I20260809 15:33:45.213624 28581 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:45395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:43907
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28581
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.1
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:33:45.214599 28581 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:33:45.215590 28581 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:33:45.225301 28591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:45.225334 28581 server_base.cc:1034] running on GCE node
W20260809 15:33:45.225243 28589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:45.225261 28588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:45.225989 28581 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:33:45.226547 28581 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:33:45.227705 28581 hybrid_clock.cc:648] HybridClock initialized: now 1786289625227689 us; error 30 us; skew 500 ppm
Aug 09 15:33:45 dist-test-slave-1jjb krb5kdc[28459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289625, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:33:45.230440 28581 init.cc:377] Logged in from keytab as kudu/127.11.146.1@KRBTEST.COM (short username kudu)
I20260809 15:33:45.231213 28581 webserver.cc:460] Webserver started at http://127.11.146.1:46589/ using document root <none> and password file <none>
I20260809 15:33:45.231762 28581 fs_manager.cc:359] Metadata directory not provided
I20260809 15:33:45.231823 28581 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:33:45.232050 28581 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:33:45.233978 28581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/data/instance:
uuid: "c25e03355bfd40b38652c085bd3a1292"
format_stamp: "Formatted at 2026-08-09 15:33:45 on dist-test-slave-1jjb"
server_key: "f389bea0d8e245b20c10ffda184b12a6"
server_key_iv: "0fe8486d48cde76175e2b3ec16a8dd46"
server_key_version: "encryptionkey@0"
I20260809 15:33:45.234509 28581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance:
uuid: "c25e03355bfd40b38652c085bd3a1292"
format_stamp: "Formatted at 2026-08-09 15:33:45 on dist-test-slave-1jjb"
server_key: "f389bea0d8e245b20c10ffda184b12a6"
server_key_iv: "0fe8486d48cde76175e2b3ec16a8dd46"
server_key_version: "encryptionkey@0"
I20260809 15:33:45.238178 28581 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 15:33:45.240386 28599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:45.241469 28581 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 15:33:45.241611 28581 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/wal
uuid: "c25e03355bfd40b38652c085bd3a1292"
format_stamp: "Formatted at 2026-08-09 15:33:45 on dist-test-slave-1jjb"
server_key: "f389bea0d8e245b20c10ffda184b12a6"
server_key_iv: "0fe8486d48cde76175e2b3ec16a8dd46"
server_key_version: "encryptionkey@0"
I20260809 15:33:45.241717 28581 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:33:45.257218 28581 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:33:45.259863 28581 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:33:45.260053 28581 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:33:45.260593 28581 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:33:45.261330 28581 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:33:45.261401 28581 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:45.261487 28581 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:33:45.261540 28581 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:45.270690 28581 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.1:44991
I20260809 15:33:45.270735 28725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.1:44991 every 8 connection(s)
I20260809 15:33:45.271512 28581 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
I20260809 15:33:45.278074 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 28581
I20260809 15:33:45.278213 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance
I20260809 15:33:45.278486 11848 external_mini_cluster.cc:1428] Setting key d9a3948af2c86f98263ad5f03261388c
Aug 09 15:33:45 dist-test-slave-1jjb krb5kdc[28459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289625, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:33:45.284744 28551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:45.273135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:57585 (local address 127.11.146.62:43907)
0809 15:33:45.273275 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:45.273280 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:45.274205 (+ 925us) server_negotiation.cc:407] Connection header received
0809 15:33:45.275024 (+ 819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:45.275028 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:45.275097 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:45.275211 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:45.276290 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.276812 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.277948 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.278231 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.278343 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:45.280887 (+ 2544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:45.280902 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:45.280904 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:45.280926 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:45.282670 (+ 1744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:45.283155 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:45.283161 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:45.283164 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:45.283266 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:45.283678 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:45.283681 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:45.283682 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:45.283844 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:45.283928 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:45.284521 (+ 593us) server_negotiation.cc:299] Negotiation successful
0809 15:33:45.284621 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 15:33:45.285876 28729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:45.273440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.1:57585)
0809 15:33:45.274053 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:45.274089 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:45.274806 (+ 717us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:45.275377 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:45.275383 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:45.275705 (+ 322us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:33:45.276140 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:45.276153 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.276968 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.276971 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:45.277809 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:45.277819 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.278375 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.278379 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:45.278572 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:45.279153 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:33:45.279175 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:33:45.280734 (+ 1559us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:33:45.282794 (+ 2060us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:45.282799 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:45.282808 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:45.283052 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:45.283362 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:45.283364 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:45.283366 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:45.283569 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:45.283951 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:33:45.283959 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:33:45.284278 (+ 319us) client_negotiation.cc:769] Sending connection context
0809 15:33:45.284479 (+ 201us) client_negotiation.cc:240] Negotiation successful
0809 15:33:45.284817 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":112,"threads_started":1}
I20260809 15:33:45.287014 28726 heartbeater.cc:347] Connected to a master server at 127.11.146.62:43907
I20260809 15:33:45.287250 28726 heartbeater.cc:464] Registering TS with master...
I20260809 15:33:45.287824 28726 heartbeater.cc:511] Master 127.11.146.62:43907 requested a full tablet report, sending...
I20260809 15:33:45.289404 28509 ts_manager.cc:194] Registered new tserver with Master: c25e03355bfd40b38652c085bd3a1292 (127.11.146.1:44991)
WARNING: no policy specified for kudu/127.11.146.2@KRBTEST.COM; defaulting to no policy
I20260809 15:33:45.290553 28509 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.1@KRBTEST.COM'} at 127.11.146.1:57585
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
I20260809 15:33:45.307139 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.2:0
--local_ip_for_outbound_sockets=127.11.146.2
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:43907
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:45395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:33:45.416169 28734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:33:45.416437 28734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:33:45.416529 28734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:33:45.420467 28734 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:33:45.420553 28734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:33:45.420644 28734 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.2
I20260809 15:33:45.425791 28734 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:45395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:43907
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28734
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.2
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:33:45.426798 28734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:33:45.427791 28734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:33:45.437320 28744 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:45.437361 28741 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:45.437383 28742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:45.437709 28734 server_base.cc:1034] running on GCE node
I20260809 15:33:45.438089 28734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:33:45.438679 28734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:33:45.439836 28734 hybrid_clock.cc:648] HybridClock initialized: now 1786289625439812 us; error 32 us; skew 500 ppm
Aug 09 15:33:45 dist-test-slave-1jjb krb5kdc[28459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289625, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:33:45.442589 28734 init.cc:377] Logged in from keytab as kudu/127.11.146.2@KRBTEST.COM (short username kudu)
I20260809 15:33:45.443415 28734 webserver.cc:460] Webserver started at http://127.11.146.2:42943/ using document root <none> and password file <none>
I20260809 15:33:45.443970 28734 fs_manager.cc:359] Metadata directory not provided
I20260809 15:33:45.444024 28734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:33:45.444289 28734 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:33:45.446365 28734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/data/instance:
uuid: "36aa1caa9f1a43808493994d31b568d9"
format_stamp: "Formatted at 2026-08-09 15:33:45 on dist-test-slave-1jjb"
server_key: "a822ef6925cb57bf7a4238a5c5232982"
server_key_iv: "25ab88274f12b4004c5e7fc021d00fd4"
server_key_version: "encryptionkey@0"
I20260809 15:33:45.446866 28734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance:
uuid: "36aa1caa9f1a43808493994d31b568d9"
format_stamp: "Formatted at 2026-08-09 15:33:45 on dist-test-slave-1jjb"
server_key: "a822ef6925cb57bf7a4238a5c5232982"
server_key_iv: "25ab88274f12b4004c5e7fc021d00fd4"
server_key_version: "encryptionkey@0"
I20260809 15:33:45.450420 28734 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 15:33:45.452831 28753 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:45.453989 28734 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:33:45.454075 28734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/wal
uuid: "36aa1caa9f1a43808493994d31b568d9"
format_stamp: "Formatted at 2026-08-09 15:33:45 on dist-test-slave-1jjb"
server_key: "a822ef6925cb57bf7a4238a5c5232982"
server_key_iv: "25ab88274f12b4004c5e7fc021d00fd4"
server_key_version: "encryptionkey@0"
I20260809 15:33:45.454151 28734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:33:45.467963 28734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:33:45.471874 28734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:33:45.472105 28734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:33:45.472842 28734 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:33:45.473934 28734 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:33:45.474004 28734 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:45.474062 28734 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:33:45.474098 28734 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:45.484212 28734 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.2:43161
I20260809 15:33:45.484227 28887 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.2:43161 every 8 connection(s)
I20260809 15:33:45.485110 28734 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
I20260809 15:33:45.493208 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 28734
I20260809 15:33:45.493300 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance
I20260809 15:33:45.493669 11848 external_mini_cluster.cc:1428] Setting key 8208c5430fe17d955068128fef0903a8
Aug 09 15:33:45 dist-test-slave-1jjb krb5kdc[28459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289625, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:33:45.499155 28551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:45.486956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:43523 (local address 127.11.146.62:43907)
0809 15:33:45.487119 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:45.487123 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:45.488141 (+ 1018us) server_negotiation.cc:407] Connection header received
0809 15:33:45.489038 (+ 897us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:45.489041 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:45.489125 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:45.489209 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:45.490515 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.491066 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.492384 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.492661 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.492820 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:45.495766 (+ 2946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:45.495769 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:45.495771 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:45.495793 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:45.497196 (+ 1403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:45.497688 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:45.497693 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:45.497697 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:45.497793 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:45.498111 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:45.498118 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:45.498122 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:45.498365 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:45.498487 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:45.498942 (+ 455us) server_negotiation.cc:299] Negotiation successful
0809 15:33:45.499044 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 15:33:45.500233 28892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:45.487339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.2:43523)
0809 15:33:45.487971 (+ 632us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:45.488010 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:45.488819 (+ 809us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:45.489366 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:45.489391 (+ 25us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:45.489725 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:33:45.490363 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:45.490383 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.491178 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.491181 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:45.492256 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:45.492266 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.492885 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.492888 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:45.493095 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:45.493751 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:33:45.493772 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:33:45.495606 (+ 1834us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:33:45.497330 (+ 1724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:45.497337 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:45.497357 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:45.497592 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:45.497883 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:45.497885 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:45.497887 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:45.498022 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:45.498477 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:33:45.498481 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:33:45.498678 (+ 197us) client_negotiation.cc:769] Sending connection context
0809 15:33:45.498875 (+ 197us) client_negotiation.cc:240] Negotiation successful
0809 15:33:45.499215 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":102,"threads_started":1}
I20260809 15:33:45.501428 28889 heartbeater.cc:347] Connected to a master server at 127.11.146.62:43907
I20260809 15:33:45.501682 28889 heartbeater.cc:464] Registering TS with master...
I20260809 15:33:45.502141 28889 heartbeater.cc:511] Master 127.11.146.62:43907 requested a full tablet report, sending...
I20260809 15:33:45.503166 28509 ts_manager.cc:194] Registered new tserver with Master: 36aa1caa9f1a43808493994d31b568d9 (127.11.146.2:43161)
I20260809 15:33:45.503746 28509 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.2@KRBTEST.COM'} at 127.11.146.2:43523
WARNING: no policy specified for kudu/127.11.146.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
I20260809 15:33:45.522868 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.3:0
--local_ip_for_outbound_sockets=127.11.146.3
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:43907
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:45395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:33:45.637452 28895 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:33:45.637717 28895 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:33:45.637796 28895 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:33:45.642083 28895 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:33:45.642172 28895 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:33:45.642267 28895 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.3
I20260809 15:33:45.647878 28895 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:45395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:43907
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28895
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.3
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:33:45.648873 28895 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:33:45.649948 28895 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:33:45.659814 28903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:45.659883 28906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:33:45.659927 28908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:33:45.660017 28895 server_base.cc:1034] running on GCE node
I20260809 15:33:45.660508 28895 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:33:45.661114 28895 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:33:45.662300 28895 hybrid_clock.cc:648] HybridClock initialized: now 1786289625662273 us; error 35 us; skew 500 ppm
Aug 09 15:33:45 dist-test-slave-1jjb krb5kdc[28459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289625, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:33:45.665361 28895 init.cc:377] Logged in from keytab as kudu/127.11.146.3@KRBTEST.COM (short username kudu)
I20260809 15:33:45.666114 28895 webserver.cc:460] Webserver started at http://127.11.146.3:41597/ using document root <none> and password file <none>
I20260809 15:33:45.666592 28895 fs_manager.cc:359] Metadata directory not provided
I20260809 15:33:45.666648 28895 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:33:45.666796 28895 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:33:45.668824 28895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/data/instance:
uuid: "46d6c3dd213444ce9ff1a741489d7df2"
format_stamp: "Formatted at 2026-08-09 15:33:45 on dist-test-slave-1jjb"
server_key: "2b1b42115cce740bde0ed3c6bcc74df7"
server_key_iv: "ea4b9f56e53ddcd2a833251dba07c4d7"
server_key_version: "encryptionkey@0"
I20260809 15:33:45.669385 28895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance:
uuid: "46d6c3dd213444ce9ff1a741489d7df2"
format_stamp: "Formatted at 2026-08-09 15:33:45 on dist-test-slave-1jjb"
server_key: "2b1b42115cce740bde0ed3c6bcc74df7"
server_key_iv: "ea4b9f56e53ddcd2a833251dba07c4d7"
server_key_version: "encryptionkey@0"
I20260809 15:33:45.673148 28895 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 15:33:45.675336 28918 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:45.676554 28895 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:33:45.676666 28895 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/wal
uuid: "46d6c3dd213444ce9ff1a741489d7df2"
format_stamp: "Formatted at 2026-08-09 15:33:45 on dist-test-slave-1jjb"
server_key: "2b1b42115cce740bde0ed3c6bcc74df7"
server_key_iv: "ea4b9f56e53ddcd2a833251dba07c4d7"
server_key_version: "encryptionkey@0"
I20260809 15:33:45.676756 28895 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:33:45.687023 28895 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:33:45.689849 28895 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:33:45.690039 28895 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:33:45.690593 28895 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:33:45.691495 28895 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:33:45.691547 28895 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:45.691615 28895 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:33:45.691656 28895 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:33:45.701053 28895 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.3:42971
I20260809 15:33:45.701079 29044 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.3:42971 every 8 connection(s)
I20260809 15:33:45.701937 28895 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
I20260809 15:33:45.709120 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 28895
I20260809 15:33:45.709266 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance
I20260809 15:33:45.709569 11848 external_mini_cluster.cc:1428] Setting key 0131683b76e45e21f424f9ec96ed67dd
Aug 09 15:33:45 dist-test-slave-1jjb krb5kdc[28459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289625, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:33:45.715173 28551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:45.703729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:57825 (local address 127.11.146.62:43907)
0809 15:33:45.703934 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:45.703940 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:45.705001 (+ 1061us) server_negotiation.cc:407] Connection header received
0809 15:33:45.705840 (+ 839us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:45.705843 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:45.705896 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:45.705976 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:45.707055 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.707664 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.708812 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.709172 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.709316 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:45.711804 (+ 2488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:45.711811 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:45.711816 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:45.711868 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:45.713350 (+ 1482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:45.713845 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:45.713849 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:45.713850 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:45.713947 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:45.714248 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:45.714250 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:45.714252 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:45.714439 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:45.714523 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:45.714954 (+ 431us) server_negotiation.cc:299] Negotiation successful
0809 15:33:45.715061 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 15:33:45.715883 29047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:45.704180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.3:57825)
0809 15:33:45.704850 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:45.704886 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:45.705639 (+ 753us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:45.706117 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:45.706123 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:45.706464 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:33:45.706906 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:45.706919 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.707771 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.707773 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:45.708707 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:45.708717 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.709399 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.709403 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:45.709540 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:45.710146 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:33:45.710173 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:33:45.711629 (+ 1456us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:33:45.713473 (+ 1844us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:45.713477 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:45.713488 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:45.713717 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:45.714042 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:33:45.714044 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:33:45.714046 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:33:45.714161 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:33:45.714542 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:33:45.714546 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:33:45.714731 (+ 185us) client_negotiation.cc:769] Sending connection context
0809 15:33:45.714863 (+ 132us) client_negotiation.cc:240] Negotiation successful
0809 15:33:45.715082 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":143,"threads_started":1}
I20260809 15:33:45.716902 29045 heartbeater.cc:347] Connected to a master server at 127.11.146.62:43907
I20260809 15:33:45.717108 29045 heartbeater.cc:464] Registering TS with master...
I20260809 15:33:45.717523 29045 heartbeater.cc:511] Master 127.11.146.62:43907 requested a full tablet report, sending...
I20260809 15:33:45.718431 28509 ts_manager.cc:194] Registered new tserver with Master: 46d6c3dd213444ce9ff1a741489d7df2 (127.11.146.3:42971)
I20260809 15:33:45.718921 28509 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.3@KRBTEST.COM'} at 127.11.146.3:57825
I20260809 15:33:45.723731 11848 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:33:45.733031 28551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:45.725764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53184 (local address 127.11.146.62:43907)
0809 15:33:45.725948 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:45.725951 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:45.726045 (+ 94us) server_negotiation.cc:407] Connection header received
0809 15:33:45.726126 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:45.726128 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:45.726168 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:45.726244 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:33:45.726923 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.727486 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.728388 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.728619 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.728707 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:45.730053 (+ 1346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:33:45.730056 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:33:45.730059 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:33:45.730083 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:33:45.731441 (+ 1358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:45.731846 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:45.731850 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:45.731851 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:45.731940 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:33:45.732242 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:33:45.732246 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:33:45.732247 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:33:45.732485 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:33:45.732601 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:45.732810 (+ 209us) server_negotiation.cc:299] Negotiation successful
0809 15:33:45.732912 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260809 15:33:45.736009 28509 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53184:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:33:45.739439 28509 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:33:45.755544 29057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:45.748673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:42971 (local address 127.0.0.1:52588)
0809 15:33:45.749546 (+ 873us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:45.749564 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:45.749677 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:45.750581 (+ 904us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:45.750588 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:45.750627 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:33:45.750974 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:45.750983 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.752580 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.752587 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:45.753842 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:45.753853 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.754944 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.754948 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:45.755065 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:45.755109 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 15:33:45.755238 (+ 129us) client_negotiation.cc:240] Negotiation successful
0809 15:33:45.755387 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":807,"mutex_wait_us":139,"spinlock_wait_cycles":5504,"thread_start_us":118,"threads_started":1}
I20260809 15:33:45.755574 29062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:45.749414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52588 (local address 127.11.146.3:42971)
0809 15:33:45.750042 (+ 628us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:45.750055 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:45.750075 (+ 20us) server_negotiation.cc:407] Connection header received
0809 15:33:45.750156 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:45.750162 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:45.750404 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:45.750564 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:33:45.751133 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.752235 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.753990 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.754806 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.754927 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:45.755080 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:45.755288 (+ 208us) server_negotiation.cc:299] Negotiation successful
0809 15:33:45.755411 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":535,"thread_start_us":101,"threads_started":1}
I20260809 15:33:45.756326 29059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:45.748530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:44991 (local address 127.0.0.1:47596)
0809 15:33:45.749480 (+ 950us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:45.749531 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:45.749691 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:45.750581 (+ 890us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:45.750588 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:45.750628 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:33:45.750974 (+ 346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:45.750983 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.752636 (+ 1653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.752640 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:45.754191 (+ 1551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:45.754203 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.755606 (+ 1403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.755610 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:45.755911 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:45.755943 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 15:33:45.756023 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 15:33:45.756137 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":756,"mutex_wait_us":175,"spinlock_wait_cycles":13824,"thread_start_us":95,"threads_started":1}
I20260809 15:33:45.756464 29061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:45.749205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47140 (local address 127.11.146.2:43161)
0809 15:33:45.749845 (+ 640us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:45.749866 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:45.750963 (+ 1097us) server_negotiation.cc:407] Connection header received
0809 15:33:45.751119 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:45.751125 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:45.751322 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:45.751509 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:33:45.751733 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.752987 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.754534 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.755319 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.755428 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:45.755579 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:45.756197 (+ 618us) server_negotiation.cc:299] Negotiation successful
0809 15:33:45.756319 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":522,"thread_start_us":166,"threads_started":1}
I20260809 15:33:45.757156 29058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:45.748648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47596 (local address 127.11.146.1:44991)
0809 15:33:45.750031 (+ 1383us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:45.750047 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:45.750074 (+ 27us) server_negotiation.cc:407] Connection header received
0809 15:33:45.750157 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:45.750162 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:45.750378 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:45.750564 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:33:45.751146 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.752473 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.754333 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.755282 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.755397 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:45.755528 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:45.756747 (+ 1219us) server_negotiation.cc:299] Negotiation successful
0809 15:33:45.756936 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1274,"thread_start_us":119,"threads_started":1}
I20260809 15:33:45.759227 28970 tablet_service.cc:1467] Processing CreateTablet for tablet 4d32f54b75ba43aa8d1fb310b98ed671 (DEFAULT_TABLE table=test-table [id=5894026fc9164df6a4cf8033c88ae6bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:33:45.760432 28970 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d32f54b75ba43aa8d1fb310b98ed671. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:33:45.756867 29060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:45.749029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:43161 (local address 127.0.0.1:47140)
0809 15:33:45.750827 (+ 1798us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:45.750850 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:45.750988 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:45.751511 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:45.751514 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:45.751536 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:33:45.751630 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:45.751636 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.753170 (+ 1534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.753173 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:45.754405 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:45.754414 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.755656 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.755663 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:45.755892 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:45.755934 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 15:33:45.756021 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 15:33:45.756711 (+ 690us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1728,"mutex_wait_us":111,"thread_start_us":93,"threads_started":1}
I20260809 15:33:45.762678 28650 tablet_service.cc:1467] Processing CreateTablet for tablet 4d32f54b75ba43aa8d1fb310b98ed671 (DEFAULT_TABLE table=test-table [id=5894026fc9164df6a4cf8033c88ae6bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:33:45.763559 28650 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d32f54b75ba43aa8d1fb310b98ed671. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:33:45.763906 28811 tablet_service.cc:1467] Processing CreateTablet for tablet 4d32f54b75ba43aa8d1fb310b98ed671 (DEFAULT_TABLE table=test-table [id=5894026fc9164df6a4cf8033c88ae6bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:33:45.765010 28811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d32f54b75ba43aa8d1fb310b98ed671. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:33:45.768456 29063 tablet_bootstrap.cc:492] T 4d32f54b75ba43aa8d1fb310b98ed671 P 46d6c3dd213444ce9ff1a741489d7df2: Bootstrap starting.
I20260809 15:33:45.770373 29064 tablet_bootstrap.cc:492] T 4d32f54b75ba43aa8d1fb310b98ed671 P c25e03355bfd40b38652c085bd3a1292: Bootstrap starting.
I20260809 15:33:45.771030 29063 tablet_bootstrap.cc:654] T 4d32f54b75ba43aa8d1fb310b98ed671 P 46d6c3dd213444ce9ff1a741489d7df2: Neither blocks nor log segments found. Creating new log.
I20260809 15:33:45.772523 29065 tablet_bootstrap.cc:492] T 4d32f54b75ba43aa8d1fb310b98ed671 P 36aa1caa9f1a43808493994d31b568d9: Bootstrap starting.
I20260809 15:33:45.772517 29063 log.cc:824] T 4d32f54b75ba43aa8d1fb310b98ed671 P 46d6c3dd213444ce9ff1a741489d7df2: Log is configured to *not* fsync() on all Append() calls
I20260809 15:33:45.772771 29064 tablet_bootstrap.cc:654] T 4d32f54b75ba43aa8d1fb310b98ed671 P c25e03355bfd40b38652c085bd3a1292: Neither blocks nor log segments found. Creating new log.
I20260809 15:33:45.774060 29064 log.cc:824] T 4d32f54b75ba43aa8d1fb310b98ed671 P c25e03355bfd40b38652c085bd3a1292: Log is configured to *not* fsync() on all Append() calls
I20260809 15:33:45.775053 29063 tablet_bootstrap.cc:492] T 4d32f54b75ba43aa8d1fb310b98ed671 P 46d6c3dd213444ce9ff1a741489d7df2: No bootstrap required, opened a new log
I20260809 15:33:45.775228 29065 tablet_bootstrap.cc:654] T 4d32f54b75ba43aa8d1fb310b98ed671 P 36aa1caa9f1a43808493994d31b568d9: Neither blocks nor log segments found. Creating new log.
I20260809 15:33:45.775266 29063 ts_tablet_manager.cc:1397] T 4d32f54b75ba43aa8d1fb310b98ed671 P 46d6c3dd213444ce9ff1a741489d7df2: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.003s
I20260809 15:33:45.775919 29065 log.cc:824] T 4d32f54b75ba43aa8d1fb310b98ed671 P 36aa1caa9f1a43808493994d31b568d9: Log is configured to *not* fsync() on all Append() calls
I20260809 15:33:45.776381 29064 tablet_bootstrap.cc:492] T 4d32f54b75ba43aa8d1fb310b98ed671 P c25e03355bfd40b38652c085bd3a1292: No bootstrap required, opened a new log
I20260809 15:33:45.776571 29064 ts_tablet_manager.cc:1397] T 4d32f54b75ba43aa8d1fb310b98ed671 P c25e03355bfd40b38652c085bd3a1292: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 15:33:45.777621 29065 tablet_bootstrap.cc:492] T 4d32f54b75ba43aa8d1fb310b98ed671 P 36aa1caa9f1a43808493994d31b568d9: No bootstrap required, opened a new log
I20260809 15:33:45.777824 29065 ts_tablet_manager.cc:1397] T 4d32f54b75ba43aa8d1fb310b98ed671 P 36aa1caa9f1a43808493994d31b568d9: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 15:33:45.779428 29063 raft_consensus.cc:348] T 4d32f54b75ba43aa8d1fb310b98ed671 P 46d6c3dd213444ce9ff1a741489d7df2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c25e03355bfd40b38652c085bd3a1292" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44991 } } peers { permanent_uuid: "46d6c3dd213444ce9ff1a741489d7df2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42971 } } peers { permanent_uuid: "36aa1caa9f1a43808493994d31b568d9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 43161 } }
I20260809 15:33:45.779716 29063 raft_consensus.cc:374] T 4d32f54b75ba43aa8d1fb310b98ed671 P 46d6c3dd213444ce9ff1a741489d7df2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:33:45.779776 29063 raft_consensus.cc:729] T 4d32f54b75ba43aa8d1fb310b98ed671 P 46d6c3dd213444ce9ff1a741489d7df2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46d6c3dd213444ce9ff1a741489d7df2, State: Initialized, Role: FOLLOWER
I20260809 15:33:45.780332 29063 consensus_queue.cc:260] T 4d32f54b75ba43aa8d1fb310b98ed671 P 46d6c3dd213444ce9ff1a741489d7df2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c25e03355bfd40b38652c085bd3a1292" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44991 } } peers { permanent_uuid: "46d6c3dd213444ce9ff1a741489d7df2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42971 } } peers { permanent_uuid: "36aa1caa9f1a43808493994d31b568d9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 43161 } }
I20260809 15:33:45.780640 29064 raft_consensus.cc:348] T 4d32f54b75ba43aa8d1fb310b98ed671 P c25e03355bfd40b38652c085bd3a1292 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c25e03355bfd40b38652c085bd3a1292" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44991 } } peers { permanent_uuid: "46d6c3dd213444ce9ff1a741489d7df2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42971 } } peers { permanent_uuid: "36aa1caa9f1a43808493994d31b568d9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 43161 } }
I20260809 15:33:45.780877 29064 raft_consensus.cc:374] T 4d32f54b75ba43aa8d1fb310b98ed671 P c25e03355bfd40b38652c085bd3a1292 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:33:45.780948 29064 raft_consensus.cc:729] T 4d32f54b75ba43aa8d1fb310b98ed671 P c25e03355bfd40b38652c085bd3a1292 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c25e03355bfd40b38652c085bd3a1292, State: Initialized, Role: FOLLOWER
I20260809 15:33:45.781181 29045 heartbeater.cc:503] Master 127.11.146.62:43907 was elected leader, sending a full tablet report...
I20260809 15:33:45.781257 29065 raft_consensus.cc:348] T 4d32f54b75ba43aa8d1fb310b98ed671 P 36aa1caa9f1a43808493994d31b568d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c25e03355bfd40b38652c085bd3a1292" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44991 } } peers { permanent_uuid: "46d6c3dd213444ce9ff1a741489d7df2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42971 } } peers { permanent_uuid: "36aa1caa9f1a43808493994d31b568d9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 43161 } }
I20260809 15:33:45.781448 29063 ts_tablet_manager.cc:1428] T 4d32f54b75ba43aa8d1fb310b98ed671 P 46d6c3dd213444ce9ff1a741489d7df2: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 15:33:45.781533 29065 raft_consensus.cc:374] T 4d32f54b75ba43aa8d1fb310b98ed671 P 36aa1caa9f1a43808493994d31b568d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:33:45.781592 29065 raft_consensus.cc:729] T 4d32f54b75ba43aa8d1fb310b98ed671 P 36aa1caa9f1a43808493994d31b568d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36aa1caa9f1a43808493994d31b568d9, State: Initialized, Role: FOLLOWER
I20260809 15:33:45.782048 29064 consensus_queue.cc:260] T 4d32f54b75ba43aa8d1fb310b98ed671 P c25e03355bfd40b38652c085bd3a1292 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c25e03355bfd40b38652c085bd3a1292" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44991 } } peers { permanent_uuid: "46d6c3dd213444ce9ff1a741489d7df2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42971 } } peers { permanent_uuid: "36aa1caa9f1a43808493994d31b568d9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 43161 } }
I20260809 15:33:45.782053 29065 consensus_queue.cc:260] T 4d32f54b75ba43aa8d1fb310b98ed671 P 36aa1caa9f1a43808493994d31b568d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c25e03355bfd40b38652c085bd3a1292" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44991 } } peers { permanent_uuid: "46d6c3dd213444ce9ff1a741489d7df2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42971 } } peers { permanent_uuid: "36aa1caa9f1a43808493994d31b568d9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 43161 } }
I20260809 15:33:45.782757 28726 heartbeater.cc:503] Master 127.11.146.62:43907 was elected leader, sending a full tablet report...
I20260809 15:33:45.783107 29065 ts_tablet_manager.cc:1428] T 4d32f54b75ba43aa8d1fb310b98ed671 P 36aa1caa9f1a43808493994d31b568d9: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 15:33:45.783450 28889 heartbeater.cc:503] Master 127.11.146.62:43907 was elected leader, sending a full tablet report...
I20260809 15:33:45.784125 29064 ts_tablet_manager.cc:1428] T 4d32f54b75ba43aa8d1fb310b98ed671 P c25e03355bfd40b38652c085bd3a1292: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260809 15:33:45.814621 29069 raft_consensus.cc:482] T 4d32f54b75ba43aa8d1fb310b98ed671 P 46d6c3dd213444ce9ff1a741489d7df2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:33:45.814849 29069 raft_consensus.cc:504] T 4d32f54b75ba43aa8d1fb310b98ed671 P 46d6c3dd213444ce9ff1a741489d7df2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c25e03355bfd40b38652c085bd3a1292" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44991 } } peers { permanent_uuid: "46d6c3dd213444ce9ff1a741489d7df2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42971 } } peers { permanent_uuid: "36aa1caa9f1a43808493994d31b568d9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 43161 } }
I20260809 15:33:45.816005 29069 leader_election.cc:288] T 4d32f54b75ba43aa8d1fb310b98ed671 P 46d6c3dd213444ce9ff1a741489d7df2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c25e03355bfd40b38652c085bd3a1292 (127.11.146.1:44991), 36aa1caa9f1a43808493994d31b568d9 (127.11.146.2:43161)
I20260809 15:33:45.820681 29058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:45.816355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:57655 (local address 127.11.146.1:44991)
0809 15:33:45.816524 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:45.816531 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:45.816551 (+ 20us) server_negotiation.cc:407] Connection header received
0809 15:33:45.816616 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:45.816619 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:45.816683 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:45.816772 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:33:45.817113 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.817924 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.819397 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.820020 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.820178 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:45.820235 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:45.820480 (+ 245us) server_negotiation.cc:299] Negotiation successful
0809 15:33:45.820550 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 15:33:45.820681 29061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:45.816534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:33247 (local address 127.11.146.2:43161)
0809 15:33:45.816657 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:45.816661 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:45.816867 (+ 206us) server_negotiation.cc:407] Connection header received
0809 15:33:45.816985 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:45.816988 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:45.817033 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:45.817139 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:33:45.817374 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.818093 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.819397 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.820020 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.820178 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:45.820235 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:45.820480 (+ 245us) server_negotiation.cc:299] Negotiation successful
0809 15:33:45.820550 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 15:33:45.820690 29047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:45.816190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:44991 (local address 127.11.146.3:57655)
0809 15:33:45.816327 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:45.816347 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:45.816472 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:45.816815 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:45.816822 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:45.816844 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:33:45.817002 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:45.817008 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.818039 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.818042 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:45.819229 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:45.819239 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.820164 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.820168 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:45.820324 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:45.820373 (+ 49us) client_negotiation.cc:769] Sending connection context
0809 15:33:45.820445 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 15:33:45.820554 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":77,"spinlock_wait_cycles":2432}
I20260809 15:33:45.820705 29073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:45.816355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:43161 (local address 127.11.146.3:33247)
0809 15:33:45.816730 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:45.816762 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 15:33:45.816883 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:33:45.817152 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:33:45.817154 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:33:45.817171 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:33:45.817256 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:45.817260 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.818188 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.818191 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:45.819280 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:33:45.819289 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.820164 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.820168 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:33:45.820320 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:45.820364 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 15:33:45.820445 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 15:33:45.820549 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"mutex_wait_us":47,"spinlock_wait_cycles":26368,"thread_start_us":167,"threads_started":1}
I20260809 15:33:45.821591 28674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d32f54b75ba43aa8d1fb310b98ed671" candidate_uuid: "46d6c3dd213444ce9ff1a741489d7df2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c25e03355bfd40b38652c085bd3a1292" is_pre_election: true
I20260809 15:33:45.821606 28837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d32f54b75ba43aa8d1fb310b98ed671" candidate_uuid: "46d6c3dd213444ce9ff1a741489d7df2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36aa1caa9f1a43808493994d31b568d9" is_pre_election: true
I20260809 15:33:45.821910 28674 raft_consensus.cc:2454] T 4d32f54b75ba43aa8d1fb310b98ed671 P c25e03355bfd40b38652c085bd3a1292 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46d6c3dd213444ce9ff1a741489d7df2 in term 0.
I20260809 15:33:45.821899 28837 raft_consensus.cc:2454] T 4d32f54b75ba43aa8d1fb310b98ed671 P 36aa1caa9f1a43808493994d31b568d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46d6c3dd213444ce9ff1a741489d7df2 in term 0.
I20260809 15:33:45.822427 28920 leader_election.cc:302] T 4d32f54b75ba43aa8d1fb310b98ed671 P 46d6c3dd213444ce9ff1a741489d7df2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 36aa1caa9f1a43808493994d31b568d9, 46d6c3dd213444ce9ff1a741489d7df2, c25e03355bfd40b38652c085bd3a1292; no voters:
I20260809 15:33:45.822695 29069 raft_consensus.cc:2781] T 4d32f54b75ba43aa8d1fb310b98ed671 P 46d6c3dd213444ce9ff1a741489d7df2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:33:45.822801 29069 raft_consensus.cc:482] T 4d32f54b75ba43aa8d1fb310b98ed671 P 46d6c3dd213444ce9ff1a741489d7df2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:33:45.822860 29069 raft_consensus.cc:3037] T 4d32f54b75ba43aa8d1fb310b98ed671 P 46d6c3dd213444ce9ff1a741489d7df2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:33:45.823848 29069 raft_consensus.cc:504] T 4d32f54b75ba43aa8d1fb310b98ed671 P 46d6c3dd213444ce9ff1a741489d7df2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c25e03355bfd40b38652c085bd3a1292" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44991 } } peers { permanent_uuid: "46d6c3dd213444ce9ff1a741489d7df2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42971 } } peers { permanent_uuid: "36aa1caa9f1a43808493994d31b568d9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 43161 } }
I20260809 15:33:45.824244 29069 leader_election.cc:288] T 4d32f54b75ba43aa8d1fb310b98ed671 P 46d6c3dd213444ce9ff1a741489d7df2 [CANDIDATE]: Term 1 election: Requested vote from peers c25e03355bfd40b38652c085bd3a1292 (127.11.146.1:44991), 36aa1caa9f1a43808493994d31b568d9 (127.11.146.2:43161)
I20260809 15:33:45.824564 28674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d32f54b75ba43aa8d1fb310b98ed671" candidate_uuid: "46d6c3dd213444ce9ff1a741489d7df2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c25e03355bfd40b38652c085bd3a1292"
I20260809 15:33:45.824607 28837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d32f54b75ba43aa8d1fb310b98ed671" candidate_uuid: "46d6c3dd213444ce9ff1a741489d7df2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36aa1caa9f1a43808493994d31b568d9"
I20260809 15:33:45.824695 28674 raft_consensus.cc:3037] T 4d32f54b75ba43aa8d1fb310b98ed671 P c25e03355bfd40b38652c085bd3a1292 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:33:45.824724 28837 raft_consensus.cc:3037] T 4d32f54b75ba43aa8d1fb310b98ed671 P 36aa1caa9f1a43808493994d31b568d9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:33:45.825793 28837 raft_consensus.cc:2454] T 4d32f54b75ba43aa8d1fb310b98ed671 P 36aa1caa9f1a43808493994d31b568d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d6c3dd213444ce9ff1a741489d7df2 in term 1.
I20260809 15:33:45.825812 28674 raft_consensus.cc:2454] T 4d32f54b75ba43aa8d1fb310b98ed671 P c25e03355bfd40b38652c085bd3a1292 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d6c3dd213444ce9ff1a741489d7df2 in term 1.
I20260809 15:33:45.826102 28922 leader_election.cc:302] T 4d32f54b75ba43aa8d1fb310b98ed671 P 46d6c3dd213444ce9ff1a741489d7df2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36aa1caa9f1a43808493994d31b568d9, 46d6c3dd213444ce9ff1a741489d7df2; no voters:
I20260809 15:33:45.826342 29069 raft_consensus.cc:2781] T 4d32f54b75ba43aa8d1fb310b98ed671 P 46d6c3dd213444ce9ff1a741489d7df2 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:33:45.826558 29069 raft_consensus.cc:686] T 4d32f54b75ba43aa8d1fb310b98ed671 P 46d6c3dd213444ce9ff1a741489d7df2 [term 1 LEADER]: Becoming Leader. State: Replica: 46d6c3dd213444ce9ff1a741489d7df2, State: Running, Role: LEADER
I20260809 15:33:45.826876 29069 consensus_queue.cc:237] T 4d32f54b75ba43aa8d1fb310b98ed671 P 46d6c3dd213444ce9ff1a741489d7df2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c25e03355bfd40b38652c085bd3a1292" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44991 } } peers { permanent_uuid: "46d6c3dd213444ce9ff1a741489d7df2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42971 } } peers { permanent_uuid: "36aa1caa9f1a43808493994d31b568d9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 43161 } }
I20260809 15:33:45.830104 28509 catalog_manager.cc:5495] T 4d32f54b75ba43aa8d1fb310b98ed671 P 46d6c3dd213444ce9ff1a741489d7df2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 46d6c3dd213444ce9ff1a741489d7df2 (127.11.146.3). New cstate: current_term: 1 leader_uuid: "46d6c3dd213444ce9ff1a741489d7df2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c25e03355bfd40b38652c085bd3a1292" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46d6c3dd213444ce9ff1a741489d7df2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36aa1caa9f1a43808493994d31b568d9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 43161 } health_report { overall_health: UNKNOWN } } }
I20260809 15:33:45.854986 29062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:45.851503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52596 (local address 127.11.146.3:42971)
0809 15:33:45.851648 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 15:33:45.851653 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:33:45.851665 (+ 12us) server_negotiation.cc:407] Connection header received
0809 15:33:45.851821 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:33:45.851824 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:33:45.851883 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:33:45.851995 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:33:45.852266 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.852778 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.853608 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:33:45.853831 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:33:45.853940 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:33:45.854248 (+ 308us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:33:45.854612 (+ 364us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:33:45.854739 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 15:33:45.854803 (+ 64us) server_negotiation.cc:299] Negotiation successful
0809 15:33:45.854854 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 15:33:45.860538 28837 raft_consensus.cc:1261] T 4d32f54b75ba43aa8d1fb310b98ed671 P 36aa1caa9f1a43808493994d31b568d9 [term 1 FOLLOWER]: Refusing update from remote peer 46d6c3dd213444ce9ff1a741489d7df2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:33:45.860541 28674 raft_consensus.cc:1261] T 4d32f54b75ba43aa8d1fb310b98ed671 P c25e03355bfd40b38652c085bd3a1292 [term 1 FOLLOWER]: Refusing update from remote peer 46d6c3dd213444ce9ff1a741489d7df2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:33:45.861176 29069 consensus_queue.cc:1035] T 4d32f54b75ba43aa8d1fb310b98ed671 P 46d6c3dd213444ce9ff1a741489d7df2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36aa1caa9f1a43808493994d31b568d9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 43161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:33:45.861340 29074 consensus_queue.cc:1035] T 4d32f54b75ba43aa8d1fb310b98ed671 P 46d6c3dd213444ce9ff1a741489d7df2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c25e03355bfd40b38652c085bd3a1292" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:33:45.870070 29079 mvcc.cc:205] Tried to move back new op lower bound from 7316642307518029824 to 7316642307389755392. Current Snapshot: MvccSnapshot[applied={T|T < 7316642307518029824}]
I20260809 15:33:45.872211 29078 mvcc.cc:205] Tried to move back new op lower bound from 7316642307518029824 to 7316642307389755392. Current Snapshot: MvccSnapshot[applied={T|T < 7316642307518029824}]
I20260809 15:33:45.876279 28508 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53184:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:33:45.876403 28508 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53184:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:33:45.878548 28508 catalog_manager.cc:5782] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5: Sending DeleteTablet for 3 replicas of tablet 4d32f54b75ba43aa8d1fb310b98ed671
I20260809 15:33:45.879222 28650 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d32f54b75ba43aa8d1fb310b98ed671 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:33:45 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:47596
I20260809 15:33:45.879292 28970 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d32f54b75ba43aa8d1fb310b98ed671 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:33:45 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:52588
I20260809 15:33:45.879357 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 28581
I20260809 15:33:45.880779 28811 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d32f54b75ba43aa8d1fb310b98ed671 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:33:45 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:47140
I20260809 15:33:45.881320 29089 tablet_replica.cc:330] T 4d32f54b75ba43aa8d1fb310b98ed671 P 46d6c3dd213444ce9ff1a741489d7df2: stopping tablet replica
I20260809 15:33:45.881624 29089 raft_consensus.cc:2229] T 4d32f54b75ba43aa8d1fb310b98ed671 P 46d6c3dd213444ce9ff1a741489d7df2 [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:33:45.881953 29089 raft_consensus.cc:2258] T 4d32f54b75ba43aa8d1fb310b98ed671 P 46d6c3dd213444ce9ff1a741489d7df2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:33:45.883248 29089 ts_tablet_manager.cc:1905] T 4d32f54b75ba43aa8d1fb310b98ed671 P 46d6c3dd213444ce9ff1a741489d7df2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:33:45.886080 29089 ts_tablet_manager.cc:1918] T 4d32f54b75ba43aa8d1fb310b98ed671 P 46d6c3dd213444ce9ff1a741489d7df2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:33:45.886178 29089 log.cc:1196] T 4d32f54b75ba43aa8d1fb310b98ed671 P 46d6c3dd213444ce9ff1a741489d7df2: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/wal/wals/4d32f54b75ba43aa8d1fb310b98ed671
I20260809 15:33:45.886444 29090 tablet_replica.cc:330] T 4d32f54b75ba43aa8d1fb310b98ed671 P 36aa1caa9f1a43808493994d31b568d9: stopping tablet replica
I20260809 15:33:45.886525 29089 ts_tablet_manager.cc:1939] T 4d32f54b75ba43aa8d1fb310b98ed671 P 46d6c3dd213444ce9ff1a741489d7df2: Deleting consensus metadata
I20260809 15:33:45.886844 29090 raft_consensus.cc:2229] T 4d32f54b75ba43aa8d1fb310b98ed671 P 36aa1caa9f1a43808493994d31b568d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:33:45.887192 29090 raft_consensus.cc:2258] T 4d32f54b75ba43aa8d1fb310b98ed671 P 36aa1caa9f1a43808493994d31b568d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:33:45.887655 28492 catalog_manager.cc:4841] TS 46d6c3dd213444ce9ff1a741489d7df2 (127.11.146.3:42971): tablet 4d32f54b75ba43aa8d1fb310b98ed671 (table test-table [id=5894026fc9164df6a4cf8033c88ae6bc]) successfully deleted
I20260809 15:33:45.888744 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 28734
W20260809 15:33:45.888713 28493 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.146.1:44991 (error 108)
I20260809 15:33:45.895315 29060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:45.895049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:44991 (local address 127.0.0.1:47612)
0809 15:33:45.895177 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:45.895249 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.1:44991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 15:33:45.895502 28493 catalog_manager.cc:4584] TS c25e03355bfd40b38652c085bd3a1292 (127.11.146.1:44991): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4d32f54b75ba43aa8d1fb310b98ed671: Network error: Client connection negotiation failed: client connection to 127.11.146.1:44991: connect: Connection refused (error 111)
I20260809 15:33:45.900480 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 28895
I20260809 15:33:45.901791 29060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:33:45.900592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:43161 (local address 127.0.0.1:47152)
0809 15:33:45.901690 (+ 1098us) negotiation.cc:107] Waiting for socket to connect
0809 15:33:45.901738 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.2:43161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1017}
I20260809 15:33:45.906976 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 28474
I20260809 15:34:05.915233 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:43907
--webserver_interface=127.11.146.62
--webserver_port=33511
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:45395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:43907
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:34:06.030103 29092 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:06.030376 29092 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:06.030462 29092 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:06.034374 29092 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 15:34:06.034446 29092 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 15:34:06.034473 29092 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 15:34:06.034520 29092 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:34:06.034560 29092 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:06.034598 29092 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:06.034631 29092 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:34:06.034662 29092 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:34:06.039656 29092 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:45395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:43907
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:43907
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=33511
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29092
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:06.040656 29092 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:06.041584 29092 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:34:06.055302 29099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:06.055254 29098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:06.055264 29101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:06.055652 29092 server_base.cc:1034] running on GCE node
I20260809 15:34:06.056349 29092 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:06.057493 29092 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:06.058696 29092 hybrid_clock.cc:648] HybridClock initialized: now 1786289646058671 us; error 32 us; skew 500 ppm
Aug 09 15:34:06 dist-test-slave-1jjb krb5kdc[28459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289646, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:34:06.065138 29092 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:34:06.066087 29092 webserver.cc:460] Webserver started at http://127.11.146.62:33511/ using document root <none> and password file <none>
I20260809 15:34:06.066613 29092 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:06.066690 29092 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:06.070602 29092 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 15:34:06.072731 29108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:06.073972 29092 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:34:06.074110 29092 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "eb738e2dbb294df1bfa4d23f04e490e5"
format_stamp: "Formatted at 2026-08-09 15:33:44 on dist-test-slave-1jjb"
server_key: "f055ffd663695050491ef8ef93cec8b4"
server_key_iv: "9ffe9bc600ba56e05bfe21b3ff0e5f7a"
server_key_version: "encryptionkey@0"
I20260809 15:34:06.074707 29092 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:06.085078 29092 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:06.087836 29092 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:06.088035 29092 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:06.095568 29092 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:43907
I20260809 15:34:06.095896 29171 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:43907 every 8 connection(s)
I20260809 15:34:06.096707 29092 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:34:06.101056 29172 sys_catalog.cc:263] Verifying existing consensus state
I20260809 15:34:06.102778 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 29092
I20260809 15:34:06.102802 29172 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5: Bootstrap starting.
I20260809 15:34:06.103276 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.1:44991
--local_ip_for_outbound_sockets=127.11.146.1
--tserver_master_addrs=127.11.146.62:43907
--webserver_port=46589
--webserver_interface=127.11.146.1
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:45395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:34:06.120319 29172 log.cc:824] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5: Log is configured to *not* fsync() on all Append() calls
I20260809 15:34:06.129067 29172 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 15:34:06.129431 29172 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5: Bootstrap complete.
I20260809 15:34:06.133461 29172 raft_consensus.cc:348] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb738e2dbb294df1bfa4d23f04e490e5" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43907 } }
I20260809 15:34:06.133829 29172 raft_consensus.cc:729] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb738e2dbb294df1bfa4d23f04e490e5, State: Initialized, Role: FOLLOWER
I20260809 15:34:06.134286 29172 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb738e2dbb294df1bfa4d23f04e490e5" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43907 } }
I20260809 15:34:06.134433 29172 raft_consensus.cc:388] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:34:06.134505 29172 raft_consensus.cc:482] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:34:06.134622 29172 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [term 1 FOLLOWER]: Advancing to term 2
I20260809 15:34:06.136498 29172 raft_consensus.cc:504] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb738e2dbb294df1bfa4d23f04e490e5" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43907 } }
I20260809 15:34:06.136838 29172 leader_election.cc:302] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eb738e2dbb294df1bfa4d23f04e490e5; no voters:
I20260809 15:34:06.137128 29172 leader_election.cc:288] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 15:34:06.137272 29176 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 15:34:06.137579 29176 raft_consensus.cc:686] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [term 2 LEADER]: Becoming Leader. State: Replica: eb738e2dbb294df1bfa4d23f04e490e5, State: Running, Role: LEADER
I20260809 15:34:06.137917 29176 consensus_queue.cc:237] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb738e2dbb294df1bfa4d23f04e490e5" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43907 } }
I20260809 15:34:06.138343 29172 sys_catalog.cc:564] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:34:06.139359 29178 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "eb738e2dbb294df1bfa4d23f04e490e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb738e2dbb294df1bfa4d23f04e490e5" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43907 } } }
I20260809 15:34:06.139477 29178 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [sys.catalog]: This master's current role is: LEADER
I20260809 15:34:06.139812 29179 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb738e2dbb294df1bfa4d23f04e490e5. Latest consensus state: current_term: 2 leader_uuid: "eb738e2dbb294df1bfa4d23f04e490e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb738e2dbb294df1bfa4d23f04e490e5" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43907 } } }
I20260809 15:34:06.139928 29179 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [sys.catalog]: This master's current role is: LEADER
I20260809 15:34:06.140296 29187 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:34:06.144948 29187 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:34:06.145565 29187 catalog_manager.cc:1259] Loaded cluster ID: 83e1f3d81f5c401cb7a610b3c5a16c84
I20260809 15:34:06.145627 29187 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:34:06.148178 29187 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:34:06.148921 29187 catalog_manager.cc:5879] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5: Loaded TSK: 0
I20260809 15:34:06.162051 29187 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5: Generated new TSK 1
I20260809 15:34:06.162279 29187 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 15:34:06.220312 29174 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:06.220577 29174 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:06.220650 29174 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:06.224709 29174 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:06.224782 29174 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:06.224874 29174 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.1
I20260809 15:34:06.230069 29174 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:45395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.1:44991
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.146.1
--webserver_port=46589
--tserver_master_addrs=127.11.146.62:43907
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29174
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.1
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:06.231065 29174 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:06.232044 29174 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:34:06.242579 29201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:06.242594 29204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:06.242573 29202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:06.243013 29174 server_base.cc:1034] running on GCE node
I20260809 15:34:06.243400 29174 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:06.243988 29174 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:06.245180 29174 hybrid_clock.cc:648] HybridClock initialized: now 1786289646245160 us; error 39 us; skew 500 ppm
Aug 09 15:34:06 dist-test-slave-1jjb krb5kdc[28459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289646, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:34:06.247962 29174 init.cc:377] Logged in from keytab as kudu/127.11.146.1@KRBTEST.COM (short username kudu)
I20260809 15:34:06.248926 29174 webserver.cc:460] Webserver started at http://127.11.146.1:46589/ using document root <none> and password file <none>
I20260809 15:34:06.249468 29174 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:06.249538 29174 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:06.253612 29174 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 15:34:06.255847 29211 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:06.257135 29174 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:34:06.257226 29174 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/wal
uuid: "c25e03355bfd40b38652c085bd3a1292"
format_stamp: "Formatted at 2026-08-09 15:33:45 on dist-test-slave-1jjb"
server_key: "f389bea0d8e245b20c10ffda184b12a6"
server_key_iv: "0fe8486d48cde76175e2b3ec16a8dd46"
server_key_version: "encryptionkey@0"
I20260809 15:34:06.257767 29174 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:06.280601 29174 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:06.283849 29174 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:06.284061 29174 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:06.284767 29174 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:34:06.285992 29218 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 15:34:06.290131 29174 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 15:34:06.290225 29174 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.001s
I20260809 15:34:06.290310 29174 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 15:34:06.292107 29174 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 15:34:06.292177 29174 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.002s
I20260809 15:34:06.292457 29218 tablet_bootstrap.cc:492] T 4d32f54b75ba43aa8d1fb310b98ed671 P c25e03355bfd40b38652c085bd3a1292: Bootstrap starting.
I20260809 15:34:06.303112 29174 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.1:44991
I20260809 15:34:06.303182 29340 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.1:44991 every 8 connection(s)
I20260809 15:34:06.304113 29174 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
I20260809 15:34:06.310560 29218 log.cc:824] T 4d32f54b75ba43aa8d1fb310b98ed671 P c25e03355bfd40b38652c085bd3a1292: Log is configured to *not* fsync() on all Append() calls
I20260809 15:34:06.311122 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 29174
I20260809 15:34:06.311630 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.2:43161
--local_ip_for_outbound_sockets=127.11.146.2
--tserver_master_addrs=127.11.146.62:43907
--webserver_port=42943
--webserver_interface=127.11.146.2
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:45395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 15:34:06 dist-test-slave-1jjb krb5kdc[28459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289646, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:34:06.319011 29218 tablet_bootstrap.cc:492] T 4d32f54b75ba43aa8d1fb310b98ed671 P c25e03355bfd40b38652c085bd3a1292: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 15:34:06.319427 29218 tablet_bootstrap.cc:492] T 4d32f54b75ba43aa8d1fb310b98ed671 P c25e03355bfd40b38652c085bd3a1292: Bootstrap complete.
I20260809 15:34:06.320784 29218 ts_tablet_manager.cc:1397] T 4d32f54b75ba43aa8d1fb310b98ed671 P c25e03355bfd40b38652c085bd3a1292: Time spent bootstrapping tablet: real 0.029s user 0.023s sys 0.004s
I20260809 15:34:06.323204 29344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:06.306267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:41913 (local address 127.11.146.62:43907)
0809 15:34:06.306645 (+ 378us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:06.306666 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:06.307030 (+ 364us) server_negotiation.cc:407] Connection header received
0809 15:34:06.308201 (+ 1171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:06.308212 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:06.308507 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:06.308842 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:06.310016 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.311124 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.312655 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.313116 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.313307 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:06.316570 (+ 3263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:06.316579 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:06.316598 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:34:06.316637 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:06.319109 (+ 2472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:06.319847 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:06.319857 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:06.319866 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:06.320034 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:06.320573 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:06.320580 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:06.320585 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:06.321081 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:06.321232 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:06.321968 (+ 736us) server_negotiation.cc:299] Negotiation successful
0809 15:34:06.322281 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":229,"thread_start_us":137,"threads_started":1}
I20260809 15:34:06.323750 29345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:06.306295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.1:41913)
0809 15:34:06.306850 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:06.306904 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:06.307746 (+ 842us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:06.308907 (+ 1161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:06.308915 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:06.309373 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:34:06.309829 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:06.309843 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.311305 (+ 1462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.311309 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:06.312514 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:06.312525 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.313270 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.313274 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:06.313478 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:06.314280 (+ 802us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:34:06.314307 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:34:06.316344 (+ 2037us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:34:06.319269 (+ 2925us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:34:06.319285 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:34:06.319299 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:34:06.319703 (+ 404us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:34:06.320218 (+ 515us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:34:06.320223 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:34:06.320227 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:34:06.320448 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:34:06.321227 (+ 779us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:34:06.321235 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:34:06.321583 (+ 348us) client_negotiation.cc:769] Sending connection context
0809 15:34:06.321819 (+ 236us) client_negotiation.cc:240] Negotiation successful
0809 15:34:06.322209 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":140,"threads_started":1}
I20260809 15:34:06.323693 29218 raft_consensus.cc:348] T 4d32f54b75ba43aa8d1fb310b98ed671 P c25e03355bfd40b38652c085bd3a1292 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c25e03355bfd40b38652c085bd3a1292" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44991 } } peers { permanent_uuid: "46d6c3dd213444ce9ff1a741489d7df2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42971 } } peers { permanent_uuid: "36aa1caa9f1a43808493994d31b568d9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 43161 } }
I20260809 15:34:06.324308 29218 raft_consensus.cc:729] T 4d32f54b75ba43aa8d1fb310b98ed671 P c25e03355bfd40b38652c085bd3a1292 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c25e03355bfd40b38652c085bd3a1292, State: Initialized, Role: FOLLOWER
I20260809 15:34:06.324867 29218 consensus_queue.cc:260] T 4d32f54b75ba43aa8d1fb310b98ed671 P c25e03355bfd40b38652c085bd3a1292 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c25e03355bfd40b38652c085bd3a1292" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44991 } } peers { permanent_uuid: "46d6c3dd213444ce9ff1a741489d7df2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42971 } } peers { permanent_uuid: "36aa1caa9f1a43808493994d31b568d9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 43161 } }
I20260809 15:34:06.325794 29218 ts_tablet_manager.cc:1428] T 4d32f54b75ba43aa8d1fb310b98ed671 P c25e03355bfd40b38652c085bd3a1292: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 15:34:06.326538 29341 heartbeater.cc:347] Connected to a master server at 127.11.146.62:43907
I20260809 15:34:06.326794 29341 heartbeater.cc:464] Registering TS with master...
I20260809 15:34:06.327279 29341 heartbeater.cc:511] Master 127.11.146.62:43907 requested a full tablet report, sending...
I20260809 15:34:06.329649 29130 ts_manager.cc:194] Registered new tserver with Master: c25e03355bfd40b38652c085bd3a1292 (127.11.146.1:44991)
I20260809 15:34:06.332887 29130 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.1@KRBTEST.COM'} at 127.11.146.1:41913
I20260809 15:34:06.335575 29341 heartbeater.cc:503] Master 127.11.146.62:43907 was elected leader, sending a full tablet report...
Aug 09 15:34:06 dist-test-slave-1jjb krb5kdc[28459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289646, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for kudu/127.11.146.1@KRBTEST.COM
I20260809 15:34:06.342695 29349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:06.332372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:44991 (local address 127.0.0.1:42776)
0809 15:34:06.333070 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:06.333109 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:06.333247 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:06.333744 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:06.333750 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:06.334097 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:34:06.334192 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:06.334198 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.335156 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.335159 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:06.335825 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:06.335836 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.336670 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.336674 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:06.336794 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:06.337310 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:34:06.337332 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:34:06.338881 (+ 1549us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:34:06.340962 (+ 2081us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:34:06.340972 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:34:06.340978 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:34:06.341199 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:34:06.341509 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:34:06.341512 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:34:06.341514 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:34:06.341599 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:34:06.342036 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:34:06.342042 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:34:06.342185 (+ 143us) client_negotiation.cc:769] Sending connection context
0809 15:34:06.342319 (+ 134us) client_negotiation.cc:240] Negotiation successful
0809 15:34:06.342504 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":93,"threads_started":1}
I20260809 15:34:06.342727 29350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:06.332449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42776 (local address 127.11.146.1:44991)
0809 15:34:06.332823 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:06.332834 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:06.333216 (+ 382us) server_negotiation.cc:407] Connection header received
0809 15:34:06.333396 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:06.333401 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:06.333592 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:06.333715 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:06.334312 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.335026 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.335989 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.336533 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.336653 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:06.339011 (+ 2358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:06.339021 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:06.339038 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:34:06.339059 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:06.340853 (+ 1794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:06.341314 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:06.341320 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:06.341322 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:06.341415 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:06.341688 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:06.341693 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:06.341694 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:06.341927 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:06.342061 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:06.342420 (+ 359us) server_negotiation.cc:299] Negotiation successful
0809 15:34:06.342569 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":98,"threads_started":1}
I20260809 15:34:06.343904 29268 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d32f54b75ba43aa8d1fb310b98ed671 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:33:45 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:42776
I20260809 15:34:06.344763 29351 tablet_replica.cc:330] stopping tablet replica
I20260809 15:34:06.345039 29351 raft_consensus.cc:2229] T 4d32f54b75ba43aa8d1fb310b98ed671 P c25e03355bfd40b38652c085bd3a1292 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:34:06.345269 29351 raft_consensus.cc:2258] T 4d32f54b75ba43aa8d1fb310b98ed671 P c25e03355bfd40b38652c085bd3a1292 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:34:06.346166 29351 ts_tablet_manager.cc:1905] T 4d32f54b75ba43aa8d1fb310b98ed671 P c25e03355bfd40b38652c085bd3a1292: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:34:06.349534 29351 ts_tablet_manager.cc:1918] T 4d32f54b75ba43aa8d1fb310b98ed671 P c25e03355bfd40b38652c085bd3a1292: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:34:06.349607 29351 log.cc:1196] T 4d32f54b75ba43aa8d1fb310b98ed671 P c25e03355bfd40b38652c085bd3a1292: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/wal/wals/4d32f54b75ba43aa8d1fb310b98ed671
I20260809 15:34:06.349856 29351 ts_tablet_manager.cc:1939] T 4d32f54b75ba43aa8d1fb310b98ed671 P c25e03355bfd40b38652c085bd3a1292: Deleting consensus metadata
I20260809 15:34:06.351295 29111 catalog_manager.cc:4841] TS c25e03355bfd40b38652c085bd3a1292 (127.11.146.1:44991): tablet 4d32f54b75ba43aa8d1fb310b98ed671 (table test-table [id=5894026fc9164df6a4cf8033c88ae6bc]) successfully deleted
W20260809 15:34:06.433863 29347 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:06.434129 29347 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:06.434198 29347 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:06.438526 29347 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:06.438601 29347 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:06.438681 29347 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.2
I20260809 15:34:06.443876 29347 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:45395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.2:43161
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.146.2
--webserver_port=42943
--tserver_master_addrs=127.11.146.62:43907
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29347
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.2
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:06.444869 29347 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:06.445843 29347 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:34:06.455633 29358 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:06.455734 29361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:06.455731 29357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:06.455888 29347 server_base.cc:1034] running on GCE node
I20260809 15:34:06.456404 29347 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:06.457046 29347 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:06.458256 29347 hybrid_clock.cc:648] HybridClock initialized: now 1786289646458251 us; error 39 us; skew 500 ppm
Aug 09 15:34:06 dist-test-slave-1jjb krb5kdc[28459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289646, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:34:06.461333 29347 init.cc:377] Logged in from keytab as kudu/127.11.146.2@KRBTEST.COM (short username kudu)
I20260809 15:34:06.462235 29347 webserver.cc:460] Webserver started at http://127.11.146.2:42943/ using document root <none> and password file <none>
I20260809 15:34:06.462728 29347 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:06.462796 29347 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:06.466441 29347 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:34:06.468544 29369 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:06.469722 29347 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:34:06.469813 29347 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/wal
uuid: "36aa1caa9f1a43808493994d31b568d9"
format_stamp: "Formatted at 2026-08-09 15:33:45 on dist-test-slave-1jjb"
server_key: "a822ef6925cb57bf7a4238a5c5232982"
server_key_iv: "25ab88274f12b4004c5e7fc021d00fd4"
server_key_version: "encryptionkey@0"
I20260809 15:34:06.470371 29347 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:06.489918 29347 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:06.492712 29347 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:06.492865 29347 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:06.493386 29347 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:34:06.494345 29378 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 15:34:06.498667 29347 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 15:34:06.498766 29347 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260809 15:34:06.498875 29347 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 15:34:06.500628 29347 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 15:34:06.500747 29347 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260809 15:34:06.501055 29378 tablet_bootstrap.cc:492] T 4d32f54b75ba43aa8d1fb310b98ed671 P 36aa1caa9f1a43808493994d31b568d9: Bootstrap starting.
I20260809 15:34:06.507432 29378 log.cc:824] T 4d32f54b75ba43aa8d1fb310b98ed671 P 36aa1caa9f1a43808493994d31b568d9: Log is configured to *not* fsync() on all Append() calls
I20260809 15:34:06.511226 29347 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.2:43161
I20260809 15:34:06.511267 29502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.2:43161 every 8 connection(s)
I20260809 15:34:06.512045 29347 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
I20260809 15:34:06.515978 29378 tablet_bootstrap.cc:492] T 4d32f54b75ba43aa8d1fb310b98ed671 P 36aa1caa9f1a43808493994d31b568d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 15:34:06.516397 29378 tablet_bootstrap.cc:492] T 4d32f54b75ba43aa8d1fb310b98ed671 P 36aa1caa9f1a43808493994d31b568d9: Bootstrap complete.
I20260809 15:34:06.516729 29378 ts_tablet_manager.cc:1397] T 4d32f54b75ba43aa8d1fb310b98ed671 P 36aa1caa9f1a43808493994d31b568d9: Time spent bootstrapping tablet: real 0.016s user 0.015s sys 0.000s
I20260809 15:34:06.519057 29378 raft_consensus.cc:348] T 4d32f54b75ba43aa8d1fb310b98ed671 P 36aa1caa9f1a43808493994d31b568d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c25e03355bfd40b38652c085bd3a1292" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44991 } } peers { permanent_uuid: "46d6c3dd213444ce9ff1a741489d7df2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42971 } } peers { permanent_uuid: "36aa1caa9f1a43808493994d31b568d9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 43161 } }
I20260809 15:34:06.519507 29378 raft_consensus.cc:729] T 4d32f54b75ba43aa8d1fb310b98ed671 P 36aa1caa9f1a43808493994d31b568d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36aa1caa9f1a43808493994d31b568d9, State: Initialized, Role: FOLLOWER
I20260809 15:34:06.520042 29378 consensus_queue.cc:260] T 4d32f54b75ba43aa8d1fb310b98ed671 P 36aa1caa9f1a43808493994d31b568d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c25e03355bfd40b38652c085bd3a1292" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44991 } } peers { permanent_uuid: "46d6c3dd213444ce9ff1a741489d7df2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42971 } } peers { permanent_uuid: "36aa1caa9f1a43808493994d31b568d9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 43161 } }
I20260809 15:34:06.520890 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 29347
I20260809 15:34:06.521088 29378 ts_tablet_manager.cc:1428] T 4d32f54b75ba43aa8d1fb310b98ed671 P 36aa1caa9f1a43808493994d31b568d9: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260809 15:34:06.521396 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.3:42971
--local_ip_for_outbound_sockets=127.11.146.3
--tserver_master_addrs=127.11.146.62:43907
--webserver_port=41597
--webserver_interface=127.11.146.3
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:45395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 15:34:06 dist-test-slave-1jjb krb5kdc[28459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289646, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:34:06.526646 29344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:06.514007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:57533 (local address 127.11.146.62:43907)
0809 15:34:06.514147 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:06.514150 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:06.514760 (+ 610us) server_negotiation.cc:407] Connection header received
0809 15:34:06.515691 (+ 931us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:06.515694 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:06.515758 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:06.515887 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:06.517151 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.517675 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.518830 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.519061 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.519190 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:06.522490 (+ 3300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:06.522493 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:06.522495 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:34:06.522521 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:06.524226 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:06.524990 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:06.524993 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:06.524995 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:06.525080 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:06.525507 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:06.525510 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:06.525511 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:06.525693 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:06.525776 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:06.526396 (+ 620us) server_negotiation.cc:299] Negotiation successful
0809 15:34:06.526514 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 15:34:06.527784 29506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:06.514127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.2:57533)
0809 15:34:06.514614 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:06.514654 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:06.515488 (+ 834us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:06.516045 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:06.516051 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:06.516467 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:34:06.517009 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:06.517024 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.517829 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.517831 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:06.518668 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:06.518678 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.519203 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.519206 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:06.519405 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:06.520452 (+ 1047us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:34:06.520468 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:34:06.522274 (+ 1806us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:34:06.524351 (+ 2077us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:34:06.524359 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:34:06.524375 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:34:06.524793 (+ 418us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:34:06.525182 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:34:06.525206 (+ 24us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:34:06.525211 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:34:06.525404 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:34:06.525805 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:34:06.525814 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:34:06.526135 (+ 321us) client_negotiation.cc:769] Sending connection context
0809 15:34:06.526337 (+ 202us) client_negotiation.cc:240] Negotiation successful
0809 15:34:06.526724 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":148,"threads_started":1}
I20260809 15:34:06.529172 29504 heartbeater.cc:347] Connected to a master server at 127.11.146.62:43907
I20260809 15:34:06.529443 29504 heartbeater.cc:464] Registering TS with master...
I20260809 15:34:06.529943 29504 heartbeater.cc:511] Master 127.11.146.62:43907 requested a full tablet report, sending...
I20260809 15:34:06.531668 29130 ts_manager.cc:194] Registered new tserver with Master: 36aa1caa9f1a43808493994d31b568d9 (127.11.146.2:43161)
I20260809 15:34:06.533244 29130 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.2@KRBTEST.COM'} at 127.11.146.2:57533
I20260809 15:34:06.535722 29504 heartbeater.cc:503] Master 127.11.146.62:43907 was elected leader, sending a full tablet report...
Aug 09 15:34:06 dist-test-slave-1jjb krb5kdc[28459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289646, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for kudu/127.11.146.2@KRBTEST.COM
I20260809 15:34:06.542935 29349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:06.532813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:43161 (local address 127.0.0.1:38642)
0809 15:34:06.532995 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:06.533014 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:06.533097 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:06.533843 (+ 746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:06.533847 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:06.534059 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:34:06.534145 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:06.534152 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.535274 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.535280 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:06.535956 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:06.535967 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.536832 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.536837 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:06.536967 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:06.537498 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:34:06.537521 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:34:06.539067 (+ 1546us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:34:06.541393 (+ 2326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:34:06.541396 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:34:06.541398 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:34:06.541638 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:34:06.541932 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:34:06.541935 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:34:06.541938 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:34:06.542039 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:34:06.542450 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:34:06.542453 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:34:06.542542 (+ 89us) client_negotiation.cc:769] Sending connection context
0809 15:34:06.542651 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 15:34:06.542781 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105}
I20260809 15:34:06.543007 29509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:06.532910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38642 (local address 127.11.146.2:43161)
0809 15:34:06.533362 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:06.533377 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:06.533411 (+ 34us) server_negotiation.cc:407] Connection header received
0809 15:34:06.533478 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:06.533482 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:06.533709 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:06.533861 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:06.534269 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.535144 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.536124 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.536693 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.536799 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:06.539213 (+ 2414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:06.539222 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:06.539233 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:34:06.539255 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:06.541272 (+ 2017us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:06.541749 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:06.541754 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:06.541755 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:06.541833 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:06.542127 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:06.542130 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:06.542131 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:06.542350 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:06.542461 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:06.542705 (+ 244us) server_negotiation.cc:299] Negotiation successful
0809 15:34:06.542832 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":344,"thread_start_us":116,"threads_started":1}
I20260809 15:34:06.543982 29426 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d32f54b75ba43aa8d1fb310b98ed671 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:33:45 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:38642
I20260809 15:34:06.544955 29510 tablet_replica.cc:330] stopping tablet replica
I20260809 15:34:06.545241 29510 raft_consensus.cc:2229] T 4d32f54b75ba43aa8d1fb310b98ed671 P 36aa1caa9f1a43808493994d31b568d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:34:06.545480 29510 raft_consensus.cc:2258] T 4d32f54b75ba43aa8d1fb310b98ed671 P 36aa1caa9f1a43808493994d31b568d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:34:06.546409 29510 ts_tablet_manager.cc:1905] T 4d32f54b75ba43aa8d1fb310b98ed671 P 36aa1caa9f1a43808493994d31b568d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:34:06.550022 29510 ts_tablet_manager.cc:1918] T 4d32f54b75ba43aa8d1fb310b98ed671 P 36aa1caa9f1a43808493994d31b568d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:34:06.550100 29510 log.cc:1196] T 4d32f54b75ba43aa8d1fb310b98ed671 P 36aa1caa9f1a43808493994d31b568d9: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/wal/wals/4d32f54b75ba43aa8d1fb310b98ed671
I20260809 15:34:06.550387 29510 ts_tablet_manager.cc:1939] T 4d32f54b75ba43aa8d1fb310b98ed671 P 36aa1caa9f1a43808493994d31b568d9: Deleting consensus metadata
I20260809 15:34:06.551841 29114 catalog_manager.cc:4841] TS 36aa1caa9f1a43808493994d31b568d9 (127.11.146.2:43161): tablet 4d32f54b75ba43aa8d1fb310b98ed671 (table test-table [id=5894026fc9164df6a4cf8033c88ae6bc]) successfully deleted
W20260809 15:34:06.635902 29508 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:06.636175 29508 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:06.636255 29508 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:06.640194 29508 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:06.640298 29508 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:06.640388 29508 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.3
I20260809 15:34:06.645465 29508 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:45395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.3:42971
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.146.3
--webserver_port=41597
--tserver_master_addrs=127.11.146.62:43907
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29508
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.3
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:06.646374 29508 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:06.647325 29508 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:34:06.656775 29515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:06.656809 29518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:06.656906 29508 server_base.cc:1034] running on GCE node
W20260809 15:34:06.656832 29520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:06.657505 29508 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:06.658095 29508 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:06.659281 29508 hybrid_clock.cc:648] HybridClock initialized: now 1786289646659260 us; error 29 us; skew 500 ppm
Aug 09 15:34:06 dist-test-slave-1jjb krb5kdc[28459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289646, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:34:06.662209 29508 init.cc:377] Logged in from keytab as kudu/127.11.146.3@KRBTEST.COM (short username kudu)
I20260809 15:34:06.663079 29508 webserver.cc:460] Webserver started at http://127.11.146.3:41597/ using document root <none> and password file <none>
I20260809 15:34:06.663618 29508 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:06.663761 29508 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:06.667428 29508 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:34:06.669480 29527 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:06.670608 29508 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:34:06.670747 29508 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/wal
uuid: "46d6c3dd213444ce9ff1a741489d7df2"
format_stamp: "Formatted at 2026-08-09 15:33:45 on dist-test-slave-1jjb"
server_key: "2b1b42115cce740bde0ed3c6bcc74df7"
server_key_iv: "ea4b9f56e53ddcd2a833251dba07c4d7"
server_key_version: "encryptionkey@0"
I20260809 15:34:06.671267 29508 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:06.681813 29508 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:06.684531 29508 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:06.684715 29508 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:06.685263 29508 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:34:06.686177 29508 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:34:06.686221 29508 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:06.686287 29508 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:34:06.686331 29508 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:06.694864 29508 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.3:42971
I20260809 15:34:06.694936 29670 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.3:42971 every 8 connection(s)
I20260809 15:34:06.695873 29508 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
I20260809 15:34:06.699250 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 29508
Aug 09 15:34:06 dist-test-slave-1jjb krb5kdc[28459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289646, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:34:06.708142 29676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:06.699907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53194 (local address 127.11.146.62:43907)
0809 15:34:06.700227 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:06.700230 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:06.700300 (+ 70us) server_negotiation.cc:407] Connection header received
0809 15:34:06.700415 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:06.700418 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:06.700466 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:06.700569 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:06.701273 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.701867 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.702726 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.703049 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.703159 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:06.704647 (+ 1488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:06.704651 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:06.704653 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:34:06.704685 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:06.706215 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:06.706717 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:06.706723 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:06.706728 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:06.706840 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:06.707180 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:06.707185 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:06.707188 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:06.707435 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:06.707580 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:06.707831 (+ 251us) server_negotiation.cc:299] Negotiation successful
0809 15:34:06.707940 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":250,"thread_start_us":98,"threads_started":1}
I20260809 15:34:06.710512 29344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:06.697633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:41825 (local address 127.11.146.62:43907)
0809 15:34:06.697782 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:06.697787 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:06.698807 (+ 1020us) server_negotiation.cc:407] Connection header received
0809 15:34:06.699690 (+ 883us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:06.699696 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:06.699759 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:06.699845 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:06.701381 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.701889 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.703160 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.703535 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.703615 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:06.706345 (+ 2730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:06.706349 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:06.706351 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:34:06.706381 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:06.708160 (+ 1779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:06.708975 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:06.708978 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:06.708980 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:06.709106 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:06.709455 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:06.709459 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:06.709460 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:06.709621 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:06.709726 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:06.710249 (+ 523us) server_negotiation.cc:299] Negotiation successful
0809 15:34:06.710356 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":54}
I20260809 15:34:06.711223 29673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:06.698056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.3:41825)
0809 15:34:06.698666 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:06.698703 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:06.699510 (+ 807us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:06.700205 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:06.700214 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:06.700731 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:34:06.701218 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:06.701238 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.702041 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.702044 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:06.703039 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:06.703048 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.703691 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.703697 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:06.703887 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:06.704408 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:34:06.704423 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:34:06.706157 (+ 1734us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:34:06.708512 (+ 2355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:34:06.708517 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:34:06.708532 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:34:06.708856 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:34:06.709208 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:34:06.709211 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:34:06.709213 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:34:06.709346 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:34:06.709727 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:34:06.709734 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:34:06.710017 (+ 283us) client_negotiation.cc:769] Sending connection context
0809 15:34:06.710192 (+ 175us) client_negotiation.cc:240] Negotiation successful
0809 15:34:06.710481 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":98,"threads_started":1}
I20260809 15:34:06.712265 29671 heartbeater.cc:347] Connected to a master server at 127.11.146.62:43907
I20260809 15:34:06.712497 29671 heartbeater.cc:464] Registering TS with master...
I20260809 15:34:06.712941 29671 heartbeater.cc:511] Master 127.11.146.62:43907 requested a full tablet report, sending...
I20260809 15:34:06.713876 29130 ts_manager.cc:194] Registered new tserver with Master: 46d6c3dd213444ce9ff1a741489d7df2 (127.11.146.3:42971)
I20260809 15:34:06.714411 29130 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.3@KRBTEST.COM'} at 127.11.146.3:41825
I20260809 15:34:06.721493 11848 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:34:06.725222 29344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:06.722027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53200 (local address 127.11.146.62:43907)
0809 15:34:06.722141 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:06.722144 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:06.722323 (+ 179us) server_negotiation.cc:407] Connection header received
0809 15:34:06.722442 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:06.722444 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:06.722528 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:06.722611 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:34:06.722808 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.723287 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.724180 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.724376 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.724450 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:06.724777 (+ 327us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:34:06.724890 (+ 113us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0809 15:34:06.725079 (+ 189us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53200: token expired
Metrics: {"server-negotiator.queue_time_us":43}
W20260809 15:34:06.725294 29344 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53200: token expired
W20260809 15:34:06.725662 29050 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.11.146.62:43907)
I20260809 15:34:06.731894 29344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:06.725980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53208 (local address 127.11.146.62:43907)
0809 15:34:06.726087 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:06.726090 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:06.726106 (+ 16us) server_negotiation.cc:407] Connection header received
0809 15:34:06.726201 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:06.726203 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:06.726234 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:06.726285 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:06.726779 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.727205 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.727902 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.728166 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.728237 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:06.729541 (+ 1304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:06.729544 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:06.729545 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:34:06.729561 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:06.730718 (+ 1157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:06.731073 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:06.731076 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:06.731077 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:06.731143 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:06.731331 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:06.731333 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:06.731334 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:06.731471 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:06.731570 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:06.731723 (+ 153us) server_negotiation.cc:299] Negotiation successful
0809 15:34:06.731803 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 15:34:06.734084 29130 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53208:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:34:06.737229 29130 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:34:06.745066 29426 tablet_service.cc:1467] Processing CreateTablet for tablet f20ffaaf93ce4ee8a48a08547c81c9d1 (DEFAULT_TABLE table=test-table [id=ddf38404fd60476383851ef1bb5dddc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:34:06.745285 29268 tablet_service.cc:1467] Processing CreateTablet for tablet f20ffaaf93ce4ee8a48a08547c81c9d1 (DEFAULT_TABLE table=test-table [id=ddf38404fd60476383851ef1bb5dddc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:34:06.745700 29426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f20ffaaf93ce4ee8a48a08547c81c9d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:34:06.745827 29268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f20ffaaf93ce4ee8a48a08547c81c9d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:34:06.748241 29378 tablet_bootstrap.cc:492] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 36aa1caa9f1a43808493994d31b568d9: Bootstrap starting.
I20260809 15:34:06.748472 29218 tablet_bootstrap.cc:492] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292: Bootstrap starting.
I20260809 15:34:06.749228 29378 tablet_bootstrap.cc:654] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 36aa1caa9f1a43808493994d31b568d9: Neither blocks nor log segments found. Creating new log.
I20260809 15:34:06.749289 29218 tablet_bootstrap.cc:654] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292: Neither blocks nor log segments found. Creating new log.
I20260809 15:34:06.749650 29349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:06.744062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:42971 (local address 127.0.0.1:52706)
0809 15:34:06.744345 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:06.744359 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:06.744428 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:06.745355 (+ 927us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:06.745358 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:06.745374 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:34:06.745465 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:06.745470 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.746956 (+ 1486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.746959 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:06.748140 (+ 1181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:06.748154 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.749252 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.749255 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:06.749357 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:06.749397 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 15:34:06.749463 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 15:34:06.749536 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216}
I20260809 15:34:06.749956 29681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:06.744425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52706 (local address 127.11.146.3:42971)
0809 15:34:06.744844 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:06.744856 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:06.744880 (+ 24us) server_negotiation.cc:407] Connection header received
0809 15:34:06.744955 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:06.744960 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:06.745164 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:06.745622 (+ 458us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:34:06.745791 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.746829 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.748348 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.749108 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.749252 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:06.749516 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:06.749567 (+ 51us) server_negotiation.cc:299] Negotiation successful
0809 15:34:06.749652 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":190,"threads_started":1}
I20260809 15:34:06.751094 29218 tablet_bootstrap.cc:492] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292: No bootstrap required, opened a new log
I20260809 15:34:06.751183 29218 ts_tablet_manager.cc:1397] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 15:34:06.751384 29378 tablet_bootstrap.cc:492] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 36aa1caa9f1a43808493994d31b568d9: No bootstrap required, opened a new log
I20260809 15:34:06.751511 29378 ts_tablet_manager.cc:1397] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 36aa1caa9f1a43808493994d31b568d9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 15:34:06.751606 29218 raft_consensus.cc:348] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6c3dd213444ce9ff1a741489d7df2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42971 } } peers { permanent_uuid: "c25e03355bfd40b38652c085bd3a1292" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44991 } } peers { permanent_uuid: "36aa1caa9f1a43808493994d31b568d9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 43161 } }
I20260809 15:34:06.751725 29218 raft_consensus.cc:374] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:34:06.751770 29218 raft_consensus.cc:729] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c25e03355bfd40b38652c085bd3a1292, State: Initialized, Role: FOLLOWER
I20260809 15:34:06.751889 29218 consensus_queue.cc:260] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6c3dd213444ce9ff1a741489d7df2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42971 } } peers { permanent_uuid: "c25e03355bfd40b38652c085bd3a1292" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44991 } } peers { permanent_uuid: "36aa1caa9f1a43808493994d31b568d9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 43161 } }
I20260809 15:34:06.752015 29378 raft_consensus.cc:348] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 36aa1caa9f1a43808493994d31b568d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6c3dd213444ce9ff1a741489d7df2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42971 } } peers { permanent_uuid: "c25e03355bfd40b38652c085bd3a1292" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44991 } } peers { permanent_uuid: "36aa1caa9f1a43808493994d31b568d9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 43161 } }
I20260809 15:34:06.752146 29378 raft_consensus.cc:374] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 36aa1caa9f1a43808493994d31b568d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:34:06.752187 29378 raft_consensus.cc:729] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 36aa1caa9f1a43808493994d31b568d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36aa1caa9f1a43808493994d31b568d9, State: Initialized, Role: FOLLOWER
I20260809 15:34:06.752329 29378 consensus_queue.cc:260] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 36aa1caa9f1a43808493994d31b568d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6c3dd213444ce9ff1a741489d7df2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42971 } } peers { permanent_uuid: "c25e03355bfd40b38652c085bd3a1292" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44991 } } peers { permanent_uuid: "36aa1caa9f1a43808493994d31b568d9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 43161 } }
I20260809 15:34:06.752370 29218 ts_tablet_manager.cc:1428] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 15:34:06.752616 29378 ts_tablet_manager.cc:1428] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 36aa1caa9f1a43808493994d31b568d9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 15:34:06.753031 29586 tablet_service.cc:1467] Processing CreateTablet for tablet f20ffaaf93ce4ee8a48a08547c81c9d1 (DEFAULT_TABLE table=test-table [id=ddf38404fd60476383851ef1bb5dddc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:34:06.754099 29586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f20ffaaf93ce4ee8a48a08547c81c9d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:34:06.761627 29685 tablet_bootstrap.cc:492] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 46d6c3dd213444ce9ff1a741489d7df2: Bootstrap starting.
W20260809 15:34:06.763027 29505 tablet.cc:2369] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 36aa1caa9f1a43808493994d31b568d9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:34:06.764055 29685 tablet_bootstrap.cc:654] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 46d6c3dd213444ce9ff1a741489d7df2: Neither blocks nor log segments found. Creating new log.
I20260809 15:34:06.764833 29685 log.cc:824] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 46d6c3dd213444ce9ff1a741489d7df2: Log is configured to *not* fsync() on all Append() calls
I20260809 15:34:06.766683 29685 tablet_bootstrap.cc:492] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 46d6c3dd213444ce9ff1a741489d7df2: No bootstrap required, opened a new log
I20260809 15:34:06.766902 29685 ts_tablet_manager.cc:1397] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 46d6c3dd213444ce9ff1a741489d7df2: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 15:34:06.768471 29348 raft_consensus.cc:482] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:34:06.768642 29348 raft_consensus.cc:504] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6c3dd213444ce9ff1a741489d7df2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42971 } } peers { permanent_uuid: "c25e03355bfd40b38652c085bd3a1292" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44991 } } peers { permanent_uuid: "36aa1caa9f1a43808493994d31b568d9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 43161 } }
I20260809 15:34:06.769593 29348 leader_election.cc:288] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46d6c3dd213444ce9ff1a741489d7df2 (127.11.146.3:42971), 36aa1caa9f1a43808493994d31b568d9 (127.11.146.2:43161)
I20260809 15:34:06.770259 29685 raft_consensus.cc:348] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 46d6c3dd213444ce9ff1a741489d7df2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6c3dd213444ce9ff1a741489d7df2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42971 } } peers { permanent_uuid: "c25e03355bfd40b38652c085bd3a1292" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44991 } } peers { permanent_uuid: "36aa1caa9f1a43808493994d31b568d9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 43161 } }
I20260809 15:34:06.770545 29685 raft_consensus.cc:374] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 46d6c3dd213444ce9ff1a741489d7df2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:34:06.770613 29685 raft_consensus.cc:729] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 46d6c3dd213444ce9ff1a741489d7df2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46d6c3dd213444ce9ff1a741489d7df2, State: Initialized, Role: FOLLOWER
I20260809 15:34:06.771096 29685 consensus_queue.cc:260] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 46d6c3dd213444ce9ff1a741489d7df2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6c3dd213444ce9ff1a741489d7df2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42971 } } peers { permanent_uuid: "c25e03355bfd40b38652c085bd3a1292" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44991 } } peers { permanent_uuid: "36aa1caa9f1a43808493994d31b568d9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 43161 } }
I20260809 15:34:06.771715 29671 heartbeater.cc:503] Master 127.11.146.62:43907 was elected leader, sending a full tablet report...
I20260809 15:34:06.773167 29685 ts_tablet_manager.cc:1428] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 46d6c3dd213444ce9ff1a741489d7df2: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 15:34:06.774704 29345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:06.769829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:43161 (local address 127.11.146.1:59373)
0809 15:34:06.770113 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:06.770139 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:06.770221 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:06.770767 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:06.770770 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:06.770788 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:34:06.770898 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:06.770905 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.771894 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.771899 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:06.773291 (+ 1392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:06.773303 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.774221 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.774227 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:06.774339 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:06.774389 (+ 50us) client_negotiation.cc:769] Sending connection context
0809 15:34:06.774469 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 15:34:06.774555 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"mutex_wait_us":71,"thread_start_us":96,"threads_started":1}
I20260809 15:34:06.774721 29509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:06.770367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:59373 (local address 127.11.146.2:43161)
0809 15:34:06.770533 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:06.770538 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:06.770549 (+ 11us) server_negotiation.cc:407] Connection header received
0809 15:34:06.770589 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:06.770592 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:06.770640 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:06.770735 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:34:06.771023 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.771763 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.773441 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.774089 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.774202 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:06.774329 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:06.774497 (+ 168us) server_negotiation.cc:299] Negotiation successful
0809 15:34:06.774585 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 15:34:06.774791 29681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:06.769830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:47259 (local address 127.11.146.3:42971)
0809 15:34:06.769960 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:06.769965 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:06.770201 (+ 236us) server_negotiation.cc:407] Connection header received
0809 15:34:06.770372 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:06.770376 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:06.770419 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:06.770499 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:34:06.770807 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.771564 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.773466 (+ 1902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.774091 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.774187 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:06.774238 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:06.774575 (+ 337us) server_negotiation.cc:299] Negotiation successful
0809 15:34:06.774655 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 15:34:06.775120 29688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:06.769732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:42971 (local address 127.11.146.1:47259)
0809 15:34:06.770092 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:06.770105 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:06.770241 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:06.770532 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:06.770536 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:06.770556 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:34:06.770677 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:06.770687 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.771713 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.771716 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:06.773305 (+ 1589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:06.773311 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.774313 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.774316 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:06.774394 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:06.774413 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 15:34:06.774559 (+ 146us) client_negotiation.cc:240] Negotiation successful
0809 15:34:06.774653 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"mutex_wait_us":111}
I20260809 15:34:06.775308 29447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f20ffaaf93ce4ee8a48a08547c81c9d1" candidate_uuid: "c25e03355bfd40b38652c085bd3a1292" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36aa1caa9f1a43808493994d31b568d9" is_pre_election: true
I20260809 15:34:06.775606 29447 raft_consensus.cc:2454] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 36aa1caa9f1a43808493994d31b568d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c25e03355bfd40b38652c085bd3a1292 in term 0.
I20260809 15:34:06.776062 29215 leader_election.cc:302] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36aa1caa9f1a43808493994d31b568d9, c25e03355bfd40b38652c085bd3a1292; no voters:
I20260809 15:34:06.776248 29610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f20ffaaf93ce4ee8a48a08547c81c9d1" candidate_uuid: "c25e03355bfd40b38652c085bd3a1292" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d6c3dd213444ce9ff1a741489d7df2" is_pre_election: true
I20260809 15:34:06.776355 29348 raft_consensus.cc:2781] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:34:06.776436 29348 raft_consensus.cc:482] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:34:06.776491 29348 raft_consensus.cc:3037] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:34:06.776484 29610 raft_consensus.cc:2454] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 46d6c3dd213444ce9ff1a741489d7df2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c25e03355bfd40b38652c085bd3a1292 in term 0.
I20260809 15:34:06.777607 29348 raft_consensus.cc:504] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6c3dd213444ce9ff1a741489d7df2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42971 } } peers { permanent_uuid: "c25e03355bfd40b38652c085bd3a1292" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44991 } } peers { permanent_uuid: "36aa1caa9f1a43808493994d31b568d9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 43161 } }
I20260809 15:34:06.777946 29348 leader_election.cc:288] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [CANDIDATE]: Term 1 election: Requested vote from peers 46d6c3dd213444ce9ff1a741489d7df2 (127.11.146.3:42971), 36aa1caa9f1a43808493994d31b568d9 (127.11.146.2:43161)
I20260809 15:34:06.778270 29610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f20ffaaf93ce4ee8a48a08547c81c9d1" candidate_uuid: "c25e03355bfd40b38652c085bd3a1292" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46d6c3dd213444ce9ff1a741489d7df2"
I20260809 15:34:06.778370 29610 raft_consensus.cc:3037] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 46d6c3dd213444ce9ff1a741489d7df2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:34:06.778334 29447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f20ffaaf93ce4ee8a48a08547c81c9d1" candidate_uuid: "c25e03355bfd40b38652c085bd3a1292" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36aa1caa9f1a43808493994d31b568d9"
I20260809 15:34:06.778493 29447 raft_consensus.cc:3037] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 36aa1caa9f1a43808493994d31b568d9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:34:06.779274 29610 raft_consensus.cc:2454] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 46d6c3dd213444ce9ff1a741489d7df2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c25e03355bfd40b38652c085bd3a1292 in term 1.
I20260809 15:34:06.779589 29212 leader_election.cc:302] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46d6c3dd213444ce9ff1a741489d7df2, c25e03355bfd40b38652c085bd3a1292; no voters:
I20260809 15:34:06.779644 29447 raft_consensus.cc:2454] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 36aa1caa9f1a43808493994d31b568d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c25e03355bfd40b38652c085bd3a1292 in term 1.
I20260809 15:34:06.779762 29348 raft_consensus.cc:2781] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:34:06.779971 29348 raft_consensus.cc:686] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [term 1 LEADER]: Becoming Leader. State: Replica: c25e03355bfd40b38652c085bd3a1292, State: Running, Role: LEADER
I20260809 15:34:06.780228 29348 consensus_queue.cc:237] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6c3dd213444ce9ff1a741489d7df2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42971 } } peers { permanent_uuid: "c25e03355bfd40b38652c085bd3a1292" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44991 } } peers { permanent_uuid: "36aa1caa9f1a43808493994d31b568d9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 43161 } }
I20260809 15:34:06.782930 29129 catalog_manager.cc:5495] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 reported cstate change: term changed from 0 to 1, leader changed from <none> to c25e03355bfd40b38652c085bd3a1292 (127.11.146.1). New cstate: current_term: 1 leader_uuid: "c25e03355bfd40b38652c085bd3a1292" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6c3dd213444ce9ff1a741489d7df2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c25e03355bfd40b38652c085bd3a1292" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36aa1caa9f1a43808493994d31b568d9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 43161 } health_report { overall_health: UNKNOWN } } }
I20260809 15:34:06.797569 29350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:06.794004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42790 (local address 127.11.146.1:44991)
0809 15:34:06.794133 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:06.794139 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:06.794193 (+ 54us) server_negotiation.cc:407] Connection header received
0809 15:34:06.794390 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:06.794392 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:06.794441 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:06.794563 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:34:06.794803 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.795326 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.796172 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:06.796401 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:06.796532 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:06.796807 (+ 275us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:34:06.797184 (+ 377us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:34:06.797309 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:06.797371 (+ 62us) server_negotiation.cc:299] Negotiation successful
0809 15:34:06.797421 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 15:34:06.801184 29447 raft_consensus.cc:1261] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 36aa1caa9f1a43808493994d31b568d9 [term 1 FOLLOWER]: Refusing update from remote peer c25e03355bfd40b38652c085bd3a1292: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:34:06.801189 29610 raft_consensus.cc:1261] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 46d6c3dd213444ce9ff1a741489d7df2 [term 1 FOLLOWER]: Refusing update from remote peer c25e03355bfd40b38652c085bd3a1292: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:34:06.801831 29348 consensus_queue.cc:1035] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46d6c3dd213444ce9ff1a741489d7df2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:34:06.802066 29690 consensus_queue.cc:1035] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36aa1caa9f1a43808493994d31b568d9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 43161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 15:34:06.805311 29342 tablet.cc:2369] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:34:06.814913 29695 mvcc.cc:205] Tried to move back new op lower bound from 7316642393291661312 to 7316642393214476288. Current Snapshot: MvccSnapshot[applied={T|T < 7316642393291661312 or (T in {7316642393291661312})}]
I20260809 15:34:06.815765 29130 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53208:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:34:06.815937 29130 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53208:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:34:06.818310 29130 catalog_manager.cc:5782] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5: Sending DeleteTablet for 3 replicas of tablet f20ffaaf93ce4ee8a48a08547c81c9d1
I20260809 15:34:06.819096 29586 tablet_service.cc:1514] Processing DeleteTablet for tablet f20ffaaf93ce4ee8a48a08547c81c9d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:34:06 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:52706
I20260809 15:34:06.819195 29426 tablet_service.cc:1514] Processing DeleteTablet for tablet f20ffaaf93ce4ee8a48a08547c81c9d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:34:06 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:38642
I20260809 15:34:06.819404 29510 tablet_replica.cc:330] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 36aa1caa9f1a43808493994d31b568d9: stopping tablet replica
I20260809 15:34:06.819540 29510 raft_consensus.cc:2229] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 36aa1caa9f1a43808493994d31b568d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:34:06.819538 29268 tablet_service.cc:1514] Processing DeleteTablet for tablet f20ffaaf93ce4ee8a48a08547c81c9d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:34:06 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:42776
I20260809 15:34:06.819700 29351 tablet_replica.cc:330] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292: stopping tablet replica
I20260809 15:34:06.819705 29510 raft_consensus.cc:2258] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 36aa1caa9f1a43808493994d31b568d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:34:06.819804 29351 raft_consensus.cc:2229] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:34:06.819967 29704 tablet_replica.cc:330] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 46d6c3dd213444ce9ff1a741489d7df2: stopping tablet replica
I20260809 15:34:06.820116 29351 raft_consensus.cc:2258] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:34:06.820550 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 29174
I20260809 15:34:06.820732 29510 ts_tablet_manager.cc:1905] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 36aa1caa9f1a43808493994d31b568d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:34:06.823597 29510 ts_tablet_manager.cc:1918] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 36aa1caa9f1a43808493994d31b568d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:34:06.823712 29510 log.cc:1196] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 36aa1caa9f1a43808493994d31b568d9: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/wal/wals/f20ffaaf93ce4ee8a48a08547c81c9d1
I20260809 15:34:06.823979 29510 ts_tablet_manager.cc:1939] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 36aa1caa9f1a43808493994d31b568d9: Deleting consensus metadata
I20260809 15:34:06.824961 29114 catalog_manager.cc:4841] TS 36aa1caa9f1a43808493994d31b568d9 (127.11.146.2:43161): tablet f20ffaaf93ce4ee8a48a08547c81c9d1 (table test-table [id=ddf38404fd60476383851ef1bb5dddc4]) successfully deleted
I20260809 15:34:06.820339 29704 raft_consensus.cc:2229] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 46d6c3dd213444ce9ff1a741489d7df2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:34:06.828516 29704 raft_consensus.cc:2258] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 46d6c3dd213444ce9ff1a741489d7df2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:34:06.829880 29704 ts_tablet_manager.cc:1905] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 46d6c3dd213444ce9ff1a741489d7df2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260809 15:34:06.831192 29111 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.146.1:44991 (error 108)
I20260809 15:34:06.831496 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 29347
I20260809 15:34:06.835314 29349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:06.834988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:44991 (local address 127.0.0.1:42800)
0809 15:34:06.835123 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:06.835209 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.1:44991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 15:34:06.835502 29111 catalog_manager.cc:4584] TS c25e03355bfd40b38652c085bd3a1292 (127.11.146.1:44991): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f20ffaaf93ce4ee8a48a08547c81c9d1: Network error: Client connection negotiation failed: client connection to 127.11.146.1:44991: connect: Connection refused (error 111)
I20260809 15:34:06.836607 29704 ts_tablet_manager.cc:1918] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 46d6c3dd213444ce9ff1a741489d7df2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:34:06.836714 29704 log.cc:1196] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 46d6c3dd213444ce9ff1a741489d7df2: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/wal/wals/f20ffaaf93ce4ee8a48a08547c81c9d1
I20260809 15:34:06.837087 29704 ts_tablet_manager.cc:1939] T f20ffaaf93ce4ee8a48a08547c81c9d1 P 46d6c3dd213444ce9ff1a741489d7df2: Deleting consensus metadata
I20260809 15:34:06.838461 29109 catalog_manager.cc:4841] TS 46d6c3dd213444ce9ff1a741489d7df2 (127.11.146.3:42971): tablet f20ffaaf93ce4ee8a48a08547c81c9d1 (table test-table [id=ddf38404fd60476383851ef1bb5dddc4]) successfully deleted
I20260809 15:34:06.842458 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 29508
I20260809 15:34:06.849448 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 29092
I20260809 15:34:26.858500 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:43907
--webserver_interface=127.11.146.62
--webserver_port=33511
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:45395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:43907
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:34:26.968130 29706 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:26.968405 29706 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:26.968508 29706 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:26.972410 29706 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 15:34:26.972476 29706 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 15:34:26.972501 29706 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 15:34:26.972535 29706 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:34:26.972574 29706 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:26.972613 29706 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:26.972645 29706 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:34:26.972674 29706 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:34:26.977609 29706 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:45395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:43907
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:43907
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=33511
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29706
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:26.978549 29706 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:26.979451 29706 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 15:34:26.987764 29706 server_base.cc:1034] running on GCE node
W20260809 15:34:26.987897 29712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:26.988026 29716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:26.987828 29713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:26.988688 29706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:26.989753 29706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:26.990964 29706 hybrid_clock.cc:648] HybridClock initialized: now 1786289666990924 us; error 49 us; skew 500 ppm
Aug 09 15:34:26 dist-test-slave-1jjb krb5kdc[28459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289666, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:34:26.997947 29706 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:34:26.998881 29706 webserver.cc:460] Webserver started at http://127.11.146.62:33511/ using document root <none> and password file <none>
I20260809 15:34:26.999424 29706 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:26.999516 29706 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:27.003330 29706 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:34:27.005563 29725 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:27.006753 29706 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:34:27.006916 29706 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "eb738e2dbb294df1bfa4d23f04e490e5"
format_stamp: "Formatted at 2026-08-09 15:33:44 on dist-test-slave-1jjb"
server_key: "f055ffd663695050491ef8ef93cec8b4"
server_key_iv: "9ffe9bc600ba56e05bfe21b3ff0e5f7a"
server_key_version: "encryptionkey@0"
I20260809 15:34:27.007479 29706 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:27.018828 29706 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:27.021512 29706 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:27.021745 29706 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:27.028859 29706 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:43907
I20260809 15:34:27.029187 29784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:43907 every 8 connection(s)
I20260809 15:34:27.030107 29706 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:34:27.034502 29786 sys_catalog.cc:263] Verifying existing consensus state
I20260809 15:34:27.036038 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 29706
I20260809 15:34:27.036258 29786 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5: Bootstrap starting.
I20260809 15:34:27.036525 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.1:44991
--local_ip_for_outbound_sockets=127.11.146.1
--tserver_master_addrs=127.11.146.62:43907
--webserver_port=46589
--webserver_interface=127.11.146.1
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:45395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:34:27.053639 29786 log.cc:824] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5: Log is configured to *not* fsync() on all Append() calls
I20260809 15:34:27.064555 29786 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 15:34:27.065028 29786 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5: Bootstrap complete.
I20260809 15:34:27.069087 29786 raft_consensus.cc:348] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb738e2dbb294df1bfa4d23f04e490e5" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43907 } }
I20260809 15:34:27.069447 29786 raft_consensus.cc:729] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb738e2dbb294df1bfa4d23f04e490e5, State: Initialized, Role: FOLLOWER
I20260809 15:34:27.069965 29786 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb738e2dbb294df1bfa4d23f04e490e5" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43907 } }
I20260809 15:34:27.070089 29786 raft_consensus.cc:388] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:34:27.070173 29786 raft_consensus.cc:482] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:34:27.070289 29786 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [term 2 FOLLOWER]: Advancing to term 3
I20260809 15:34:27.072232 29786 raft_consensus.cc:504] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb738e2dbb294df1bfa4d23f04e490e5" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43907 } }
I20260809 15:34:27.072556 29786 leader_election.cc:302] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eb738e2dbb294df1bfa4d23f04e490e5; no voters:
I20260809 15:34:27.072870 29786 leader_election.cc:288] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 15:34:27.072999 29790 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260809 15:34:27.073271 29790 raft_consensus.cc:686] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [term 3 LEADER]: Becoming Leader. State: Replica: eb738e2dbb294df1bfa4d23f04e490e5, State: Running, Role: LEADER
I20260809 15:34:27.073575 29790 consensus_queue.cc:237] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb738e2dbb294df1bfa4d23f04e490e5" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43907 } }
I20260809 15:34:27.074082 29786 sys_catalog.cc:564] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:34:27.074508 29793 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb738e2dbb294df1bfa4d23f04e490e5. Latest consensus state: current_term: 3 leader_uuid: "eb738e2dbb294df1bfa4d23f04e490e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb738e2dbb294df1bfa4d23f04e490e5" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43907 } } }
I20260809 15:34:27.074630 29793 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [sys.catalog]: This master's current role is: LEADER
I20260809 15:34:27.074918 29792 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "eb738e2dbb294df1bfa4d23f04e490e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb738e2dbb294df1bfa4d23f04e490e5" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43907 } } }
I20260809 15:34:27.075011 29795 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:34:27.075026 29792 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5 [sys.catalog]: This master's current role is: LEADER
I20260809 15:34:27.079981 29795 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:34:27.080659 29795 catalog_manager.cc:1259] Loaded cluster ID: 83e1f3d81f5c401cb7a610b3c5a16c84
I20260809 15:34:27.080730 29795 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:34:27.083539 29795 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:34:27.084280 29795 catalog_manager.cc:5879] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5: Loaded TSK: 0
I20260809 15:34:27.084359 29795 catalog_manager.cc:5879] T 00000000000000000000000000000000 P eb738e2dbb294df1bfa4d23f04e490e5: Loaded TSK: 1
F20260809 15:34:27.085072 29795 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f584336a9ad google::LogMessage::Fail() at ??:0
@ 0x7f584336d88a google::LogMessage::SendToLog() at ??:0
@ 0x7f584336a4de google::LogMessage::Flush() at ??:0
@ 0x7f584336ba19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f584602e18d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f5846026f0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f584dcd37bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f584dcad99c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f584dcae178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7f584dcefdf8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f584dd0e82b std::function<>::operator()() at ??:0
@ 0x7f584dcadb4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f584dcaef3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f584dcab579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f584dcef640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f58455bc3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f58455bcc83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f58455be3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f58455ad512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f5846bf16db start_thread at ??:0
@ 0x7f5841e6861f clone at ??:0
W20260809 15:34:27.175458 29788 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:27.175730 29788 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:27.175772 29788 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:27.179610 29788 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:27.179677 29788 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:27.179749 29788 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.1
I20260809 15:34:27.185061 29788 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:45395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.1:44991
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.146.1
--webserver_port=46589
--tserver_master_addrs=127.11.146.62:43907
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29788
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.1
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:27.185881 29788 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:27.186782 29788 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:34:27.196075 29839 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:27.196208 29840 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:27.196336 29788 server_base.cc:1034] running on GCE node
W20260809 15:34:27.196499 29843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:27.196980 29788 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:27.197743 29788 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:27.198951 29788 hybrid_clock.cc:648] HybridClock initialized: now 1786289667198918 us; error 39 us; skew 500 ppm
Aug 09 15:34:27 dist-test-slave-1jjb krb5kdc[28459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289667, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:34:27.202387 29788 init.cc:377] Logged in from keytab as kudu/127.11.146.1@KRBTEST.COM (short username kudu)
I20260809 15:34:27.203445 29788 webserver.cc:460] Webserver started at http://127.11.146.1:46589/ using document root <none> and password file <none>
I20260809 15:34:27.204140 29788 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:27.204226 29788 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:27.209017 29788 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 15:34:27.211793 29851 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:27.213354 29788 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 15:34:27.213467 29788 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/wal
uuid: "c25e03355bfd40b38652c085bd3a1292"
format_stamp: "Formatted at 2026-08-09 15:33:45 on dist-test-slave-1jjb"
server_key: "f389bea0d8e245b20c10ffda184b12a6"
server_key_iv: "0fe8486d48cde76175e2b3ec16a8dd46"
server_key_version: "encryptionkey@0"
I20260809 15:34:27.214103 29788 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:27.249142 29788 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:27.252774 29788 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:27.252977 29788 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:27.253716 29788 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:34:27.255034 29859 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 15:34:27.259126 29788 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 15:34:27.259198 29788 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.001s sys 0.000s
I20260809 15:34:27.259262 29788 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 15:34:27.261547 29788 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 15:34:27.261606 29788 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260809 15:34:27.261981 29859 tablet_bootstrap.cc:492] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292: Bootstrap starting.
I20260809 15:34:27.268324 29859 log.cc:824] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292: Log is configured to *not* fsync() on all Append() calls
I20260809 15:34:27.271905 29788 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.1:44991
I20260809 15:34:27.272183 29991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.1:44991 every 8 connection(s)
I20260809 15:34:27.272907 29788 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
I20260809 15:34:27.274580 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 29788
I20260809 15:34:27.275041 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.2:43161
--local_ip_for_outbound_sockets=127.11.146.2
--tserver_master_addrs=127.11.146.62:43907
--webserver_port=42943
--webserver_interface=127.11.146.2
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:45395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:34:27.277295 29859 tablet_bootstrap.cc:492] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 15:34:27.277716 29859 tablet_bootstrap.cc:492] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292: Bootstrap complete.
I20260809 15:34:27.278072 29859 ts_tablet_manager.cc:1397] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292: Time spent bootstrapping tablet: real 0.016s user 0.015s sys 0.000s
I20260809 15:34:27.282094 29859 raft_consensus.cc:348] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6c3dd213444ce9ff1a741489d7df2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42971 } } peers { permanent_uuid: "c25e03355bfd40b38652c085bd3a1292" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44991 } } peers { permanent_uuid: "36aa1caa9f1a43808493994d31b568d9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 43161 } }
I20260809 15:34:27.282775 29859 raft_consensus.cc:729] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c25e03355bfd40b38652c085bd3a1292, State: Initialized, Role: FOLLOWER
I20260809 15:34:27.283341 29859 consensus_queue.cc:260] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6c3dd213444ce9ff1a741489d7df2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42971 } } peers { permanent_uuid: "c25e03355bfd40b38652c085bd3a1292" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44991 } } peers { permanent_uuid: "36aa1caa9f1a43808493994d31b568d9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 43161 } }
I20260809 15:34:27.284536 29859 ts_tablet_manager.cc:1428] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260809 15:34:27.332604 29994 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:34:27.274907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.1:51017)
0809 15:34:27.276321 (+ 1414us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:27.276380 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:27.277535 (+ 1155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:27.331622 (+ 54087us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":1133,"thread_start_us":149,"threads_started":1}
W20260809 15:34:27.333245 29992 heartbeater.cc:644] Failed to heartbeat to 127.11.146.62:43907 (0 consecutive failures): Network error: Failed to ping master at 127.11.146.62:43907: Client connection negotiation failed: client connection to 127.11.146.62:43907: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 15:34:27.333981 29994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:27.333698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.1:48849)
0809 15:34:27.333837 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:27.333917 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260809 15:34:27.334686 29994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:27.334438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.1:33303)
0809 15:34:27.334556 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:27.334607 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 15:34:27.334971 29992 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 15:34:27.390015 29995 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:27.390237 29995 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:27.390275 29995 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:27.394191 29995 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:27.394236 29995 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:27.394333 29995 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.2
I20260809 15:34:27.399401 29995 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:45395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.2:43161
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.146.2
--webserver_port=42943
--tserver_master_addrs=127.11.146.62:43907
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29995
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.2
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:27.400380 29995 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:27.401387 29995 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:34:27.410869 30003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:27.410964 30007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:27.410920 29995 server_base.cc:1034] running on GCE node
W20260809 15:34:27.411139 30005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:27.411561 29995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:27.412209 29995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:27.413385 29995 hybrid_clock.cc:648] HybridClock initialized: now 1786289667413370 us; error 32 us; skew 500 ppm
Aug 09 15:34:27 dist-test-slave-1jjb krb5kdc[28459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289667, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:34:27.415952 29995 init.cc:377] Logged in from keytab as kudu/127.11.146.2@KRBTEST.COM (short username kudu)
I20260809 15:34:27.416775 29995 webserver.cc:460] Webserver started at http://127.11.146.2:42943/ using document root <none> and password file <none>
I20260809 15:34:27.417372 29995 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:27.417465 29995 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:27.421175 29995 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260809 15:34:27.423084 30016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:27.424268 29995 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:34:27.424399 29995 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/wal
uuid: "36aa1caa9f1a43808493994d31b568d9"
format_stamp: "Formatted at 2026-08-09 15:33:45 on dist-test-slave-1jjb"
server_key: "a822ef6925cb57bf7a4238a5c5232982"
server_key_iv: "25ab88274f12b4004c5e7fc021d00fd4"
server_key_version: "encryptionkey@0"
I20260809 15:34:27.424983 29995 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:27.441751 29995 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:27.444309 29995 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:27.444499 29995 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:27.445048 29995 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:34:27.445796 29995 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:34:27.445868 29995 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:27.445940 29995 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:34:27.445983 29995 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:27.454910 29995 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.2:43161
I20260809 15:34:27.454958 30140 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.2:43161 every 8 connection(s)
I20260809 15:34:27.455847 29995 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
I20260809 15:34:27.459272 30143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:27.457935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.2:35069)
0809 15:34:27.458563 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:27.458656 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":108,"threads_started":1}
W20260809 15:34:27.459717 30141 heartbeater.cc:644] Failed to heartbeat to 127.11.146.62:43907 (0 consecutive failures): Network error: Failed to ping master at 127.11.146.62:43907: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
I20260809 15:34:27.460309 30143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:27.460068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.2:58041)
0809 15:34:27.460208 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:27.460261 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260809 15:34:27.460909 30143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:27.460700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.2:58885)
0809 15:34:27.460804 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:27.460848 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 15:34:27.461087 30141 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 15:34:27.464421 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 29995
I20260809 15:34:27.464823 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.3:42971
--local_ip_for_outbound_sockets=127.11.146.3
--tserver_master_addrs=127.11.146.62:43907
--webserver_port=41597
--webserver_interface=127.11.146.3
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:45395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:34:27.581379 30144 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:27.581682 30144 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:27.581768 30144 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:27.585682 30144 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:27.585736 30144 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:27.585856 30144 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.3
I20260809 15:34:27.590675 30144 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:45395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.3:42971
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.146.3
--webserver_port=41597
--tserver_master_addrs=127.11.146.62:43907
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30144
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.3
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:27.591553 30144 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:27.592628 30144 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:34:27.602272 30153 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:27.602291 30150 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:27.602372 30149 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:27.602463 30144 server_base.cc:1034] running on GCE node
I20260809 15:34:27.603003 30144 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:27.603632 30144 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:27.604811 30144 hybrid_clock.cc:648] HybridClock initialized: now 1786289667604784 us; error 34 us; skew 500 ppm
Aug 09 15:34:27 dist-test-slave-1jjb krb5kdc[28459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289667, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:34:27.607637 30144 init.cc:377] Logged in from keytab as kudu/127.11.146.3@KRBTEST.COM (short username kudu)
I20260809 15:34:27.608604 30144 webserver.cc:460] Webserver started at http://127.11.146.3:41597/ using document root <none> and password file <none>
I20260809 15:34:27.609169 30144 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:27.609268 30144 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:27.613016 30144 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:34:27.615064 30162 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:27.616357 30144 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:34:27.616488 30144 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/wal
uuid: "46d6c3dd213444ce9ff1a741489d7df2"
format_stamp: "Formatted at 2026-08-09 15:33:45 on dist-test-slave-1jjb"
server_key: "2b1b42115cce740bde0ed3c6bcc74df7"
server_key_iv: "ea4b9f56e53ddcd2a833251dba07c4d7"
server_key_version: "encryptionkey@0"
I20260809 15:34:27.616991 30144 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:27.629441 30144 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:27.631946 30144 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:27.632179 30144 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:27.632781 30144 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:34:27.633555 30144 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:34:27.633637 30144 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:27.633718 30144 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:34:27.633765 30144 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:27.642423 30144 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.3:42971
I20260809 15:34:27.642468 30293 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.3:42971 every 8 connection(s)
I20260809 15:34:27.643366 30144 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
I20260809 15:34:27.646685 30296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:27.645339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.3:55081)
0809 15:34:27.645964 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:27.646057 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":111,"threads_started":1}
W20260809 15:34:27.647164 30294 heartbeater.cc:644] Failed to heartbeat to 127.11.146.62:43907 (0 consecutive failures): Network error: Failed to ping master at 127.11.146.62:43907: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
I20260809 15:34:27.647719 30296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:27.647509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.3:49345)
0809 15:34:27.647613 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:27.647661 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260809 15:34:27.648319 30296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:27.648141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.3:40715)
0809 15:34:27.648233 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:27.648273 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260809 15:34:27.648500 30294 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 15:34:27.652783 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 30144
I20260809 15:34:28.336144 30299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:28.335593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.1:53083)
0809 15:34:28.335891 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:28.335967 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":87,"threads_started":1}
I20260809 15:34:28.461941 30301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:28.461553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.2:50673)
0809 15:34:28.461805 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:28.461852 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":67,"threads_started":1}
I20260809 15:34:28.649359 30302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:28.648972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.3:59279)
0809 15:34:28.649209 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:28.649262 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":78,"threads_started":1}
I20260809 15:34:28.714257 30303 raft_consensus.cc:482] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:34:28.714507 30303 raft_consensus.cc:504] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6c3dd213444ce9ff1a741489d7df2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42971 } } peers { permanent_uuid: "c25e03355bfd40b38652c085bd3a1292" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44991 } } peers { permanent_uuid: "36aa1caa9f1a43808493994d31b568d9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 43161 } }
I20260809 15:34:28.715875 30303 leader_election.cc:288] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 46d6c3dd213444ce9ff1a741489d7df2 (127.11.146.3:42971), 36aa1caa9f1a43808493994d31b568d9 (127.11.146.2:43161)
Aug 09 15:34:28 dist-test-slave-1jjb krb5kdc[28459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289667, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for kudu/127.11.146.3@KRBTEST.COM
Aug 09 15:34:28 dist-test-slave-1jjb krb5kdc[28459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289667, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for kudu/127.11.146.2@KRBTEST.COM
I20260809 15:34:28.731710 30299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:28.716113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:42971 (local address 127.11.146.1:37209)
0809 15:34:28.716407 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:28.716425 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:28.716538 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:28.719268 (+ 2730us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:28.719274 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:28.719821 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:34:28.720551 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:28.720576 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:28.722148 (+ 1572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:28.722151 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:28.723140 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:28.723150 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:28.724030 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:28.724033 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:28.724243 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:28.724881 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:34:28.724901 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:34:28.726737 (+ 1836us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:34:28.729217 (+ 2480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:34:28.729226 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:34:28.729241 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:34:28.729547 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:34:28.729950 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:34:28.729952 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:34:28.729954 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:34:28.730163 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:34:28.730930 (+ 767us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:34:28.730936 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:34:28.731206 (+ 270us) client_negotiation.cc:769] Sending connection context
0809 15:34:28.731367 (+ 161us) client_negotiation.cc:240] Negotiation successful
0809 15:34:28.731581 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"mutex_wait_us":3}
I20260809 15:34:28.732380 30305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:28.716133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:43161 (local address 127.11.146.1:41755)
0809 15:34:28.716923 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:28.716939 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:28.717051 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:28.719425 (+ 2374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:28.719428 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:28.720816 (+ 1388us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:34:28.720941 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:28.720949 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:28.722806 (+ 1857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:28.722809 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:28.723482 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:28.723490 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:28.724793 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:28.724799 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:28.724904 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:28.725288 (+ 384us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:34:28.725303 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:34:28.727079 (+ 1776us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:34:28.729481 (+ 2402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:34:28.729484 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:34:28.729486 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:34:28.729718 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:34:28.730085 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:34:28.730088 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:34:28.730090 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:34:28.730164 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:34:28.730930 (+ 766us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:34:28.730936 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:34:28.731925 (+ 989us) client_negotiation.cc:769] Sending connection context
0809 15:34:28.732038 (+ 113us) client_negotiation.cc:240] Negotiation successful
0809 15:34:28.732216 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":680,"mutex_wait_us":1361,"thread_start_us":71,"threads_started":1}
I20260809 15:34:28.732671 30304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:28.716268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:41755 (local address 127.11.146.2:43161)
0809 15:34:28.717236 (+ 968us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:28.717265 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:28.717316 (+ 51us) server_negotiation.cc:407] Connection header received
0809 15:34:28.718545 (+ 1229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:28.718557 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:28.719112 (+ 555us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:28.719776 (+ 664us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:28.721112 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:28.722670 (+ 1558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:28.723594 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:28.724377 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:28.724530 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:28.727288 (+ 2758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:28.727297 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:28.727312 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:34:28.727353 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:28.729380 (+ 2027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:28.729820 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:28.729825 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:28.729830 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:28.729993 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:28.730292 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:28.730295 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:28.730297 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:28.730790 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:28.731029 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:28.732219 (+ 1190us) server_negotiation.cc:299] Negotiation successful
0809 15:34:28.732496 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":805,"thread_start_us":113,"threads_started":1}
I20260809 15:34:28.732750 30306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:28.717092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:37209 (local address 127.11.146.3:42971)
0809 15:34:28.717445 (+ 353us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:28.717468 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:28.717507 (+ 39us) server_negotiation.cc:407] Connection header received
0809 15:34:28.718413 (+ 906us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:28.718420 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:28.718886 (+ 466us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:28.719219 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:28.720748 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:28.722016 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:28.723261 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:28.723898 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:28.724131 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:28.726970 (+ 2839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:28.726975 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:28.726985 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:34:28.727011 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:28.729065 (+ 2054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:28.729672 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:28.729677 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:28.729681 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:28.729833 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:28.730294 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:28.730297 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:28.730299 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:28.730796 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:28.732192 (+ 1396us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:28.732329 (+ 137us) server_negotiation.cc:299] Negotiation successful
0809 15:34:28.732618 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":143,"threads_started":1}
W20260809 15:34:28.734879 29856 leader_election.cc:341] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36aa1caa9f1a43808493994d31b568d9 (127.11.146.2:43161): Not found: Tablet not found: f20ffaaf93ce4ee8a48a08547c81c9d1
W20260809 15:34:28.735067 29852 leader_election.cc:341] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 46d6c3dd213444ce9ff1a741489d7df2 (127.11.146.3:42971): Not found: Tablet not found: f20ffaaf93ce4ee8a48a08547c81c9d1
I20260809 15:34:28.735172 29852 leader_election.cc:302] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c25e03355bfd40b38652c085bd3a1292; no voters: 36aa1caa9f1a43808493994d31b568d9, 46d6c3dd213444ce9ff1a741489d7df2
I20260809 15:34:28.735438 30303 raft_consensus.cc:2726] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 15:34:29.337357 30307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:29.336969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.1:45089)
0809 15:34:29.337212 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:29.337264 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":72,"threads_started":1}
I20260809 15:34:29.462942 30309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:29.462549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.2:33865)
0809 15:34:29.462778 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:29.462825 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":77,"threads_started":1}
I20260809 15:34:29.650357 30311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:29.650019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.3:36931)
0809 15:34:29.650232 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:29.650281 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":65,"threads_started":1}
I20260809 15:34:30.338485 30312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:30.338047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.1:54665)
0809 15:34:30.338309 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:30.338357 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":99,"threads_started":1}
I20260809 15:34:30.464003 30313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:30.463652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.2:58099)
0809 15:34:30.463869 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:30.463921 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":68,"threads_started":1}
I20260809 15:34:30.651528 30314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:30.651155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.3:35583)
0809 15:34:30.651397 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:30.651445 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":83,"threads_started":1}
I20260809 15:34:30.936820 30315 raft_consensus.cc:482] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:34:30.936975 30315 raft_consensus.cc:504] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6c3dd213444ce9ff1a741489d7df2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42971 } } peers { permanent_uuid: "c25e03355bfd40b38652c085bd3a1292" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44991 } } peers { permanent_uuid: "36aa1caa9f1a43808493994d31b568d9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 43161 } }
I20260809 15:34:30.937398 30315 leader_election.cc:288] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 46d6c3dd213444ce9ff1a741489d7df2 (127.11.146.3:42971), 36aa1caa9f1a43808493994d31b568d9 (127.11.146.2:43161)
W20260809 15:34:30.938297 29852 leader_election.cc:341] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 46d6c3dd213444ce9ff1a741489d7df2 (127.11.146.3:42971): Not found: Tablet not found: f20ffaaf93ce4ee8a48a08547c81c9d1
W20260809 15:34:30.938385 29856 leader_election.cc:341] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36aa1caa9f1a43808493994d31b568d9 (127.11.146.2:43161): Not found: Tablet not found: f20ffaaf93ce4ee8a48a08547c81c9d1
I20260809 15:34:30.938490 29856 leader_election.cc:302] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c25e03355bfd40b38652c085bd3a1292; no voters: 36aa1caa9f1a43808493994d31b568d9, 46d6c3dd213444ce9ff1a741489d7df2
I20260809 15:34:30.938655 30315 raft_consensus.cc:2726] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 15:34:31.339643 30316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:31.339249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.1:50819)
0809 15:34:31.339488 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:31.339540 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":66,"threads_started":1}
I20260809 15:34:31.465014 30317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:31.464663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.2:40681)
0809 15:34:31.464891 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:31.464940 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":66,"threads_started":1}
I20260809 15:34:31.652678 30318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:31.652301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.3:40267)
0809 15:34:31.652539 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:31.652592 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":90,"threads_started":1}
I20260809 15:34:32.341097 30319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:32.340565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.1:52579)
0809 15:34:32.340892 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:32.340973 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":94,"threads_started":1}
I20260809 15:34:32.463002 30321 raft_consensus.cc:482] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:34:32.463122 30321 raft_consensus.cc:504] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6c3dd213444ce9ff1a741489d7df2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42971 } } peers { permanent_uuid: "c25e03355bfd40b38652c085bd3a1292" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44991 } } peers { permanent_uuid: "36aa1caa9f1a43808493994d31b568d9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 43161 } }
I20260809 15:34:32.463500 30321 leader_election.cc:288] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 46d6c3dd213444ce9ff1a741489d7df2 (127.11.146.3:42971), 36aa1caa9f1a43808493994d31b568d9 (127.11.146.2:43161)
W20260809 15:34:32.464285 29856 leader_election.cc:341] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36aa1caa9f1a43808493994d31b568d9 (127.11.146.2:43161): Not found: Tablet not found: f20ffaaf93ce4ee8a48a08547c81c9d1
W20260809 15:34:32.464447 29852 leader_election.cc:341] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 46d6c3dd213444ce9ff1a741489d7df2 (127.11.146.3:42971): Not found: Tablet not found: f20ffaaf93ce4ee8a48a08547c81c9d1
I20260809 15:34:32.464550 29852 leader_election.cc:302] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c25e03355bfd40b38652c085bd3a1292; no voters: 36aa1caa9f1a43808493994d31b568d9, 46d6c3dd213444ce9ff1a741489d7df2
I20260809 15:34:32.464761 30321 raft_consensus.cc:2726] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 15:34:32.466027 30322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:32.465648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.2:55531)
0809 15:34:32.465885 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:32.465943 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":101,"threads_started":1}
I20260809 15:34:32.654031 30323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:32.653621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.3:52331)
0809 15:34:32.653879 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:32.653938 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":75,"threads_started":1}
I20260809 15:34:33.342232 30324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:33.341829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.1:38055)
0809 15:34:33.342086 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:33.342140 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":83,"threads_started":1}
I20260809 15:34:33.467079 30325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:33.466636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.2:41107)
0809 15:34:33.466944 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:33.466998 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":92,"threads_started":1}
I20260809 15:34:33.655299 30326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:33.654872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.3:45167)
0809 15:34:33.655143 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:33.655194 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":109,"threads_started":1}
I20260809 15:34:34.343403 30327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:34.342990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.1:52017)
0809 15:34:34.343256 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:34.343309 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":72,"threads_started":1}
I20260809 15:34:34.468263 30328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:34.467800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.2:46333)
0809 15:34:34.468117 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:34.468178 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":66,"threads_started":1}
I20260809 15:34:34.656445 30329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:34.655987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.3:40729)
0809 15:34:34.656299 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:34.656349 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":107,"threads_started":1}
I20260809 15:34:35.344662 30330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:35.344279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.1:51321)
0809 15:34:35.344520 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:35.344571 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":71,"threads_started":1}
I20260809 15:34:35.469350 30331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:35.468944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.2:57003)
0809 15:34:35.469216 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:35.469268 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":75,"threads_started":1}
I20260809 15:34:35.657631 30332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:35.657123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.3:60305)
0809 15:34:35.657431 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:35.657512 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":106,"threads_started":1}
I20260809 15:34:36.345794 30334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:36.345405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.1:60703)
0809 15:34:36.345647 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:36.345701 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":84,"threads_started":1}
I20260809 15:34:36.470463 30336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:36.470034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.2:40441)
0809 15:34:36.470303 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:36.470375 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":73,"threads_started":1}
I20260809 15:34:36.658686 30337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:36.658308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.3:37345)
0809 15:34:36.658549 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:36.658597 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":72,"threads_started":1}
I20260809 15:34:37.347090 30338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:37.346673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.1:32871)
0809 15:34:37.346920 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:37.346969 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":91,"threads_started":1}
I20260809 15:34:37.471693 30339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:37.471182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.2:39659)
0809 15:34:37.471471 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:37.471573 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":89,"threads_started":1}
I20260809 15:34:37.497454 30340 raft_consensus.cc:482] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:34:37.497601 30340 raft_consensus.cc:504] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46d6c3dd213444ce9ff1a741489d7df2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42971 } } peers { permanent_uuid: "c25e03355bfd40b38652c085bd3a1292" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 44991 } } peers { permanent_uuid: "36aa1caa9f1a43808493994d31b568d9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 43161 } }
I20260809 15:34:37.498098 30340 leader_election.cc:288] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 46d6c3dd213444ce9ff1a741489d7df2 (127.11.146.3:42971), 36aa1caa9f1a43808493994d31b568d9 (127.11.146.2:43161)
W20260809 15:34:37.498823 29856 leader_election.cc:341] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36aa1caa9f1a43808493994d31b568d9 (127.11.146.2:43161): Not found: Tablet not found: f20ffaaf93ce4ee8a48a08547c81c9d1
W20260809 15:34:37.498908 29852 leader_election.cc:341] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 46d6c3dd213444ce9ff1a741489d7df2 (127.11.146.3:42971): Not found: Tablet not found: f20ffaaf93ce4ee8a48a08547c81c9d1
I20260809 15:34:37.499023 29852 leader_election.cc:302] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c25e03355bfd40b38652c085bd3a1292; no voters: 36aa1caa9f1a43808493994d31b568d9, 46d6c3dd213444ce9ff1a741489d7df2
I20260809 15:34:37.499184 30340 raft_consensus.cc:2726] T f20ffaaf93ce4ee8a48a08547c81c9d1 P c25e03355bfd40b38652c085bd3a1292 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 15:34:37.659770 30341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:37.659345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.3:49705)
0809 15:34:37.659574 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:37.659638 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":74,"threads_started":1}
I20260809 15:34:38.348268 30342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:38.347780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.1:48211)
0809 15:34:38.348047 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:38.348150 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":88,"threads_started":1}
I20260809 15:34:38.472929 30343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:38.472554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.2:47973)
0809 15:34:38.472804 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:38.472854 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":96,"threads_started":1}
I20260809 15:34:38.660880 30344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:38.660524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.3:33077)
0809 15:34:38.660742 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:38.660792 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":67,"threads_started":1}
I20260809 15:34:39.349365 30345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:39.348960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.1:48243)
0809 15:34:39.349225 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:39.349274 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":102,"threads_started":1}
I20260809 15:34:39.474035 30346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:39.473591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.2:59773)
0809 15:34:39.473850 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:39.473916 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":67,"threads_started":1}
I20260809 15:34:39.661908 30347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:39.661525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.3:44445)
0809 15:34:39.661747 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:39.661797 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":68,"threads_started":1}
I20260809 15:34:40.350638 30349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:40.350128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.1:59841)
0809 15:34:40.350497 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:40.350549 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":93,"threads_started":1}
I20260809 15:34:40.475317 30351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:40.474811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.2:47743)
0809 15:34:40.475165 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:40.475233 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":81,"threads_started":1}
I20260809 15:34:40.663014 30353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:40.662590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.3:48097)
0809 15:34:40.662856 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:40.662920 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":71,"threads_started":1}
I20260809 15:34:41.351729 30354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:41.351372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.1:42151)
0809 15:34:41.351590 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:41.351639 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":69,"threads_started":1}
I20260809 15:34:41.476472 30355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:41.475962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.2:34261)
0809 15:34:41.476288 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:41.476355 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":121,"threads_started":1}
I20260809 15:34:41.664193 30356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:41.663651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.3:56751)
0809 15:34:41.663984 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:41.664052 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":89,"threads_started":1}
I20260809 15:34:42.353057 30357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:42.352667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.1:36971)
0809 15:34:42.352913 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:42.352960 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":95,"threads_started":1}
I20260809 15:34:42.477638 30358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:42.477274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.2:51683)
0809 15:34:42.477507 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:42.477554 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":70,"threads_started":1}
I20260809 15:34:42.663935 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 29788
I20260809 15:34:42.667255 30359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:42.666426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43907 (local address 127.11.146.3:48489)
0809 15:34:42.667043 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:42.667117 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.62:43907: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":87,"threads_started":1}
I20260809 15:34:42.675004 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 29995
I20260809 15:34:42.682273 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 30144
2026-08-09T15:34:42Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59080 ms)
[----------] 30 tests from SecurityITest (245254 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:34:42 dist-test-slave-1jjb krb5kdc[30362](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:34:42 dist-test-slave-1jjb krb5kdc[30362](info): set up 2 sockets
Aug 09 15:34:42 dist-test-slave-1jjb krb5kdc[30362](info): commencing operation
krb5kdc: starting...
W20260809 15:34:43.738099 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.032s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:34:43 dist-test-slave-1jjb krb5kdc[30362](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289683, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:34:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:34:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.146.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
I20260809 15:34:43.855018 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:34055
--webserver_interface=127.11.146.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:40995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:34055
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:34:43.963769 30378 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:43.964040 30378 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:43.964136 30378 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:43.968045 30378 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:34:43.968133 30378 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:43.968178 30378 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:43.968226 30378 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:34:43.968263 30378 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:34:43.973479 30378 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:40995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:34055
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:34055
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30378
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:43.974368 30378 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:43.975286 30378 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:34:43.983767 30387 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:43.983875 30378 server_base.cc:1034] running on GCE node
W20260809 15:34:43.983775 30384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:43.983775 30385 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:43.984635 30378 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:43.985612 30378 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:43.986796 30378 hybrid_clock.cc:648] HybridClock initialized: now 1786289683986787 us; error 31 us; skew 500 ppm
Aug 09 15:34:43 dist-test-slave-1jjb krb5kdc[30362](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289683, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:34:43.994145 30378 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:34:43.994984 30378 webserver.cc:460] Webserver started at http://127.11.146.62:34039/ using document root <none> and password file <none>
I20260809 15:34:43.995522 30378 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:43.995607 30378 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:43.995819 30378 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:34:43.997812 30378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "dcdc418254d24939a658d4210dfb5529"
format_stamp: "Formatted at 2026-08-09 15:34:43 on dist-test-slave-1jjb"
server_key: "5a6367cf2d333626f9051596b5e9fb08"
server_key_iv: "ad13f6856e2285270929131392fa7ccd"
server_key_version: "encryptionkey@0"
I20260809 15:34:43.998353 30378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "dcdc418254d24939a658d4210dfb5529"
format_stamp: "Formatted at 2026-08-09 15:34:43 on dist-test-slave-1jjb"
server_key: "5a6367cf2d333626f9051596b5e9fb08"
server_key_iv: "ad13f6856e2285270929131392fa7ccd"
server_key_version: "encryptionkey@0"
I20260809 15:34:44.001889 30378 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 15:34:44.004199 30395 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:44.005304 30378 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:34:44.005432 30378 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "dcdc418254d24939a658d4210dfb5529"
format_stamp: "Formatted at 2026-08-09 15:34:43 on dist-test-slave-1jjb"
server_key: "5a6367cf2d333626f9051596b5e9fb08"
server_key_iv: "ad13f6856e2285270929131392fa7ccd"
server_key_version: "encryptionkey@0"
I20260809 15:34:44.005535 30378 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:44.025966 30378 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:44.028570 30378 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:44.028759 30378 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:44.035866 30378 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:34055
I20260809 15:34:44.035887 30455 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:34055 every 8 connection(s)
I20260809 15:34:44.036830 30378 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:34:44.039531 30456 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:34:44.040721 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 30378
I20260809 15:34:44.040858 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:34:44.041149 11848 external_mini_cluster.cc:1428] Setting key 70494de507191c0cd32f3fbc9fc3d122
I20260809 15:34:44.045637 30456 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dcdc418254d24939a658d4210dfb5529: Bootstrap starting.
I20260809 15:34:44.048146 30456 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dcdc418254d24939a658d4210dfb5529: Neither blocks nor log segments found. Creating new log.
I20260809 15:34:44.049129 30456 log.cc:824] T 00000000000000000000000000000000 P dcdc418254d24939a658d4210dfb5529: Log is configured to *not* fsync() on all Append() calls
Aug 09 15:34:44 dist-test-slave-1jjb krb5kdc[30362](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289683, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:34:44.051280 30456 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dcdc418254d24939a658d4210dfb5529: No bootstrap required, opened a new log
I20260809 15:34:44.055114 30459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:44.042472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59564 (local address 127.11.146.62:34055)
0809 15:34:44.042870 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:44.042885 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:44.042920 (+ 35us) server_negotiation.cc:407] Connection header received
0809 15:34:44.043527 (+ 607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:44.043543 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:44.043837 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:44.044155 (+ 318us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:44.045063 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.046058 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.047197 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.047634 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.047745 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:44.050695 (+ 2950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:44.050700 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:44.050712 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:34:44.050736 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:44.052450 (+ 1714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:44.052917 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:44.052921 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:44.052925 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:44.053025 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:44.053330 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:44.053332 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:44.053333 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:44.053704 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:44.053848 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:44.054121 (+ 273us) server_negotiation.cc:299] Negotiation successful
0809 15:34:44.054448 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":119,"threads_started":1}
I20260809 15:34:44.055459 30456 raft_consensus.cc:348] T 00000000000000000000000000000000 P dcdc418254d24939a658d4210dfb5529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcdc418254d24939a658d4210dfb5529" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 34055 } }
I20260809 15:34:44.055675 30456 raft_consensus.cc:374] T 00000000000000000000000000000000 P dcdc418254d24939a658d4210dfb5529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:34:44.055744 30456 raft_consensus.cc:729] T 00000000000000000000000000000000 P dcdc418254d24939a658d4210dfb5529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcdc418254d24939a658d4210dfb5529, State: Initialized, Role: FOLLOWER
I20260809 15:34:44.056206 30456 consensus_queue.cc:260] T 00000000000000000000000000000000 P dcdc418254d24939a658d4210dfb5529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcdc418254d24939a658d4210dfb5529" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 34055 } }
I20260809 15:34:44.056348 30456 raft_consensus.cc:388] T 00000000000000000000000000000000 P dcdc418254d24939a658d4210dfb5529 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:34:44.056447 30456 raft_consensus.cc:482] T 00000000000000000000000000000000 P dcdc418254d24939a658d4210dfb5529 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:34:44.056546 30456 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dcdc418254d24939a658d4210dfb5529 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:34:44.057407 30456 raft_consensus.cc:504] T 00000000000000000000000000000000 P dcdc418254d24939a658d4210dfb5529 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcdc418254d24939a658d4210dfb5529" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 34055 } }
I20260809 15:34:44.057747 30456 leader_election.cc:302] T 00000000000000000000000000000000 P dcdc418254d24939a658d4210dfb5529 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dcdc418254d24939a658d4210dfb5529; no voters:
I20260809 15:34:44.058045 30456 leader_election.cc:288] T 00000000000000000000000000000000 P dcdc418254d24939a658d4210dfb5529 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:34:44.058116 30461 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dcdc418254d24939a658d4210dfb5529 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:34:44.058372 30461 raft_consensus.cc:686] T 00000000000000000000000000000000 P dcdc418254d24939a658d4210dfb5529 [term 1 LEADER]: Becoming Leader. State: Replica: dcdc418254d24939a658d4210dfb5529, State: Running, Role: LEADER
I20260809 15:34:44.058701 30461 consensus_queue.cc:237] T 00000000000000000000000000000000 P dcdc418254d24939a658d4210dfb5529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcdc418254d24939a658d4210dfb5529" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 34055 } }
I20260809 15:34:44.059163 30456 sys_catalog.cc:564] T 00000000000000000000000000000000 P dcdc418254d24939a658d4210dfb5529 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:34:44.060236 30464 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcdc418254d24939a658d4210dfb5529 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dcdc418254d24939a658d4210dfb5529. Latest consensus state: current_term: 1 leader_uuid: "dcdc418254d24939a658d4210dfb5529" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcdc418254d24939a658d4210dfb5529" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 34055 } } }
I20260809 15:34:44.060351 30464 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcdc418254d24939a658d4210dfb5529 [sys.catalog]: This master's current role is: LEADER
I20260809 15:34:44.060743 30463 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcdc418254d24939a658d4210dfb5529 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dcdc418254d24939a658d4210dfb5529" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcdc418254d24939a658d4210dfb5529" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 34055 } } }
I20260809 15:34:44.060921 30463 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcdc418254d24939a658d4210dfb5529 [sys.catalog]: This master's current role is: LEADER
W20260809 15:34:44.063724 30480 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dcdc418254d24939a658d4210dfb5529: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:34:44.063812 30480 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:34:44.063898 30472 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:34:44.064651 30472 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:34:44.069329 30472 catalog_manager.cc:1347] Generated new cluster ID: c8095c6d4de246398de50a5dffa7a44d
I20260809 15:34:44.069388 30472 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:34:44.076407 30472 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:34:44.077227 30472 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:34:44.088860 30472 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dcdc418254d24939a658d4210dfb5529: Generated new TSK 0
I20260809 15:34:44.089536 30472 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.146.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
I20260809 15:34:44.127786 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.1:0
--local_ip_for_outbound_sockets=127.11.146.1
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:34055
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:40995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:34:44.235152 30485 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:44.235419 30485 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:44.235484 30485 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:44.239444 30485 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:44.239537 30485 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:44.239627 30485 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.1
I20260809 15:34:44.244387 30485 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:40995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:34055
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30485
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.1
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:44.245328 30485 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:44.246259 30485 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:34:44.255232 30491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:44.255371 30485 server_base.cc:1034] running on GCE node
W20260809 15:34:44.255285 30494 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:44.255251 30492 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:44.255913 30485 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:44.256558 30485 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:44.257711 30485 hybrid_clock.cc:648] HybridClock initialized: now 1786289684257691 us; error 30 us; skew 500 ppm
Aug 09 15:34:44 dist-test-slave-1jjb krb5kdc[30362](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289684, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:34:44.260592 30485 init.cc:377] Logged in from keytab as kudu/127.11.146.1@KRBTEST.COM (short username kudu)
I20260809 15:34:44.261438 30485 webserver.cc:460] Webserver started at http://127.11.146.1:38019/ using document root <none> and password file <none>
I20260809 15:34:44.261960 30485 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:44.262044 30485 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:44.262283 30485 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:34:44.264180 30485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-0/data/instance:
uuid: "c6ffd8fbec29421c9249372489552833"
format_stamp: "Formatted at 2026-08-09 15:34:44 on dist-test-slave-1jjb"
server_key: "aa7867d4c6e0df281414a9ab10bed16b"
server_key_iv: "13b20550df9a23ea4e0c122c154e7d65"
server_key_version: "encryptionkey@0"
I20260809 15:34:44.264710 30485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance:
uuid: "c6ffd8fbec29421c9249372489552833"
format_stamp: "Formatted at 2026-08-09 15:34:44 on dist-test-slave-1jjb"
server_key: "aa7867d4c6e0df281414a9ab10bed16b"
server_key_iv: "13b20550df9a23ea4e0c122c154e7d65"
server_key_version: "encryptionkey@0"
I20260809 15:34:44.268172 30485 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:34:44.270484 30502 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:44.271636 30485 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:34:44.271757 30485 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-0/wal
uuid: "c6ffd8fbec29421c9249372489552833"
format_stamp: "Formatted at 2026-08-09 15:34:44 on dist-test-slave-1jjb"
server_key: "aa7867d4c6e0df281414a9ab10bed16b"
server_key_iv: "13b20550df9a23ea4e0c122c154e7d65"
server_key_version: "encryptionkey@0"
I20260809 15:34:44.271862 30485 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:44.290925 30485 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:44.293609 30485 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:44.293793 30485 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:44.294320 30485 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:34:44.295092 30485 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:34:44.295156 30485 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:44.295218 30485 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:34:44.295264 30485 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:44.304221 30485 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.1:35023
I20260809 15:34:44.304268 30631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.1:35023 every 8 connection(s)
I20260809 15:34:44.305124 30485 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
Aug 09 15:34:44 dist-test-slave-1jjb krb5kdc[30362](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289684, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:34:44.314415 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 30485
I20260809 15:34:44.314575 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance
I20260809 15:34:44.314883 11848 external_mini_cluster.cc:1428] Setting key 80524dfeeccaf5023e3e83813a94fb41
I20260809 15:34:44.318408 30459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:44.306841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:47155 (local address 127.11.146.62:34055)
0809 15:34:44.306975 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:44.306978 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:44.307744 (+ 766us) server_negotiation.cc:407] Connection header received
0809 15:34:44.309115 (+ 1371us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:44.309119 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:44.309177 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:44.309256 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:44.310395 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.310921 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.311988 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.312276 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.312378 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:44.314529 (+ 2151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:44.314536 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:44.314539 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:34:44.314567 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:44.316301 (+ 1734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:44.316896 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:44.316899 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:44.316900 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:44.316976 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:44.317359 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:44.317361 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:44.317362 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:44.317524 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:44.317599 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:44.318206 (+ 607us) server_negotiation.cc:299] Negotiation successful
0809 15:34:44.318298 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 15:34:44.319307 30634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:44.307182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:34055 (local address 127.11.146.1:47155)
0809 15:34:44.307598 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:44.307639 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:44.308910 (+ 1271us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:44.309409 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:44.309415 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:44.309802 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:34:44.310250 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:44.310264 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.311054 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.311057 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:44.311869 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:44.311878 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.312415 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.312419 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:44.312573 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:44.313058 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:34:44.313084 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:34:44.314352 (+ 1268us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:34:44.316451 (+ 2099us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:34:44.316457 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:34:44.316469 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:34:44.316799 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:34:44.317076 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:34:44.317082 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:34:44.317086 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:34:44.317266 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:34:44.317637 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:34:44.317645 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:34:44.317965 (+ 320us) client_negotiation.cc:769] Sending connection context
0809 15:34:44.318172 (+ 207us) client_negotiation.cc:240] Negotiation successful
0809 15:34:44.318501 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":97,"threads_started":1}
I20260809 15:34:44.320463 30632 heartbeater.cc:347] Connected to a master server at 127.11.146.62:34055
I20260809 15:34:44.320683 30632 heartbeater.cc:464] Registering TS with master...
I20260809 15:34:44.321115 30632 heartbeater.cc:511] Master 127.11.146.62:34055 requested a full tablet report, sending...
I20260809 15:34:44.322611 30414 ts_manager.cc:194] Registered new tserver with Master: c6ffd8fbec29421c9249372489552833 (127.11.146.1:35023)
I20260809 15:34:44.323642 30414 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.1@KRBTEST.COM'} at 127.11.146.1:47155
WARNING: no policy specified for kudu/127.11.146.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
I20260809 15:34:44.340907 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.2:0
--local_ip_for_outbound_sockets=127.11.146.2
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:34055
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:40995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:34:44.447798 30638 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:44.448047 30638 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:44.448149 30638 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:44.452607 30638 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:44.452697 30638 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:44.452782 30638 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.2
I20260809 15:34:44.457978 30638 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:40995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:34055
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30638
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.2
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:44.458937 30638 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:44.459920 30638 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:34:44.469224 30645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:44.469214 30650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:44.469211 30643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:44.469463 30638 server_base.cc:1034] running on GCE node
I20260809 15:34:44.469941 30638 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:44.470607 30638 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:44.471760 30638 hybrid_clock.cc:648] HybridClock initialized: now 1786289684471750 us; error 27 us; skew 500 ppm
Aug 09 15:34:44 dist-test-slave-1jjb krb5kdc[30362](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289684, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:34:44.474465 30638 init.cc:377] Logged in from keytab as kudu/127.11.146.2@KRBTEST.COM (short username kudu)
I20260809 15:34:44.475265 30638 webserver.cc:460] Webserver started at http://127.11.146.2:35883/ using document root <none> and password file <none>
I20260809 15:34:44.475768 30638 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:44.475849 30638 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:44.476051 30638 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:34:44.477978 30638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-1/data/instance:
uuid: "23ec90a7aa114b1aa03726aff1c19fe9"
format_stamp: "Formatted at 2026-08-09 15:34:44 on dist-test-slave-1jjb"
server_key: "53775c71b0cc2af5a5f2bf68f2bfa55d"
server_key_iv: "32ed22cd819c209f0502a4f292458414"
server_key_version: "encryptionkey@0"
I20260809 15:34:44.478513 30638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance:
uuid: "23ec90a7aa114b1aa03726aff1c19fe9"
format_stamp: "Formatted at 2026-08-09 15:34:44 on dist-test-slave-1jjb"
server_key: "53775c71b0cc2af5a5f2bf68f2bfa55d"
server_key_iv: "32ed22cd819c209f0502a4f292458414"
server_key_version: "encryptionkey@0"
I20260809 15:34:44.481972 30638 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 15:34:44.484244 30658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:44.485322 30638 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:34:44.485476 30638 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-1/wal
uuid: "23ec90a7aa114b1aa03726aff1c19fe9"
format_stamp: "Formatted at 2026-08-09 15:34:44 on dist-test-slave-1jjb"
server_key: "53775c71b0cc2af5a5f2bf68f2bfa55d"
server_key_iv: "32ed22cd819c209f0502a4f292458414"
server_key_version: "encryptionkey@0"
I20260809 15:34:44.485579 30638 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:44.498943 30638 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:44.502279 30638 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:44.502475 30638 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:44.503022 30638 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:34:44.503839 30638 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:34:44.503916 30638 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:44.504000 30638 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:34:44.504056 30638 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:44.513175 30638 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.2:46741
I20260809 15:34:44.513195 30788 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.2:46741 every 8 connection(s)
I20260809 15:34:44.514002 30638 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
I20260809 15:34:44.516984 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 30638
I20260809 15:34:44.517114 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance
I20260809 15:34:44.517393 11848 external_mini_cluster.cc:1428] Setting key 795d765b9ae600df8fd89542d8958f77
Aug 09 15:34:44 dist-test-slave-1jjb krb5kdc[30362](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289684, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:34:44.528033 30459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:44.515703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:55697 (local address 127.11.146.62:34055)
0809 15:34:44.515825 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:44.515828 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:44.516666 (+ 838us) server_negotiation.cc:407] Connection header received
0809 15:34:44.518006 (+ 1340us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:44.518009 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:44.518071 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:44.518168 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:44.519191 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.519706 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.520840 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.521066 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.521169 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:44.523948 (+ 2779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:44.523952 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:44.523953 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:34:44.523977 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:44.525684 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:44.526347 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:44.526350 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:44.526352 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:44.526437 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:44.526869 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:44.526872 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:44.526874 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:44.527081 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:44.527172 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:44.527821 (+ 649us) server_negotiation.cc:299] Negotiation successful
0809 15:34:44.527924 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
WARNING: no policy specified for kudu/127.11.146.3@KRBTEST.COM; defaulting to no policy
I20260809 15:34:44.529207 30792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:44.516020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:34055 (local address 127.11.146.2:55697)
0809 15:34:44.516532 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:44.516572 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:44.517800 (+ 1228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:44.518331 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:44.518337 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:44.518662 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:34:44.519066 (+ 404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:44.519079 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.519828 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.519831 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:44.520702 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:44.520712 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.521206 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.521210 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:44.521368 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:44.521955 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:34:44.521971 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:34:44.523742 (+ 1771us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:34:44.525807 (+ 2065us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:34:44.525816 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:34:44.525833 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:34:44.526217 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:34:44.526559 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:34:44.526565 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:34:44.526569 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:34:44.526755 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:34:44.527195 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:34:44.527202 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:34:44.527519 (+ 317us) client_negotiation.cc:769] Sending connection context
0809 15:34:44.527757 (+ 238us) client_negotiation.cc:240] Negotiation successful
0809 15:34:44.528122 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":105,"threads_started":1}
I20260809 15:34:44.530326 30789 heartbeater.cc:347] Connected to a master server at 127.11.146.62:34055
I20260809 15:34:44.530539 30789 heartbeater.cc:464] Registering TS with master...
I20260809 15:34:44.530961 30789 heartbeater.cc:511] Master 127.11.146.62:34055 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.3@KRBTEST.COM" created.
I20260809 15:34:44.531924 30414 ts_manager.cc:194] Registered new tserver with Master: 23ec90a7aa114b1aa03726aff1c19fe9 (127.11.146.2:46741)
I20260809 15:34:44.532778 30414 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.2@KRBTEST.COM'} at 127.11.146.2:55697
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
I20260809 15:34:44.548837 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.3:0
--local_ip_for_outbound_sockets=127.11.146.3
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:34055
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:40995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:34:44.667498 30797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:44.667764 30797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:44.667837 30797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:44.671905 30797 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:44.671976 30797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:44.672057 30797 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.3
I20260809 15:34:44.677273 30797 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:40995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:34055
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30797
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.3
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:44.678184 30797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:44.679111 30797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:34:44.688361 30802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:44.688400 30805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:44.688362 30803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:44.688684 30797 server_base.cc:1034] running on GCE node
I20260809 15:34:44.689042 30797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:44.689600 30797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:44.690778 30797 hybrid_clock.cc:648] HybridClock initialized: now 1786289684690750 us; error 40 us; skew 500 ppm
Aug 09 15:34:44 dist-test-slave-1jjb krb5kdc[30362](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289684, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:34:44.693429 30797 init.cc:377] Logged in from keytab as kudu/127.11.146.3@KRBTEST.COM (short username kudu)
I20260809 15:34:44.694197 30797 webserver.cc:460] Webserver started at http://127.11.146.3:39591/ using document root <none> and password file <none>
I20260809 15:34:44.694694 30797 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:44.694777 30797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:44.694996 30797 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:34:44.696951 30797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-2/data/instance:
uuid: "073d55db25d54bbcab25b02c084f7548"
format_stamp: "Formatted at 2026-08-09 15:34:44 on dist-test-slave-1jjb"
server_key: "aba447655d0886e39689fab35e449168"
server_key_iv: "670ce7f7ca08517947f29586dadcfc20"
server_key_version: "encryptionkey@0"
I20260809 15:34:44.697484 30797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance:
uuid: "073d55db25d54bbcab25b02c084f7548"
format_stamp: "Formatted at 2026-08-09 15:34:44 on dist-test-slave-1jjb"
server_key: "aba447655d0886e39689fab35e449168"
server_key_iv: "670ce7f7ca08517947f29586dadcfc20"
server_key_version: "encryptionkey@0"
I20260809 15:34:44.700841 30797 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 15:34:44.703073 30812 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:44.704159 30797 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:34:44.704270 30797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-2/wal
uuid: "073d55db25d54bbcab25b02c084f7548"
format_stamp: "Formatted at 2026-08-09 15:34:44 on dist-test-slave-1jjb"
server_key: "aba447655d0886e39689fab35e449168"
server_key_iv: "670ce7f7ca08517947f29586dadcfc20"
server_key_version: "encryptionkey@0"
I20260809 15:34:44.704365 30797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:44.718541 30797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:44.721071 30797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:44.721246 30797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:44.721745 30797 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:34:44.722467 30797 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:34:44.722529 30797 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:44.722592 30797 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:34:44.722638 30797 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:44.731009 30797 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.3:34983
I20260809 15:34:44.731113 30944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.3:34983 every 8 connection(s)
I20260809 15:34:44.731772 30797 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
I20260809 15:34:44.735929 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 30797
I20260809 15:34:44.736050 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance
I20260809 15:34:44.736331 11848 external_mini_cluster.cc:1428] Setting key 818e6d4f7722acc9bca3d099746ebb42
Aug 09 15:34:44 dist-test-slave-1jjb krb5kdc[30362](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289684, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:34:44.744170 30459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:44.733447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:40201 (local address 127.11.146.62:34055)
0809 15:34:44.733600 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:44.733604 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:44.734273 (+ 669us) server_negotiation.cc:407] Connection header received
0809 15:34:44.735355 (+ 1082us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:44.735358 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:44.735409 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:44.735481 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:44.736777 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.737377 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.738588 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.738798 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.738877 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:44.741103 (+ 2226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:44.741106 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:44.741108 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:34:44.741131 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:44.742515 (+ 1384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:44.742928 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:44.742931 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:44.742932 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:44.743001 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:44.743267 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:44.743269 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:44.743270 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:44.743446 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:44.743520 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:44.743920 (+ 400us) server_negotiation.cc:299] Negotiation successful
0809 15:34:44.744005 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 15:34:44.744889 30948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:44.733743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:34055 (local address 127.11.146.3:40201)
0809 15:34:44.734140 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:44.734176 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:44.735184 (+ 1008us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:44.735649 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:44.735655 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:44.735951 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:34:44.736613 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:44.736643 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.737501 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.737505 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:44.738483 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:44.738493 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.738916 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.738919 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:44.739067 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:44.739526 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:34:44.739540 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:34:44.740958 (+ 1418us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:34:44.742606 (+ 1648us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:34:44.742610 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:34:44.742619 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:34:44.742842 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:34:44.743075 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:34:44.743077 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:34:44.743078 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:34:44.743194 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:34:44.743528 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:34:44.743533 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:34:44.743727 (+ 194us) client_negotiation.cc:769] Sending connection context
0809 15:34:44.743874 (+ 147us) client_negotiation.cc:240] Negotiation successful
0809 15:34:44.744153 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":109,"threads_started":1}
I20260809 15:34:44.745882 30945 heartbeater.cc:347] Connected to a master server at 127.11.146.62:34055
I20260809 15:34:44.746101 30945 heartbeater.cc:464] Registering TS with master...
I20260809 15:34:44.746531 30945 heartbeater.cc:511] Master 127.11.146.62:34055 requested a full tablet report, sending...
I20260809 15:34:44.747407 30414 ts_manager.cc:194] Registered new tserver with Master: 073d55db25d54bbcab25b02c084f7548 (127.11.146.3:34983)
I20260809 15:34:44.747949 30414 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.3@KRBTEST.COM'} at 127.11.146.3:40201
I20260809 15:34:44.749816 11848 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:34:44.758720 30459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:44.751756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59572 (local address 127.11.146.62:34055)
0809 15:34:44.751870 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:44.751876 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:44.752063 (+ 187us) server_negotiation.cc:407] Connection header received
0809 15:34:44.752213 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:44.752216 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:44.752257 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:44.752341 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:44.753026 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.753477 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.754268 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.754469 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.754568 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:44.755810 (+ 1242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:44.755814 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:44.755816 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:34:44.755844 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:44.757143 (+ 1299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:44.757565 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:44.757569 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:44.757570 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:44.757638 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:44.757906 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:44.757910 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:44.757912 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:44.758099 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:44.758230 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:44.758447 (+ 217us) server_negotiation.cc:299] Negotiation successful
0809 15:34:44.758542 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 15:34:44.761382 30414 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59572:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:34:44.764194 30414 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:34:44.778003 30960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:44.772474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:34983 (local address 127.0.0.1:40664)
0809 15:34:44.772714 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:44.772728 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:44.772807 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:44.773712 (+ 905us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:44.773715 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:44.773734 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:34:44.773846 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:44.773852 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.775295 (+ 1443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.775299 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:44.776485 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:44.776493 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.777545 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.777551 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:44.777654 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:44.777685 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 15:34:44.777753 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 15:34:44.777842 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"mutex_wait_us":7,"thread_start_us":92,"threads_started":1}
I20260809 15:34:44.778066 30961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:44.772913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33996 (local address 127.11.146.1:35023)
0809 15:34:44.773289 (+ 376us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:44.773304 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:44.773327 (+ 23us) server_negotiation.cc:407] Connection header received
0809 15:34:44.773413 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:44.773420 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:44.773593 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:44.773738 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:34:44.774124 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.775228 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.776659 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.777213 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.777335 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:44.777478 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:44.777697 (+ 219us) server_negotiation.cc:299] Negotiation successful
0809 15:34:44.777858 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":97,"threads_started":1}
I20260809 15:34:44.778467 30962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:44.772872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40664 (local address 127.11.146.3:34983)
0809 15:34:44.773350 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:44.773363 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:44.773385 (+ 22us) server_negotiation.cc:407] Connection header received
0809 15:34:44.773449 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:44.773453 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:44.773583 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:44.773869 (+ 286us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:34:44.774003 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.775174 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.776597 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.777402 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.778005 (+ 603us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:44.778168 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:44.778223 (+ 55us) server_negotiation.cc:299] Negotiation successful
0809 15:34:44.778325 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":204,"threads_started":1}
I20260809 15:34:44.777915 30959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:44.771906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:35023 (local address 127.0.0.1:33996)
0809 15:34:44.772566 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:44.772578 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:44.772655 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:44.773893 (+ 1238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:44.773896 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:44.773914 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:34:44.773999 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:44.774005 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.775351 (+ 1346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.775354 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:44.776544 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:44.776555 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.777337 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.777341 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:44.777447 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:44.777482 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 15:34:44.777649 (+ 167us) client_negotiation.cc:240] Negotiation successful
0809 15:34:44.777788 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":129,"threads_started":1}
I20260809 15:34:44.778851 30957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:44.771783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:46741 (local address 127.0.0.1:43410)
0809 15:34:44.772272 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:44.772316 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:44.772435 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:44.773479 (+ 1044us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:44.773485 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:44.773508 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:34:44.773620 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:44.773626 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.774846 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.774852 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:44.776248 (+ 1396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:44.776259 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.778463 (+ 2204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.778467 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:44.778559 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:44.778586 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 15:34:44.778665 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 15:34:44.778738 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":61,"threads_started":1}
I20260809 15:34:44.779490 30958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:44.771907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43410 (local address 127.11.146.2:46741)
0809 15:34:44.772338 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:44.772351 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:44.772380 (+ 29us) server_negotiation.cc:407] Connection header received
0809 15:34:44.772861 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:44.772868 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:44.773304 (+ 436us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:44.773752 (+ 448us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:34:44.773906 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.774721 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.776632 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.777393 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.779116 (+ 1723us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:44.779215 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:44.779274 (+ 59us) server_negotiation.cc:299] Negotiation successful
0809 15:34:44.779357 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":130,"threads_started":1}
I20260809 15:34:44.781342 30867 tablet_service.cc:1467] Processing CreateTablet for tablet d2b99795b3864d9fa781b72c661d7707 (DEFAULT_TABLE table=test-table [id=2cb6d97ee2d647989788bcdf1ce1b949]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:34:44.781365 30554 tablet_service.cc:1467] Processing CreateTablet for tablet d2b99795b3864d9fa781b72c661d7707 (DEFAULT_TABLE table=test-table [id=2cb6d97ee2d647989788bcdf1ce1b949]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:34:44.782315 30867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2b99795b3864d9fa781b72c661d7707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:34:44.782413 30554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2b99795b3864d9fa781b72c661d7707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:34:44.782152 30712 tablet_service.cc:1467] Processing CreateTablet for tablet d2b99795b3864d9fa781b72c661d7707 (DEFAULT_TABLE table=test-table [id=2cb6d97ee2d647989788bcdf1ce1b949]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:34:44.783102 30712 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2b99795b3864d9fa781b72c661d7707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:34:44.788743 30963 tablet_bootstrap.cc:492] T d2b99795b3864d9fa781b72c661d7707 P 073d55db25d54bbcab25b02c084f7548: Bootstrap starting.
I20260809 15:34:44.789764 30966 tablet_bootstrap.cc:492] T d2b99795b3864d9fa781b72c661d7707 P 23ec90a7aa114b1aa03726aff1c19fe9: Bootstrap starting.
I20260809 15:34:44.790225 30965 tablet_bootstrap.cc:492] T d2b99795b3864d9fa781b72c661d7707 P c6ffd8fbec29421c9249372489552833: Bootstrap starting.
I20260809 15:34:44.791301 30963 tablet_bootstrap.cc:654] T d2b99795b3864d9fa781b72c661d7707 P 073d55db25d54bbcab25b02c084f7548: Neither blocks nor log segments found. Creating new log.
I20260809 15:34:44.791918 30965 tablet_bootstrap.cc:654] T d2b99795b3864d9fa781b72c661d7707 P c6ffd8fbec29421c9249372489552833: Neither blocks nor log segments found. Creating new log.
I20260809 15:34:44.792342 30966 tablet_bootstrap.cc:654] T d2b99795b3864d9fa781b72c661d7707 P 23ec90a7aa114b1aa03726aff1c19fe9: Neither blocks nor log segments found. Creating new log.
I20260809 15:34:44.792752 30963 log.cc:824] T d2b99795b3864d9fa781b72c661d7707 P 073d55db25d54bbcab25b02c084f7548: Log is configured to *not* fsync() on all Append() calls
I20260809 15:34:44.793009 30965 log.cc:824] T d2b99795b3864d9fa781b72c661d7707 P c6ffd8fbec29421c9249372489552833: Log is configured to *not* fsync() on all Append() calls
I20260809 15:34:44.793139 30966 log.cc:824] T d2b99795b3864d9fa781b72c661d7707 P 23ec90a7aa114b1aa03726aff1c19fe9: Log is configured to *not* fsync() on all Append() calls
I20260809 15:34:44.794857 30965 tablet_bootstrap.cc:492] T d2b99795b3864d9fa781b72c661d7707 P c6ffd8fbec29421c9249372489552833: No bootstrap required, opened a new log
I20260809 15:34:44.794862 30963 tablet_bootstrap.cc:492] T d2b99795b3864d9fa781b72c661d7707 P 073d55db25d54bbcab25b02c084f7548: No bootstrap required, opened a new log
I20260809 15:34:44.795042 30963 ts_tablet_manager.cc:1397] T d2b99795b3864d9fa781b72c661d7707 P 073d55db25d54bbcab25b02c084f7548: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.003s
I20260809 15:34:44.795042 30965 ts_tablet_manager.cc:1397] T d2b99795b3864d9fa781b72c661d7707 P c6ffd8fbec29421c9249372489552833: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 15:34:44.795109 30966 tablet_bootstrap.cc:492] T d2b99795b3864d9fa781b72c661d7707 P 23ec90a7aa114b1aa03726aff1c19fe9: No bootstrap required, opened a new log
I20260809 15:34:44.795238 30966 ts_tablet_manager.cc:1397] T d2b99795b3864d9fa781b72c661d7707 P 23ec90a7aa114b1aa03726aff1c19fe9: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 15:34:44.798015 30966 raft_consensus.cc:348] T d2b99795b3864d9fa781b72c661d7707 P 23ec90a7aa114b1aa03726aff1c19fe9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ec90a7aa114b1aa03726aff1c19fe9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 46741 } } peers { permanent_uuid: "c6ffd8fbec29421c9249372489552833" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 35023 } } peers { permanent_uuid: "073d55db25d54bbcab25b02c084f7548" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 34983 } }
I20260809 15:34:44.798257 30966 raft_consensus.cc:374] T d2b99795b3864d9fa781b72c661d7707 P 23ec90a7aa114b1aa03726aff1c19fe9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:34:44.798331 30966 raft_consensus.cc:729] T d2b99795b3864d9fa781b72c661d7707 P 23ec90a7aa114b1aa03726aff1c19fe9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23ec90a7aa114b1aa03726aff1c19fe9, State: Initialized, Role: FOLLOWER
I20260809 15:34:44.798765 30966 consensus_queue.cc:260] T d2b99795b3864d9fa781b72c661d7707 P 23ec90a7aa114b1aa03726aff1c19fe9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ec90a7aa114b1aa03726aff1c19fe9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 46741 } } peers { permanent_uuid: "c6ffd8fbec29421c9249372489552833" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 35023 } } peers { permanent_uuid: "073d55db25d54bbcab25b02c084f7548" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 34983 } }
I20260809 15:34:44.798910 30965 raft_consensus.cc:348] T d2b99795b3864d9fa781b72c661d7707 P c6ffd8fbec29421c9249372489552833 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ec90a7aa114b1aa03726aff1c19fe9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 46741 } } peers { permanent_uuid: "c6ffd8fbec29421c9249372489552833" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 35023 } } peers { permanent_uuid: "073d55db25d54bbcab25b02c084f7548" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 34983 } }
I20260809 15:34:44.798919 30963 raft_consensus.cc:348] T d2b99795b3864d9fa781b72c661d7707 P 073d55db25d54bbcab25b02c084f7548 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ec90a7aa114b1aa03726aff1c19fe9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 46741 } } peers { permanent_uuid: "c6ffd8fbec29421c9249372489552833" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 35023 } } peers { permanent_uuid: "073d55db25d54bbcab25b02c084f7548" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 34983 } }
I20260809 15:34:44.799145 30963 raft_consensus.cc:374] T d2b99795b3864d9fa781b72c661d7707 P 073d55db25d54bbcab25b02c084f7548 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:34:44.799214 30965 raft_consensus.cc:374] T d2b99795b3864d9fa781b72c661d7707 P c6ffd8fbec29421c9249372489552833 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:34:44.799238 30963 raft_consensus.cc:729] T d2b99795b3864d9fa781b72c661d7707 P 073d55db25d54bbcab25b02c084f7548 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073d55db25d54bbcab25b02c084f7548, State: Initialized, Role: FOLLOWER
I20260809 15:34:44.799311 30965 raft_consensus.cc:729] T d2b99795b3864d9fa781b72c661d7707 P c6ffd8fbec29421c9249372489552833 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6ffd8fbec29421c9249372489552833, State: Initialized, Role: FOLLOWER
I20260809 15:34:44.799371 30789 heartbeater.cc:503] Master 127.11.146.62:34055 was elected leader, sending a full tablet report...
I20260809 15:34:44.799738 30966 ts_tablet_manager.cc:1428] T d2b99795b3864d9fa781b72c661d7707 P 23ec90a7aa114b1aa03726aff1c19fe9: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260809 15:34:44.799746 30965 consensus_queue.cc:260] T d2b99795b3864d9fa781b72c661d7707 P c6ffd8fbec29421c9249372489552833 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ec90a7aa114b1aa03726aff1c19fe9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 46741 } } peers { permanent_uuid: "c6ffd8fbec29421c9249372489552833" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 35023 } } peers { permanent_uuid: "073d55db25d54bbcab25b02c084f7548" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 34983 } }
I20260809 15:34:44.799746 30963 consensus_queue.cc:260] T d2b99795b3864d9fa781b72c661d7707 P 073d55db25d54bbcab25b02c084f7548 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ec90a7aa114b1aa03726aff1c19fe9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 46741 } } peers { permanent_uuid: "c6ffd8fbec29421c9249372489552833" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 35023 } } peers { permanent_uuid: "073d55db25d54bbcab25b02c084f7548" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 34983 } }
I20260809 15:34:44.800659 30965 ts_tablet_manager.cc:1428] T d2b99795b3864d9fa781b72c661d7707 P c6ffd8fbec29421c9249372489552833: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 15:34:44.800957 30632 heartbeater.cc:503] Master 127.11.146.62:34055 was elected leader, sending a full tablet report...
I20260809 15:34:44.801146 30945 heartbeater.cc:503] Master 127.11.146.62:34055 was elected leader, sending a full tablet report...
I20260809 15:34:44.801529 30963 ts_tablet_manager.cc:1428] T d2b99795b3864d9fa781b72c661d7707 P 073d55db25d54bbcab25b02c084f7548: Time spent starting tablet: real 0.006s user 0.005s sys 0.002s
W20260809 15:34:44.806137 30633 tablet.cc:2369] T d2b99795b3864d9fa781b72c661d7707 P c6ffd8fbec29421c9249372489552833: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:34:44.854976 30971 raft_consensus.cc:482] T d2b99795b3864d9fa781b72c661d7707 P c6ffd8fbec29421c9249372489552833 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:34:44.855156 30971 raft_consensus.cc:504] T d2b99795b3864d9fa781b72c661d7707 P c6ffd8fbec29421c9249372489552833 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ec90a7aa114b1aa03726aff1c19fe9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 46741 } } peers { permanent_uuid: "c6ffd8fbec29421c9249372489552833" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 35023 } } peers { permanent_uuid: "073d55db25d54bbcab25b02c084f7548" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 34983 } }
I20260809 15:34:44.856289 30971 leader_election.cc:288] T d2b99795b3864d9fa781b72c661d7707 P c6ffd8fbec29421c9249372489552833 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23ec90a7aa114b1aa03726aff1c19fe9 (127.11.146.2:46741), 073d55db25d54bbcab25b02c084f7548 (127.11.146.3:34983)
I20260809 15:34:44.860618 30958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:44.856631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:57113 (local address 127.11.146.2:46741)
0809 15:34:44.856801 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:44.856808 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:44.856842 (+ 34us) server_negotiation.cc:407] Connection header received
0809 15:34:44.857026 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:44.857030 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:44.857121 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:44.857205 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:34:44.857534 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.858216 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.859468 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.860011 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.860188 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:44.860248 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:44.860422 (+ 174us) server_negotiation.cc:299] Negotiation successful
0809 15:34:44.860490 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 15:34:44.860644 30962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:44.857038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:42369 (local address 127.11.146.3:34983)
0809 15:34:44.857193 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:44.857199 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:44.857314 (+ 115us) server_negotiation.cc:407] Connection header received
0809 15:34:44.857428 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:44.857431 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:44.857488 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:44.857569 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:34:44.857850 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.858326 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.859567 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.860103 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.860232 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:44.860285 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:44.860458 (+ 173us) server_negotiation.cc:299] Negotiation successful
0809 15:34:44.860528 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 15:34:44.860641 30973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:44.856490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:46741 (local address 127.11.146.1:57113)
0809 15:34:44.856772 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:44.856787 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:44.856902 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:44.857236 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:44.857239 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:44.857262 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:34:44.857419 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:44.857425 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.858334 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.858338 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:44.859342 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:44.859352 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.860180 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.860184 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:44.860287 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:44.860315 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 15:34:44.860405 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 15:34:44.860480 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"mutex_wait_us":44,"thread_start_us":87,"threads_started":1}
I20260809 15:34:44.861006 30974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:44.856890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:34983 (local address 127.11.146.1:42369)
0809 15:34:44.857223 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:44.857239 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:44.857340 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:44.857601 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:44.857604 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:44.857624 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:34:44.857748 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:44.857755 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.858436 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.858439 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:44.859384 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:44.859412 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.860227 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.860230 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:44.860336 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:44.860362 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 15:34:44.860444 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 15:34:44.860513 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":116,"threads_started":1}
I20260809 15:34:44.861335 30735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2b99795b3864d9fa781b72c661d7707" candidate_uuid: "c6ffd8fbec29421c9249372489552833" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23ec90a7aa114b1aa03726aff1c19fe9" is_pre_election: true
I20260809 15:34:44.861624 30735 raft_consensus.cc:2454] T d2b99795b3864d9fa781b72c661d7707 P 23ec90a7aa114b1aa03726aff1c19fe9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6ffd8fbec29421c9249372489552833 in term 0.
I20260809 15:34:44.861769 30891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2b99795b3864d9fa781b72c661d7707" candidate_uuid: "c6ffd8fbec29421c9249372489552833" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073d55db25d54bbcab25b02c084f7548" is_pre_election: true
I20260809 15:34:44.862084 30891 raft_consensus.cc:2454] T d2b99795b3864d9fa781b72c661d7707 P 073d55db25d54bbcab25b02c084f7548 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6ffd8fbec29421c9249372489552833 in term 0.
I20260809 15:34:44.862107 30504 leader_election.cc:302] T d2b99795b3864d9fa781b72c661d7707 P c6ffd8fbec29421c9249372489552833 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23ec90a7aa114b1aa03726aff1c19fe9, c6ffd8fbec29421c9249372489552833; no voters:
I20260809 15:34:44.862517 30971 raft_consensus.cc:2781] T d2b99795b3864d9fa781b72c661d7707 P c6ffd8fbec29421c9249372489552833 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:34:44.862599 30971 raft_consensus.cc:482] T d2b99795b3864d9fa781b72c661d7707 P c6ffd8fbec29421c9249372489552833 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:34:44.862651 30971 raft_consensus.cc:3037] T d2b99795b3864d9fa781b72c661d7707 P c6ffd8fbec29421c9249372489552833 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:34:44.863713 30971 raft_consensus.cc:504] T d2b99795b3864d9fa781b72c661d7707 P c6ffd8fbec29421c9249372489552833 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ec90a7aa114b1aa03726aff1c19fe9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 46741 } } peers { permanent_uuid: "c6ffd8fbec29421c9249372489552833" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 35023 } } peers { permanent_uuid: "073d55db25d54bbcab25b02c084f7548" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 34983 } }
I20260809 15:34:44.864033 30971 leader_election.cc:288] T d2b99795b3864d9fa781b72c661d7707 P c6ffd8fbec29421c9249372489552833 [CANDIDATE]: Term 1 election: Requested vote from peers 23ec90a7aa114b1aa03726aff1c19fe9 (127.11.146.2:46741), 073d55db25d54bbcab25b02c084f7548 (127.11.146.3:34983)
I20260809 15:34:44.864401 30735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2b99795b3864d9fa781b72c661d7707" candidate_uuid: "c6ffd8fbec29421c9249372489552833" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23ec90a7aa114b1aa03726aff1c19fe9"
I20260809 15:34:44.864481 30891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2b99795b3864d9fa781b72c661d7707" candidate_uuid: "c6ffd8fbec29421c9249372489552833" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073d55db25d54bbcab25b02c084f7548"
I20260809 15:34:44.864527 30735 raft_consensus.cc:3037] T d2b99795b3864d9fa781b72c661d7707 P 23ec90a7aa114b1aa03726aff1c19fe9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:34:44.864624 30891 raft_consensus.cc:3037] T d2b99795b3864d9fa781b72c661d7707 P 073d55db25d54bbcab25b02c084f7548 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:34:44.865551 30735 raft_consensus.cc:2454] T d2b99795b3864d9fa781b72c661d7707 P 23ec90a7aa114b1aa03726aff1c19fe9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6ffd8fbec29421c9249372489552833 in term 1.
I20260809 15:34:44.865676 30891 raft_consensus.cc:2454] T d2b99795b3864d9fa781b72c661d7707 P 073d55db25d54bbcab25b02c084f7548 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6ffd8fbec29421c9249372489552833 in term 1.
I20260809 15:34:44.865904 30504 leader_election.cc:302] T d2b99795b3864d9fa781b72c661d7707 P c6ffd8fbec29421c9249372489552833 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23ec90a7aa114b1aa03726aff1c19fe9, c6ffd8fbec29421c9249372489552833; no voters:
I20260809 15:34:44.866266 30971 raft_consensus.cc:2781] T d2b99795b3864d9fa781b72c661d7707 P c6ffd8fbec29421c9249372489552833 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:34:44.866492 30971 raft_consensus.cc:686] T d2b99795b3864d9fa781b72c661d7707 P c6ffd8fbec29421c9249372489552833 [term 1 LEADER]: Becoming Leader. State: Replica: c6ffd8fbec29421c9249372489552833, State: Running, Role: LEADER
I20260809 15:34:44.866863 30971 consensus_queue.cc:237] T d2b99795b3864d9fa781b72c661d7707 P c6ffd8fbec29421c9249372489552833 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ec90a7aa114b1aa03726aff1c19fe9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 46741 } } peers { permanent_uuid: "c6ffd8fbec29421c9249372489552833" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 35023 } } peers { permanent_uuid: "073d55db25d54bbcab25b02c084f7548" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 34983 } }
I20260809 15:34:44.870082 30412 catalog_manager.cc:5495] T d2b99795b3864d9fa781b72c661d7707 P c6ffd8fbec29421c9249372489552833 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6ffd8fbec29421c9249372489552833 (127.11.146.1). New cstate: current_term: 1 leader_uuid: "c6ffd8fbec29421c9249372489552833" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23ec90a7aa114b1aa03726aff1c19fe9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 46741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6ffd8fbec29421c9249372489552833" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 35023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073d55db25d54bbcab25b02c084f7548" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 34983 } health_report { overall_health: UNKNOWN } } }
I20260809 15:34:44.897802 30961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:44.894413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34006 (local address 127.11.146.1:35023)
0809 15:34:44.894515 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:44.894518 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:44.894530 (+ 12us) server_negotiation.cc:407] Connection header received
0809 15:34:44.894649 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:44.894651 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:44.894703 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:44.894786 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:34:44.895033 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.895586 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.896560 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:44.896759 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:44.896835 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:44.897121 (+ 286us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:34:44.897499 (+ 378us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:34:44.897587 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:44.897654 (+ 67us) server_negotiation.cc:299] Negotiation successful
0809 15:34:44.897701 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 15:34:44.903632 30735 raft_consensus.cc:1261] T d2b99795b3864d9fa781b72c661d7707 P 23ec90a7aa114b1aa03726aff1c19fe9 [term 1 FOLLOWER]: Refusing update from remote peer c6ffd8fbec29421c9249372489552833: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:34:44.903632 30891 raft_consensus.cc:1261] T d2b99795b3864d9fa781b72c661d7707 P 073d55db25d54bbcab25b02c084f7548 [term 1 FOLLOWER]: Refusing update from remote peer c6ffd8fbec29421c9249372489552833: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:34:44.904446 30975 consensus_queue.cc:1035] T d2b99795b3864d9fa781b72c661d7707 P c6ffd8fbec29421c9249372489552833 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23ec90a7aa114b1aa03726aff1c19fe9" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 46741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:34:44.904702 30971 consensus_queue.cc:1035] T d2b99795b3864d9fa781b72c661d7707 P c6ffd8fbec29421c9249372489552833 [LEADER]: Connected to new peer: Peer: permanent_uuid: "073d55db25d54bbcab25b02c084f7548" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 34983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:34:44.914304 30980 mvcc.cc:205] Tried to move back new op lower bound from 7316642549357596672 to 7316642549217460224. Current Snapshot: MvccSnapshot[applied={T|T < 7316642549357596672}]
I20260809 15:34:44.916224 30978 mvcc.cc:205] Tried to move back new op lower bound from 7316642549357596672 to 7316642549217460224. Current Snapshot: MvccSnapshot[applied={T|T < 7316642549357596672}]
I20260809 15:34:44.924733 30413 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:34:44.924916 30413 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:34:44.927398 30413 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dcdc418254d24939a658d4210dfb5529: Sending DeleteTablet for 3 replicas of tablet d2b99795b3864d9fa781b72c661d7707
I20260809 15:34:44.928138 30554 tablet_service.cc:1514] Processing DeleteTablet for tablet d2b99795b3864d9fa781b72c661d7707 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:34:44 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:33996
I20260809 15:34:44.928388 30867 tablet_service.cc:1514] Processing DeleteTablet for tablet d2b99795b3864d9fa781b72c661d7707 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:34:44 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:40664
I20260809 15:34:44.928397 30712 tablet_service.cc:1514] Processing DeleteTablet for tablet d2b99795b3864d9fa781b72c661d7707 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:34:44 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:43410
I20260809 15:34:44.928879 30991 tablet_replica.cc:330] T d2b99795b3864d9fa781b72c661d7707 P 073d55db25d54bbcab25b02c084f7548: stopping tablet replica
I20260809 15:34:44.928889 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 30485
I20260809 15:34:44.929229 30991 raft_consensus.cc:2229] T d2b99795b3864d9fa781b72c661d7707 P 073d55db25d54bbcab25b02c084f7548 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:34:44.929589 30992 tablet_replica.cc:330] T d2b99795b3864d9fa781b72c661d7707 P 23ec90a7aa114b1aa03726aff1c19fe9: stopping tablet replica
I20260809 15:34:44.929693 30991 raft_consensus.cc:2258] T d2b99795b3864d9fa781b72c661d7707 P 073d55db25d54bbcab25b02c084f7548 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:34:44.929905 30992 raft_consensus.cc:2229] T d2b99795b3864d9fa781b72c661d7707 P 23ec90a7aa114b1aa03726aff1c19fe9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:34:44.930253 30992 raft_consensus.cc:2258] T d2b99795b3864d9fa781b72c661d7707 P 23ec90a7aa114b1aa03726aff1c19fe9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:34:44.932137 30992 ts_tablet_manager.cc:1905] T d2b99795b3864d9fa781b72c661d7707 P 23ec90a7aa114b1aa03726aff1c19fe9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:34:44.932144 30991 ts_tablet_manager.cc:1905] T d2b99795b3864d9fa781b72c661d7707 P 073d55db25d54bbcab25b02c084f7548: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:34:44.934926 30992 ts_tablet_manager.cc:1918] T d2b99795b3864d9fa781b72c661d7707 P 23ec90a7aa114b1aa03726aff1c19fe9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:34:44.934919 30991 ts_tablet_manager.cc:1918] T d2b99795b3864d9fa781b72c661d7707 P 073d55db25d54bbcab25b02c084f7548: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:34:44.935029 30992 log.cc:1196] T d2b99795b3864d9fa781b72c661d7707 P 23ec90a7aa114b1aa03726aff1c19fe9: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-1/wal/wals/d2b99795b3864d9fa781b72c661d7707
I20260809 15:34:44.935029 30991 log.cc:1196] T d2b99795b3864d9fa781b72c661d7707 P 073d55db25d54bbcab25b02c084f7548: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786289437399694-11848-0/minicluster-data/ts-2/wal/wals/d2b99795b3864d9fa781b72c661d7707
I20260809 15:34:44.935431 30991 ts_tablet_manager.cc:1939] T d2b99795b3864d9fa781b72c661d7707 P 073d55db25d54bbcab25b02c084f7548: Deleting consensus metadata
I20260809 15:34:44.935424 30992 ts_tablet_manager.cc:1939] T d2b99795b3864d9fa781b72c661d7707 P 23ec90a7aa114b1aa03726aff1c19fe9: Deleting consensus metadata
I20260809 15:34:44.936765 30396 catalog_manager.cc:4841] TS 073d55db25d54bbcab25b02c084f7548 (127.11.146.3:34983): tablet d2b99795b3864d9fa781b72c661d7707 (table test-table [id=2cb6d97ee2d647989788bcdf1ce1b949]) successfully deleted
I20260809 15:34:44.937000 30396 catalog_manager.cc:4841] TS 23ec90a7aa114b1aa03726aff1c19fe9 (127.11.146.2:46741): tablet d2b99795b3864d9fa781b72c661d7707 (table test-table [id=2cb6d97ee2d647989788bcdf1ce1b949]) successfully deleted
W20260809 15:34:44.938266 30399 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.146.1:35023 (error 108)
I20260809 15:34:44.939024 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 30638
I20260809 15:34:44.939296 30959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:44.938960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:35023 (local address 127.0.0.1:34020)
0809 15:34:44.939102 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:44.939180 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.1:35023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 15:34:44.941351 30399 catalog_manager.cc:4584] TS c6ffd8fbec29421c9249372489552833 (127.11.146.1:35023): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d2b99795b3864d9fa781b72c661d7707: Network error: Client connection negotiation failed: client connection to 127.11.146.1:35023: connect: Connection refused (error 111)
I20260809 15:34:44.947191 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 30797
I20260809 15:34:44.954483 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 30378
2026-08-09T15:34:44Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2271 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-09T15:34:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:34:44Z Disabled control of system clock
I20260809 15:34:44.986265 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:43249
--webserver_interface=127.11.146.62
--webserver_port=0
--builtin_ntp_servers=127.11.146.20:35741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:43249
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 15:34:45.095095 30998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:45.095338 30998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:45.095371 30998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:45.099316 30998 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:34:45.099365 30998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:45.099380 30998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:45.099397 30998 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:34:45.099442 30998 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:34:45.104162 30998 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:35741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:43249
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:43249
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30998
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:45.105129 30998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:45.106411 30998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:34:45.114545 31006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:45.114660 30998 server_base.cc:1034] running on GCE node
W20260809 15:34:45.114522 31004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:45.114530 31003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:45.115309 30998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:45.116371 30998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:45.117566 30998 hybrid_clock.cc:648] HybridClock initialized: now 1786289685117549 us; error 29 us; skew 500 ppm
I20260809 15:34:45.119297 30998 webserver.cc:460] Webserver started at http://127.11.146.62:39117/ using document root <none> and password file <none>
I20260809 15:34:45.119846 30998 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:45.119949 30998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:45.120205 30998 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:34:45.122162 30998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "851d70fef64547c28f5b06edcfff8990"
format_stamp: "Formatted at 2026-08-09 15:34:45 on dist-test-slave-1jjb"
server_key: "066d1cc52b34c4c4a3adc1956305ffea"
server_key_iv: "403f5190665e05e9a6a20a8de870fe35"
server_key_version: "encryptionkey@0"
I20260809 15:34:45.122692 30998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "851d70fef64547c28f5b06edcfff8990"
format_stamp: "Formatted at 2026-08-09 15:34:45 on dist-test-slave-1jjb"
server_key: "066d1cc52b34c4c4a3adc1956305ffea"
server_key_iv: "403f5190665e05e9a6a20a8de870fe35"
server_key_version: "encryptionkey@0"
I20260809 15:34:45.126108 30998 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260809 15:34:45.128363 31013 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:45.129503 30998 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 15:34:45.129631 30998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "851d70fef64547c28f5b06edcfff8990"
format_stamp: "Formatted at 2026-08-09 15:34:45 on dist-test-slave-1jjb"
server_key: "066d1cc52b34c4c4a3adc1956305ffea"
server_key_iv: "403f5190665e05e9a6a20a8de870fe35"
server_key_version: "encryptionkey@0"
I20260809 15:34:45.129732 30998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:45.163060 30998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:45.163759 30998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:45.163949 30998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:45.171025 30998 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:43249
I20260809 15:34:45.171036 31071 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:43249 every 8 connection(s)
I20260809 15:34:45.171947 30998 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:34:45.175143 31072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:34:45.180441 31072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 851d70fef64547c28f5b06edcfff8990: Bootstrap starting.
I20260809 15:34:45.182161 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 30998
I20260809 15:34:45.182283 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:34:45.182590 11848 external_mini_cluster.cc:1428] Setting key 2c4736ef011eeeee8987ebbf492fd5c0
I20260809 15:34:45.183076 31072 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 851d70fef64547c28f5b06edcfff8990: Neither blocks nor log segments found. Creating new log.
I20260809 15:34:45.183962 31072 log.cc:824] T 00000000000000000000000000000000 P 851d70fef64547c28f5b06edcfff8990: Log is configured to *not* fsync() on all Append() calls
I20260809 15:34:45.185779 31072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 851d70fef64547c28f5b06edcfff8990: No bootstrap required, opened a new log
I20260809 15:34:45.189308 31072 raft_consensus.cc:348] T 00000000000000000000000000000000 P 851d70fef64547c28f5b06edcfff8990 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "851d70fef64547c28f5b06edcfff8990" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43249 } }
I20260809 15:34:45.189543 31072 raft_consensus.cc:374] T 00000000000000000000000000000000 P 851d70fef64547c28f5b06edcfff8990 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:34:45.189618 31072 raft_consensus.cc:729] T 00000000000000000000000000000000 P 851d70fef64547c28f5b06edcfff8990 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 851d70fef64547c28f5b06edcfff8990, State: Initialized, Role: FOLLOWER
I20260809 15:34:45.190061 31072 consensus_queue.cc:260] T 00000000000000000000000000000000 P 851d70fef64547c28f5b06edcfff8990 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "851d70fef64547c28f5b06edcfff8990" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43249 } }
I20260809 15:34:45.190214 31072 raft_consensus.cc:388] T 00000000000000000000000000000000 P 851d70fef64547c28f5b06edcfff8990 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:34:45.190284 31072 raft_consensus.cc:482] T 00000000000000000000000000000000 P 851d70fef64547c28f5b06edcfff8990 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:34:45.190415 31072 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 851d70fef64547c28f5b06edcfff8990 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:34:45.191228 31075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:45.183717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48062 (local address 127.11.146.62:43249)
0809 15:34:45.184365 (+ 648us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:45.184383 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:45.184418 (+ 35us) server_negotiation.cc:407] Connection header received
0809 15:34:45.185050 (+ 632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:45.185065 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:45.185360 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:45.185674 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:45.186086 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.187032 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.187875 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.188396 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.188573 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:45.189432 (+ 859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:45.189438 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:45.189450 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:34:45.189930 (+ 480us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:45.189988 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:34:45.190009 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:45.190126 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:45.190265 (+ 139us) server_negotiation.cc:299] Negotiation successful
0809 15:34:45.190548 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":127,"threads_started":1}
I20260809 15:34:45.191289 31072 raft_consensus.cc:504] T 00000000000000000000000000000000 P 851d70fef64547c28f5b06edcfff8990 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "851d70fef64547c28f5b06edcfff8990" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43249 } }
I20260809 15:34:45.191661 31072 leader_election.cc:302] T 00000000000000000000000000000000 P 851d70fef64547c28f5b06edcfff8990 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 851d70fef64547c28f5b06edcfff8990; no voters:
I20260809 15:34:45.191982 31072 leader_election.cc:288] T 00000000000000000000000000000000 P 851d70fef64547c28f5b06edcfff8990 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:34:45.192162 31077 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 851d70fef64547c28f5b06edcfff8990 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:34:45.192384 31077 raft_consensus.cc:686] T 00000000000000000000000000000000 P 851d70fef64547c28f5b06edcfff8990 [term 1 LEADER]: Becoming Leader. State: Replica: 851d70fef64547c28f5b06edcfff8990, State: Running, Role: LEADER
I20260809 15:34:45.192736 31077 consensus_queue.cc:237] T 00000000000000000000000000000000 P 851d70fef64547c28f5b06edcfff8990 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "851d70fef64547c28f5b06edcfff8990" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43249 } }
I20260809 15:34:45.193166 31072 sys_catalog.cc:564] T 00000000000000000000000000000000 P 851d70fef64547c28f5b06edcfff8990 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:34:45.193881 31079 sys_catalog.cc:455] T 00000000000000000000000000000000 P 851d70fef64547c28f5b06edcfff8990 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 851d70fef64547c28f5b06edcfff8990. Latest consensus state: current_term: 1 leader_uuid: "851d70fef64547c28f5b06edcfff8990" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "851d70fef64547c28f5b06edcfff8990" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43249 } } }
I20260809 15:34:45.194123 31079 sys_catalog.cc:458] T 00000000000000000000000000000000 P 851d70fef64547c28f5b06edcfff8990 [sys.catalog]: This master's current role is: LEADER
I20260809 15:34:45.194289 31078 sys_catalog.cc:455] T 00000000000000000000000000000000 P 851d70fef64547c28f5b06edcfff8990 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "851d70fef64547c28f5b06edcfff8990" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "851d70fef64547c28f5b06edcfff8990" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 43249 } } }
I20260809 15:34:45.194380 31078 sys_catalog.cc:458] T 00000000000000000000000000000000 P 851d70fef64547c28f5b06edcfff8990 [sys.catalog]: This master's current role is: LEADER
I20260809 15:34:45.194694 31089 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:34:45.197742 31089 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:34:45.203171 31089 catalog_manager.cc:1347] Generated new cluster ID: 8371c96fb8f34655ae696c060e75d95f
I20260809 15:34:45.203243 31089 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:34:45.223634 31089 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:34:45.224581 31089 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:34:45.232038 31089 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 851d70fef64547c28f5b06edcfff8990: Generated new TSK 0
I20260809 15:34:45.232661 31089 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:34:45.240864 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.1:0
--local_ip_for_outbound_sockets=127.11.146.1
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:43249
--builtin_ntp_servers=127.11.146.20:35741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 15:34:45.355214 31100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:45.355461 31100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:45.355499 31100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:45.359467 31100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:45.359511 31100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:45.359606 31100 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.1
I20260809 15:34:45.363993 31100 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:35741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:43249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31100
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.1
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:45.364971 31100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:45.366231 31100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:34:45.375378 31106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:45.375375 31108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:45.375551 31105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:45.375769 31100 server_base.cc:1034] running on GCE node
I20260809 15:34:45.376190 31100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:45.376765 31100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:45.377918 31100 hybrid_clock.cc:648] HybridClock initialized: now 1786289685377905 us; error 27 us; skew 500 ppm
I20260809 15:34:45.379558 31100 webserver.cc:460] Webserver started at http://127.11.146.1:40247/ using document root <none> and password file <none>
I20260809 15:34:45.380133 31100 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:45.380196 31100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:45.380393 31100 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:34:45.382231 31100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-0/data/instance:
uuid: "ef7d0812626341ee96bfbbc3bbc5fc08"
format_stamp: "Formatted at 2026-08-09 15:34:45 on dist-test-slave-1jjb"
server_key: "029055ef74decefd247b9521426d92f7"
server_key_iv: "f377d71a48777bf04fdea908788895b0"
server_key_version: "encryptionkey@0"
I20260809 15:34:45.382783 31100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance:
uuid: "ef7d0812626341ee96bfbbc3bbc5fc08"
format_stamp: "Formatted at 2026-08-09 15:34:45 on dist-test-slave-1jjb"
server_key: "029055ef74decefd247b9521426d92f7"
server_key_iv: "f377d71a48777bf04fdea908788895b0"
server_key_version: "encryptionkey@0"
I20260809 15:34:45.386183 31100 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 15:34:45.388470 31115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:45.389544 31100 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:34:45.389654 31100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-0/wal
uuid: "ef7d0812626341ee96bfbbc3bbc5fc08"
format_stamp: "Formatted at 2026-08-09 15:34:45 on dist-test-slave-1jjb"
server_key: "029055ef74decefd247b9521426d92f7"
server_key_iv: "f377d71a48777bf04fdea908788895b0"
server_key_version: "encryptionkey@0"
I20260809 15:34:45.389750 31100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:45.404970 31100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:45.405545 31100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:45.405735 31100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:45.406250 31100 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:34:45.407152 31100 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:34:45.407199 31100 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:45.407263 31100 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:34:45.407295 31100 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:45.415588 31100 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.1:41001
I20260809 15:34:45.415603 31251 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.1:41001 every 8 connection(s)
I20260809 15:34:45.416499 31100 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
I20260809 15:34:45.418234 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 31100
I20260809 15:34:45.418357 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance
I20260809 15:34:45.418679 11848 external_mini_cluster.cc:1428] Setting key 28ba7fc55ef4e4d70e51bf0b6847b8dd
I20260809 15:34:45.420542 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.2:0
--local_ip_for_outbound_sockets=127.11.146.2
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:43249
--builtin_ntp_servers=127.11.146.20:35741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 15:34:45.425822 31075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:45.418178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:52715 (local address 127.11.146.62:43249)
0809 15:34:45.418342 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:45.418347 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:45.419452 (+ 1105us) server_negotiation.cc:407] Connection header received
0809 15:34:45.420938 (+ 1486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:45.420941 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:45.420999 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:45.421074 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:45.421895 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.422761 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.423872 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.424297 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.424429 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:45.425367 (+ 938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:45.425370 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:45.425373 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:34:45.425389 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:45.425407 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:34:45.425414 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:45.425481 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:45.425634 (+ 153us) server_negotiation.cc:299] Negotiation successful
0809 15:34:45.425695 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 15:34:45.426589 31254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:45.418593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43249 (local address 127.11.146.1:52715)
0809 15:34:45.419291 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:45.419339 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:45.420715 (+ 1376us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:45.421230 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:45.421237 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:45.421313 (+ 76us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:34:45.421754 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:45.421766 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.422897 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.422900 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:45.423755 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:45.423765 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.424435 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.424438 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:45.424575 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:45.425137 (+ 562us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:34:45.425138 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:34:45.425173 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:34:45.425226 (+ 53us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:34:45.425503 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:34:45.425516 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:34:45.425520 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 15:34:45.425629 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 15:34:45.425860 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":163,"threads_started":1}
I20260809 15:34:45.427728 31252 heartbeater.cc:347] Connected to a master server at 127.11.146.62:43249
I20260809 15:34:45.427974 31252 heartbeater.cc:464] Registering TS with master...
I20260809 15:34:45.428603 31252 heartbeater.cc:511] Master 127.11.146.62:43249 requested a full tablet report, sending...
I20260809 15:34:45.430087 31032 ts_manager.cc:194] Registered new tserver with Master: ef7d0812626341ee96bfbbc3bbc5fc08 (127.11.146.1:41001)
I20260809 15:34:45.431103 31032 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.146.1:52715
W20260809 15:34:45.531348 31255 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:45.531546 31255 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:45.531579 31255 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:45.535607 31255 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:45.535653 31255 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:45.535733 31255 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.2
I20260809 15:34:45.540338 31255 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:35741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:43249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31255
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.2
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:45.541281 31255 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:45.542552 31255 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:34:45.551644 31262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:45.551638 31264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:45.551641 31266 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:45.551872 31255 server_base.cc:1034] running on GCE node
I20260809 15:34:45.552429 31255 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:45.553025 31255 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:45.554222 31255 hybrid_clock.cc:648] HybridClock initialized: now 1786289685554188 us; error 47 us; skew 500 ppm
I20260809 15:34:45.556483 31255 webserver.cc:460] Webserver started at http://127.11.146.2:35459/ using document root <none> and password file <none>
I20260809 15:34:45.557148 31255 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:45.557233 31255 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:45.557406 31255 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:34:45.559259 31255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-1/data/instance:
uuid: "48bb6a13b0c948d2a1faaeca9ac55877"
format_stamp: "Formatted at 2026-08-09 15:34:45 on dist-test-slave-1jjb"
server_key: "aa37a96e58f8b66f4023e37a9d36a55b"
server_key_iv: "086480dacfa9a8b73c78c1a89513afdd"
server_key_version: "encryptionkey@0"
I20260809 15:34:45.559731 31255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance:
uuid: "48bb6a13b0c948d2a1faaeca9ac55877"
format_stamp: "Formatted at 2026-08-09 15:34:45 on dist-test-slave-1jjb"
server_key: "aa37a96e58f8b66f4023e37a9d36a55b"
server_key_iv: "086480dacfa9a8b73c78c1a89513afdd"
server_key_version: "encryptionkey@0"
I20260809 15:34:45.563109 31255 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 15:34:45.565292 31272 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:45.566375 31255 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:34:45.566461 31255 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-1/wal
uuid: "48bb6a13b0c948d2a1faaeca9ac55877"
format_stamp: "Formatted at 2026-08-09 15:34:45 on dist-test-slave-1jjb"
server_key: "aa37a96e58f8b66f4023e37a9d36a55b"
server_key_iv: "086480dacfa9a8b73c78c1a89513afdd"
server_key_version: "encryptionkey@0"
I20260809 15:34:45.566561 31255 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:45.576661 31255 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:45.577160 31255 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:45.577289 31255 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:45.577821 31255 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:34:45.578599 31255 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:34:45.578645 31255 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:45.578679 31255 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:34:45.578699 31255 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:45.586524 31255 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.2:42305
I20260809 15:34:45.586565 31407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.2:42305 every 8 connection(s)
I20260809 15:34:45.587321 31255 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
I20260809 15:34:45.587749 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 31255
I20260809 15:34:45.587873 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance
I20260809 15:34:45.588234 11848 external_mini_cluster.cc:1428] Setting key 801d834472d29c456a09c950b71c8f71
I20260809 15:34:45.590193 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.3:0
--local_ip_for_outbound_sockets=127.11.146.3
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:43249
--builtin_ntp_servers=127.11.146.20:35741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 15:34:45.597138 31075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:45.589023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:33389 (local address 127.11.146.62:43249)
0809 15:34:45.589158 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:45.589162 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:45.590287 (+ 1125us) server_negotiation.cc:407] Connection header received
0809 15:34:45.591659 (+ 1372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:45.591665 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:45.591729 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:45.591824 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:45.593046 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.593777 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.595016 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.595404 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.595551 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:45.596563 (+ 1012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:45.596570 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:45.596576 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:34:45.596595 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:45.596621 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:34:45.596635 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:45.596723 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:45.596853 (+ 130us) server_negotiation.cc:299] Negotiation successful
0809 15:34:45.596925 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 15:34:45.597805 31410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:45.589491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43249 (local address 127.11.146.2:33389)
0809 15:34:45.590152 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:45.590198 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:45.591438 (+ 1240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:45.592026 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:45.592035 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:45.592162 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:34:45.592858 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:45.592878 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.593900 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.593903 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:45.594816 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:45.594900 (+ 84us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.595563 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.595566 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:45.595711 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:45.596296 (+ 585us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:34:45.596298 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:34:45.596333 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:34:45.596397 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:34:45.596721 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:34:45.596727 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:34:45.596732 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 15:34:45.596821 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 15:34:45.597017 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":123,"threads_started":1}
I20260809 15:34:45.598851 31408 heartbeater.cc:347] Connected to a master server at 127.11.146.62:43249
I20260809 15:34:45.599073 31408 heartbeater.cc:464] Registering TS with master...
I20260809 15:34:45.599530 31408 heartbeater.cc:511] Master 127.11.146.62:43249 requested a full tablet report, sending...
I20260809 15:34:45.600538 31032 ts_manager.cc:194] Registered new tserver with Master: 48bb6a13b0c948d2a1faaeca9ac55877 (127.11.146.2:42305)
I20260809 15:34:45.601106 31032 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.146.2:33389
W20260809 15:34:45.697744 31411 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:45.697947 31411 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:45.698001 31411 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:45.701845 31411 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:45.701885 31411 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:45.701930 31411 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.3
I20260809 15:34:45.706214 31411 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:35741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:43249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31411
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.3
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:45.707082 31411 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:45.708312 31411 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:34:45.717057 31420 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:45.717125 31411 server_base.cc:1034] running on GCE node
W20260809 15:34:45.717152 31417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:45.717073 31418 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:45.717747 31411 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:45.718379 31411 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:45.719571 31411 hybrid_clock.cc:648] HybridClock initialized: now 1786289685719552 us; error 27 us; skew 500 ppm
I20260809 15:34:45.721585 31411 webserver.cc:460] Webserver started at http://127.11.146.3:38401/ using document root <none> and password file <none>
I20260809 15:34:45.722218 31411 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:45.722321 31411 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:45.722581 31411 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:34:45.724664 31411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-2/data/instance:
uuid: "be7111d1b55843cfac6b7c428f2b40a2"
format_stamp: "Formatted at 2026-08-09 15:34:45 on dist-test-slave-1jjb"
server_key: "3ed9814e5c097d0fc40686dcf88ffbe1"
server_key_iv: "d1dde113aa9fac935b7b79e63d0b6d99"
server_key_version: "encryptionkey@0"
I20260809 15:34:45.725242 31411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance:
uuid: "be7111d1b55843cfac6b7c428f2b40a2"
format_stamp: "Formatted at 2026-08-09 15:34:45 on dist-test-slave-1jjb"
server_key: "3ed9814e5c097d0fc40686dcf88ffbe1"
server_key_iv: "d1dde113aa9fac935b7b79e63d0b6d99"
server_key_version: "encryptionkey@0"
I20260809 15:34:45.729023 31411 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 15:34:45.731427 31426 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:45.732730 31411 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 15:34:45.732851 31411 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-2/wal
uuid: "be7111d1b55843cfac6b7c428f2b40a2"
format_stamp: "Formatted at 2026-08-09 15:34:45 on dist-test-slave-1jjb"
server_key: "3ed9814e5c097d0fc40686dcf88ffbe1"
server_key_iv: "d1dde113aa9fac935b7b79e63d0b6d99"
server_key_version: "encryptionkey@0"
I20260809 15:34:45.732959 31411 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:45.743059 31411 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:45.743700 31411 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:45.743904 31411 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:45.744565 31411 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:34:45.745563 31411 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:34:45.745620 31411 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:45.745707 31411 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:34:45.745754 31411 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:45.754020 31411 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.3:38739
I20260809 15:34:45.754042 31552 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.3:38739 every 8 connection(s)
I20260809 15:34:45.754851 31411 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
I20260809 15:34:45.757505 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 31411
I20260809 15:34:45.757611 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance
I20260809 15:34:45.757917 11848 external_mini_cluster.cc:1428] Setting key 14f3ab6476235725ee2cacf6d2a5d1cb
I20260809 15:34:45.764027 31075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:45.756565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:43511 (local address 127.11.146.62:43249)
0809 15:34:45.756713 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:45.756717 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:45.757841 (+ 1124us) server_negotiation.cc:407] Connection header received
0809 15:34:45.759555 (+ 1714us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:45.759558 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:45.759612 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:45.759689 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:45.760627 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.761141 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.762286 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.762519 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.762618 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:45.763566 (+ 948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:45.763570 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:45.763572 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:34:45.763584 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:45.763608 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:34:45.763615 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:45.763683 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:45.763832 (+ 149us) server_negotiation.cc:299] Negotiation successful
0809 15:34:45.763888 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 15:34:45.764748 31556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:45.756965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:43249 (local address 127.11.146.3:43511)
0809 15:34:45.757685 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:45.757737 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:45.759366 (+ 1629us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:45.759855 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:45.759861 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:45.759978 (+ 117us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:34:45.760488 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:45.760508 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.761258 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.761261 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:45.762165 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:45.762174 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.762663 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.762667 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:45.762825 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:45.763331 (+ 506us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:34:45.763332 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:34:45.763366 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:34:45.763423 (+ 57us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:34:45.763697 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:34:45.763706 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:34:45.763711 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 15:34:45.763831 (+ 120us) client_negotiation.cc:240] Negotiation successful
0809 15:34:45.764070 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":114,"threads_started":1}
I20260809 15:34:45.765647 31553 heartbeater.cc:347] Connected to a master server at 127.11.146.62:43249
I20260809 15:34:45.765856 31553 heartbeater.cc:464] Registering TS with master...
I20260809 15:34:45.766287 31553 heartbeater.cc:511] Master 127.11.146.62:43249 requested a full tablet report, sending...
I20260809 15:34:45.767196 31032 ts_manager.cc:194] Registered new tserver with Master: be7111d1b55843cfac6b7c428f2b40a2 (127.11.146.3:38739)
I20260809 15:34:45.767838 31032 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.146.3:43511
I20260809 15:34:45.771364 11848 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:34:45.776608 31075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:45.773170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48070 (local address 127.11.146.62:43249)
0809 15:34:45.773305 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:45.773311 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:45.773572 (+ 261us) server_negotiation.cc:407] Connection header received
0809 15:34:45.773662 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:45.773665 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:45.773700 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:45.773762 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:45.774004 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.774469 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.775237 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.775427 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.775494 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:45.776226 (+ 732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:45.776229 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:45.776232 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:34:45.776245 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:45.776265 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:34:45.776275 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:45.776385 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:45.776432 (+ 47us) server_negotiation.cc:299] Negotiation successful
0809 15:34:45.776494 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 15:34:45.779017 31032 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48070:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:34:45.781945 31032 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:34:45.795640 31567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:45.789908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55694 (local address 127.11.146.1:41001)
0809 15:34:45.790813 (+ 905us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:45.790824 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:45.790850 (+ 26us) server_negotiation.cc:407] Connection header received
0809 15:34:45.790931 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:45.790939 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:45.791148 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:45.791646 (+ 498us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:34:45.791803 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.792710 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.794287 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.794972 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.795090 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:45.795279 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:45.795399 (+ 120us) server_negotiation.cc:299] Negotiation successful
0809 15:34:45.795492 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":797,"thread_start_us":95,"threads_started":1}
I20260809 15:34:45.795634 31566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:45.789800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:41001 (local address 127.0.0.1:55694)
0809 15:34:45.790126 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:45.790174 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:45.790438 (+ 264us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:45.791322 (+ 884us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:45.791328 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:45.791348 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:34:45.791488 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:45.791495 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.792836 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.792841 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:45.794084 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:45.794096 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.795091 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.795094 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:45.795210 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:45.795245 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 15:34:45.795368 (+ 123us) client_negotiation.cc:240] Negotiation successful
0809 15:34:45.795492 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":85,"threads_started":1}
I20260809 15:34:45.796195 31570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:45.790466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:38739 (local address 127.0.0.1:58122)
0809 15:34:45.791166 (+ 700us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:45.791179 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:45.791413 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:45.791808 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:45.791811 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:45.791829 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:34:45.791923 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:45.791930 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.793317 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.793320 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:45.794566 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:45.794576 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.795789 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.795793 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:45.795874 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:45.795895 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 15:34:45.795968 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 15:34:45.796042 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":642,"thread_start_us":85,"threads_started":1}
I20260809 15:34:45.796449 31568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:45.790221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:42305 (local address 127.0.0.1:44704)
0809 15:34:45.791047 (+ 826us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:45.791060 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:45.791214 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:45.791970 (+ 756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:45.791973 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:45.791991 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:34:45.792106 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:45.792113 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.793619 (+ 1506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.793623 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:45.794789 (+ 1166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:45.794800 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.796047 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.796051 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:45.796163 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:45.796183 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 15:34:45.796265 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 15:34:45.796339 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":764,"thread_start_us":79,"threads_started":1}
I20260809 15:34:45.796633 31571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:45.790653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58122 (local address 127.11.146.3:38739)
0809 15:34:45.790955 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:45.790966 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:45.791344 (+ 378us) server_negotiation.cc:407] Connection header received
0809 15:34:45.791532 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:45.791538 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:45.791679 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:45.791828 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:34:45.792026 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.793194 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.794668 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.795453 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.795567 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:45.795724 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:45.796362 (+ 638us) server_negotiation.cc:299] Negotiation successful
0809 15:34:45.796449 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":129,"threads_started":1}
I20260809 15:34:45.796703 31569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:45.790384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44704 (local address 127.11.146.2:42305)
0809 15:34:45.790716 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:45.790735 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:45.791143 (+ 408us) server_negotiation.cc:407] Connection header received
0809 15:34:45.791475 (+ 332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:45.791481 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:45.791666 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:45.791778 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:34:45.792224 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.793373 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.794928 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.795708 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.795786 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:45.795946 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:45.796454 (+ 508us) server_negotiation.cc:299] Negotiation successful
0809 15:34:45.796550 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":90,"threads_started":1}
I20260809 15:34:45.798615 31168 tablet_service.cc:1467] Processing CreateTablet for tablet faac6e28aa184a199f2c59719d396544 (DEFAULT_TABLE table=test-table [id=f8cd2d6c8838497e820ed05ed55bbdc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:34:45.799659 31168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet faac6e28aa184a199f2c59719d396544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:34:45.800972 31333 tablet_service.cc:1467] Processing CreateTablet for tablet faac6e28aa184a199f2c59719d396544 (DEFAULT_TABLE table=test-table [id=f8cd2d6c8838497e820ed05ed55bbdc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:34:45.801949 31333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet faac6e28aa184a199f2c59719d396544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:34:45.802234 31477 tablet_service.cc:1467] Processing CreateTablet for tablet faac6e28aa184a199f2c59719d396544 (DEFAULT_TABLE table=test-table [id=f8cd2d6c8838497e820ed05ed55bbdc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:34:45.802970 31477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet faac6e28aa184a199f2c59719d396544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:34:45.807116 31572 tablet_bootstrap.cc:492] T faac6e28aa184a199f2c59719d396544 P ef7d0812626341ee96bfbbc3bbc5fc08: Bootstrap starting.
I20260809 15:34:45.808669 31573 tablet_bootstrap.cc:492] T faac6e28aa184a199f2c59719d396544 P be7111d1b55843cfac6b7c428f2b40a2: Bootstrap starting.
I20260809 15:34:45.809466 31574 tablet_bootstrap.cc:492] T faac6e28aa184a199f2c59719d396544 P 48bb6a13b0c948d2a1faaeca9ac55877: Bootstrap starting.
I20260809 15:34:45.810192 31572 tablet_bootstrap.cc:654] T faac6e28aa184a199f2c59719d396544 P ef7d0812626341ee96bfbbc3bbc5fc08: Neither blocks nor log segments found. Creating new log.
I20260809 15:34:45.810763 31573 tablet_bootstrap.cc:654] T faac6e28aa184a199f2c59719d396544 P be7111d1b55843cfac6b7c428f2b40a2: Neither blocks nor log segments found. Creating new log.
I20260809 15:34:45.810935 31572 log.cc:824] T faac6e28aa184a199f2c59719d396544 P ef7d0812626341ee96bfbbc3bbc5fc08: Log is configured to *not* fsync() on all Append() calls
I20260809 15:34:45.811513 31574 tablet_bootstrap.cc:654] T faac6e28aa184a199f2c59719d396544 P 48bb6a13b0c948d2a1faaeca9ac55877: Neither blocks nor log segments found. Creating new log.
I20260809 15:34:45.811585 31573 log.cc:824] T faac6e28aa184a199f2c59719d396544 P be7111d1b55843cfac6b7c428f2b40a2: Log is configured to *not* fsync() on all Append() calls
I20260809 15:34:45.812295 31574 log.cc:824] T faac6e28aa184a199f2c59719d396544 P 48bb6a13b0c948d2a1faaeca9ac55877: Log is configured to *not* fsync() on all Append() calls
I20260809 15:34:45.812937 31572 tablet_bootstrap.cc:492] T faac6e28aa184a199f2c59719d396544 P ef7d0812626341ee96bfbbc3bbc5fc08: No bootstrap required, opened a new log
I20260809 15:34:45.813133 31572 ts_tablet_manager.cc:1397] T faac6e28aa184a199f2c59719d396544 P ef7d0812626341ee96bfbbc3bbc5fc08: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 15:34:45.813462 31573 tablet_bootstrap.cc:492] T faac6e28aa184a199f2c59719d396544 P be7111d1b55843cfac6b7c428f2b40a2: No bootstrap required, opened a new log
I20260809 15:34:45.813627 31573 ts_tablet_manager.cc:1397] T faac6e28aa184a199f2c59719d396544 P be7111d1b55843cfac6b7c428f2b40a2: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 15:34:45.814216 31574 tablet_bootstrap.cc:492] T faac6e28aa184a199f2c59719d396544 P 48bb6a13b0c948d2a1faaeca9ac55877: No bootstrap required, opened a new log
I20260809 15:34:45.814384 31574 ts_tablet_manager.cc:1397] T faac6e28aa184a199f2c59719d396544 P 48bb6a13b0c948d2a1faaeca9ac55877: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 15:34:45.816869 31572 raft_consensus.cc:348] T faac6e28aa184a199f2c59719d396544 P ef7d0812626341ee96bfbbc3bbc5fc08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7d0812626341ee96bfbbc3bbc5fc08" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 41001 } } peers { permanent_uuid: "be7111d1b55843cfac6b7c428f2b40a2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38739 } } peers { permanent_uuid: "48bb6a13b0c948d2a1faaeca9ac55877" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 42305 } }
I20260809 15:34:45.817096 31572 raft_consensus.cc:374] T faac6e28aa184a199f2c59719d396544 P ef7d0812626341ee96bfbbc3bbc5fc08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:34:45.817169 31572 raft_consensus.cc:729] T faac6e28aa184a199f2c59719d396544 P ef7d0812626341ee96bfbbc3bbc5fc08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7d0812626341ee96bfbbc3bbc5fc08, State: Initialized, Role: FOLLOWER
I20260809 15:34:45.817615 31572 consensus_queue.cc:260] T faac6e28aa184a199f2c59719d396544 P ef7d0812626341ee96bfbbc3bbc5fc08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7d0812626341ee96bfbbc3bbc5fc08" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 41001 } } peers { permanent_uuid: "be7111d1b55843cfac6b7c428f2b40a2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38739 } } peers { permanent_uuid: "48bb6a13b0c948d2a1faaeca9ac55877" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 42305 } }
I20260809 15:34:45.817740 31573 raft_consensus.cc:348] T faac6e28aa184a199f2c59719d396544 P be7111d1b55843cfac6b7c428f2b40a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7d0812626341ee96bfbbc3bbc5fc08" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 41001 } } peers { permanent_uuid: "be7111d1b55843cfac6b7c428f2b40a2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38739 } } peers { permanent_uuid: "48bb6a13b0c948d2a1faaeca9ac55877" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 42305 } }
I20260809 15:34:45.818086 31573 raft_consensus.cc:374] T faac6e28aa184a199f2c59719d396544 P be7111d1b55843cfac6b7c428f2b40a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:34:45.818178 31573 raft_consensus.cc:729] T faac6e28aa184a199f2c59719d396544 P be7111d1b55843cfac6b7c428f2b40a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be7111d1b55843cfac6b7c428f2b40a2, State: Initialized, Role: FOLLOWER
I20260809 15:34:45.818272 31252 heartbeater.cc:503] Master 127.11.146.62:43249 was elected leader, sending a full tablet report...
I20260809 15:34:45.818403 31574 raft_consensus.cc:348] T faac6e28aa184a199f2c59719d396544 P 48bb6a13b0c948d2a1faaeca9ac55877 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7d0812626341ee96bfbbc3bbc5fc08" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 41001 } } peers { permanent_uuid: "be7111d1b55843cfac6b7c428f2b40a2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38739 } } peers { permanent_uuid: "48bb6a13b0c948d2a1faaeca9ac55877" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 42305 } }
I20260809 15:34:45.818625 31574 raft_consensus.cc:374] T faac6e28aa184a199f2c59719d396544 P 48bb6a13b0c948d2a1faaeca9ac55877 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:34:45.818643 31572 ts_tablet_manager.cc:1428] T faac6e28aa184a199f2c59719d396544 P ef7d0812626341ee96bfbbc3bbc5fc08: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 15:34:45.818670 31574 raft_consensus.cc:729] T faac6e28aa184a199f2c59719d396544 P 48bb6a13b0c948d2a1faaeca9ac55877 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bb6a13b0c948d2a1faaeca9ac55877, State: Initialized, Role: FOLLOWER
I20260809 15:34:45.818671 31573 consensus_queue.cc:260] T faac6e28aa184a199f2c59719d396544 P be7111d1b55843cfac6b7c428f2b40a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7d0812626341ee96bfbbc3bbc5fc08" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 41001 } } peers { permanent_uuid: "be7111d1b55843cfac6b7c428f2b40a2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38739 } } peers { permanent_uuid: "48bb6a13b0c948d2a1faaeca9ac55877" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 42305 } }
I20260809 15:34:45.819104 31574 consensus_queue.cc:260] T faac6e28aa184a199f2c59719d396544 P 48bb6a13b0c948d2a1faaeca9ac55877 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7d0812626341ee96bfbbc3bbc5fc08" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 41001 } } peers { permanent_uuid: "be7111d1b55843cfac6b7c428f2b40a2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38739 } } peers { permanent_uuid: "48bb6a13b0c948d2a1faaeca9ac55877" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 42305 } }
I20260809 15:34:45.819424 31553 heartbeater.cc:503] Master 127.11.146.62:43249 was elected leader, sending a full tablet report...
I20260809 15:34:45.819784 31408 heartbeater.cc:503] Master 127.11.146.62:43249 was elected leader, sending a full tablet report...
I20260809 15:34:45.820044 31574 ts_tablet_manager.cc:1428] T faac6e28aa184a199f2c59719d396544 P 48bb6a13b0c948d2a1faaeca9ac55877: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 15:34:45.819650 31573 ts_tablet_manager.cc:1428] T faac6e28aa184a199f2c59719d396544 P be7111d1b55843cfac6b7c428f2b40a2: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
W20260809 15:34:45.838230 31409 tablet.cc:2369] T faac6e28aa184a199f2c59719d396544 P 48bb6a13b0c948d2a1faaeca9ac55877: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 15:34:45.917547 31253 tablet.cc:2369] T faac6e28aa184a199f2c59719d396544 P ef7d0812626341ee96bfbbc3bbc5fc08: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:34:45.972609 31578 raft_consensus.cc:482] T faac6e28aa184a199f2c59719d396544 P ef7d0812626341ee96bfbbc3bbc5fc08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:34:45.972831 31578 raft_consensus.cc:504] T faac6e28aa184a199f2c59719d396544 P ef7d0812626341ee96bfbbc3bbc5fc08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7d0812626341ee96bfbbc3bbc5fc08" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 41001 } } peers { permanent_uuid: "be7111d1b55843cfac6b7c428f2b40a2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38739 } } peers { permanent_uuid: "48bb6a13b0c948d2a1faaeca9ac55877" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 42305 } }
I20260809 15:34:45.974114 31578 leader_election.cc:288] T faac6e28aa184a199f2c59719d396544 P ef7d0812626341ee96bfbbc3bbc5fc08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be7111d1b55843cfac6b7c428f2b40a2 (127.11.146.3:38739), 48bb6a13b0c948d2a1faaeca9ac55877 (127.11.146.2:42305)
I20260809 15:34:45.978271 31571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:45.974465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:39227 (local address 127.11.146.3:38739)
0809 15:34:45.974615 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:45.974621 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:45.974884 (+ 263us) server_negotiation.cc:407] Connection header received
0809 15:34:45.975040 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:45.975043 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:45.975082 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:45.975167 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:34:45.975458 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.975940 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.977325 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.977733 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.977864 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:45.977913 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:45.978079 (+ 166us) server_negotiation.cc:299] Negotiation successful
0809 15:34:45.978137 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 15:34:45.978291 31582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:45.974363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:38739 (local address 127.11.146.1:39227)
0809 15:34:45.974799 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:45.974810 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:45.974927 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:45.975188 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:45.975191 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:45.975206 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:34:45.975356 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:45.975361 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.976204 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.976207 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:45.977210 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:45.977220 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.977855 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.977858 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:45.977955 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:45.977986 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 15:34:45.978053 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 15:34:45.978119 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":380,"mutex_wait_us":82,"thread_start_us":96,"threads_started":1}
I20260809 15:34:45.978447 31569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:45.974513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:58473 (local address 127.11.146.2:42305)
0809 15:34:45.974704 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:45.974710 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:45.974795 (+ 85us) server_negotiation.cc:407] Connection header received
0809 15:34:45.974973 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:45.974976 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:45.975023 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:45.975109 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:34:45.975457 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.975949 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.977434 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.977857 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.977982 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:45.978032 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:45.978228 (+ 196us) server_negotiation.cc:299] Negotiation successful
0809 15:34:45.978309 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
I20260809 15:34:45.978468 31581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:45.974358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:42305 (local address 127.11.146.1:58473)
0809 15:34:45.974692 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:45.974709 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:45.974854 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:45.975121 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:45.975125 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:45.975152 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:34:45.975339 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:45.975346 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.976057 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.976062 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:45.977287 (+ 1225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:45.977305 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:45.977982 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:45.977987 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:45.978090 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:45.978109 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 15:34:45.978195 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 15:34:45.978292 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"mutex_wait_us":43,"thread_start_us":98,"threads_started":1}
I20260809 15:34:45.979058 31356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "faac6e28aa184a199f2c59719d396544" candidate_uuid: "ef7d0812626341ee96bfbbc3bbc5fc08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bb6a13b0c948d2a1faaeca9ac55877" is_pre_election: true
I20260809 15:34:45.979324 31500 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "faac6e28aa184a199f2c59719d396544" candidate_uuid: "ef7d0812626341ee96bfbbc3bbc5fc08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be7111d1b55843cfac6b7c428f2b40a2" is_pre_election: true
I20260809 15:34:45.979359 31356 raft_consensus.cc:2454] T faac6e28aa184a199f2c59719d396544 P 48bb6a13b0c948d2a1faaeca9ac55877 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7d0812626341ee96bfbbc3bbc5fc08 in term 0.
I20260809 15:34:45.979569 31500 raft_consensus.cc:2454] T faac6e28aa184a199f2c59719d396544 P be7111d1b55843cfac6b7c428f2b40a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7d0812626341ee96bfbbc3bbc5fc08 in term 0.
I20260809 15:34:45.979816 31116 leader_election.cc:302] T faac6e28aa184a199f2c59719d396544 P ef7d0812626341ee96bfbbc3bbc5fc08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bb6a13b0c948d2a1faaeca9ac55877, ef7d0812626341ee96bfbbc3bbc5fc08; no voters:
I20260809 15:34:45.980114 31578 raft_consensus.cc:2781] T faac6e28aa184a199f2c59719d396544 P ef7d0812626341ee96bfbbc3bbc5fc08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:34:45.980198 31578 raft_consensus.cc:482] T faac6e28aa184a199f2c59719d396544 P ef7d0812626341ee96bfbbc3bbc5fc08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:34:45.980242 31578 raft_consensus.cc:3037] T faac6e28aa184a199f2c59719d396544 P ef7d0812626341ee96bfbbc3bbc5fc08 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:34:45.981177 31578 raft_consensus.cc:504] T faac6e28aa184a199f2c59719d396544 P ef7d0812626341ee96bfbbc3bbc5fc08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7d0812626341ee96bfbbc3bbc5fc08" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 41001 } } peers { permanent_uuid: "be7111d1b55843cfac6b7c428f2b40a2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38739 } } peers { permanent_uuid: "48bb6a13b0c948d2a1faaeca9ac55877" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 42305 } }
I20260809 15:34:45.981479 31578 leader_election.cc:288] T faac6e28aa184a199f2c59719d396544 P ef7d0812626341ee96bfbbc3bbc5fc08 [CANDIDATE]: Term 1 election: Requested vote from peers be7111d1b55843cfac6b7c428f2b40a2 (127.11.146.3:38739), 48bb6a13b0c948d2a1faaeca9ac55877 (127.11.146.2:42305)
I20260809 15:34:45.981819 31500 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "faac6e28aa184a199f2c59719d396544" candidate_uuid: "ef7d0812626341ee96bfbbc3bbc5fc08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be7111d1b55843cfac6b7c428f2b40a2"
I20260809 15:34:45.981832 31356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "faac6e28aa184a199f2c59719d396544" candidate_uuid: "ef7d0812626341ee96bfbbc3bbc5fc08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bb6a13b0c948d2a1faaeca9ac55877"
I20260809 15:34:45.981933 31500 raft_consensus.cc:3037] T faac6e28aa184a199f2c59719d396544 P be7111d1b55843cfac6b7c428f2b40a2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:34:45.981933 31356 raft_consensus.cc:3037] T faac6e28aa184a199f2c59719d396544 P 48bb6a13b0c948d2a1faaeca9ac55877 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:34:45.983165 31356 raft_consensus.cc:2454] T faac6e28aa184a199f2c59719d396544 P 48bb6a13b0c948d2a1faaeca9ac55877 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7d0812626341ee96bfbbc3bbc5fc08 in term 1.
I20260809 15:34:45.983165 31500 raft_consensus.cc:2454] T faac6e28aa184a199f2c59719d396544 P be7111d1b55843cfac6b7c428f2b40a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7d0812626341ee96bfbbc3bbc5fc08 in term 1.
I20260809 15:34:45.983464 31118 leader_election.cc:302] T faac6e28aa184a199f2c59719d396544 P ef7d0812626341ee96bfbbc3bbc5fc08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be7111d1b55843cfac6b7c428f2b40a2, ef7d0812626341ee96bfbbc3bbc5fc08; no voters:
I20260809 15:34:45.983616 31578 raft_consensus.cc:2781] T faac6e28aa184a199f2c59719d396544 P ef7d0812626341ee96bfbbc3bbc5fc08 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:34:45.983819 31578 raft_consensus.cc:686] T faac6e28aa184a199f2c59719d396544 P ef7d0812626341ee96bfbbc3bbc5fc08 [term 1 LEADER]: Becoming Leader. State: Replica: ef7d0812626341ee96bfbbc3bbc5fc08, State: Running, Role: LEADER
I20260809 15:34:45.984159 31578 consensus_queue.cc:237] T faac6e28aa184a199f2c59719d396544 P ef7d0812626341ee96bfbbc3bbc5fc08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7d0812626341ee96bfbbc3bbc5fc08" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 41001 } } peers { permanent_uuid: "be7111d1b55843cfac6b7c428f2b40a2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38739 } } peers { permanent_uuid: "48bb6a13b0c948d2a1faaeca9ac55877" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 42305 } }
I20260809 15:34:45.987131 31032 catalog_manager.cc:5495] T faac6e28aa184a199f2c59719d396544 P ef7d0812626341ee96bfbbc3bbc5fc08 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef7d0812626341ee96bfbbc3bbc5fc08 (127.11.146.1). New cstate: current_term: 1 leader_uuid: "ef7d0812626341ee96bfbbc3bbc5fc08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7d0812626341ee96bfbbc3bbc5fc08" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 41001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be7111d1b55843cfac6b7c428f2b40a2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bb6a13b0c948d2a1faaeca9ac55877" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 42305 } health_report { overall_health: UNKNOWN } } }
W20260809 15:34:46.005781 31555 tablet.cc:2369] T faac6e28aa184a199f2c59719d396544 P be7111d1b55843cfac6b7c428f2b40a2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:34:46.030002 31567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:46.026822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55710 (local address 127.11.146.1:41001)
0809 15:34:46.026949 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:46.026953 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:46.026987 (+ 34us) server_negotiation.cc:407] Connection header received
0809 15:34:46.027057 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:46.027060 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:46.027116 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:46.027194 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:34:46.027427 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:46.027993 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:46.028783 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:46.028972 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:46.029041 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:46.029309 (+ 268us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:34:46.029689 (+ 380us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:34:46.029773 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:46.029853 (+ 80us) server_negotiation.cc:299] Negotiation successful
0809 15:34:46.029900 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 15:34:46.035503 31500 raft_consensus.cc:1261] T faac6e28aa184a199f2c59719d396544 P be7111d1b55843cfac6b7c428f2b40a2 [term 1 FOLLOWER]: Refusing update from remote peer ef7d0812626341ee96bfbbc3bbc5fc08: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:34:46.035507 31356 raft_consensus.cc:1261] T faac6e28aa184a199f2c59719d396544 P 48bb6a13b0c948d2a1faaeca9ac55877 [term 1 FOLLOWER]: Refusing update from remote peer ef7d0812626341ee96bfbbc3bbc5fc08: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:34:46.036192 31584 consensus_queue.cc:1035] T faac6e28aa184a199f2c59719d396544 P ef7d0812626341ee96bfbbc3bbc5fc08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be7111d1b55843cfac6b7c428f2b40a2" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:34:46.036378 31578 consensus_queue.cc:1035] T faac6e28aa184a199f2c59719d396544 P ef7d0812626341ee96bfbbc3bbc5fc08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bb6a13b0c948d2a1faaeca9ac55877" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 42305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:34:46.046586 31589 mvcc.cc:205] Tried to move back new op lower bound from 7316642553994555392 to 7316642553793724416. Current Snapshot: MvccSnapshot[applied={T|T < 7316642553994555392}]
I20260809 15:34:46.050258 31032 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48070:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:34:46.050427 31032 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48070:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:34:46.052671 31032 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 851d70fef64547c28f5b06edcfff8990: Sending DeleteTablet for 3 replicas of tablet faac6e28aa184a199f2c59719d396544
I20260809 15:34:46.053426 31168 tablet_service.cc:1514] Processing DeleteTablet for tablet faac6e28aa184a199f2c59719d396544 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:34:46 UTC) from {username='slave'} at 127.0.0.1:55694
I20260809 15:34:46.053426 31477 tablet_service.cc:1514] Processing DeleteTablet for tablet faac6e28aa184a199f2c59719d396544 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:34:46 UTC) from {username='slave'} at 127.0.0.1:58122
I20260809 15:34:46.053727 31333 tablet_service.cc:1514] Processing DeleteTablet for tablet faac6e28aa184a199f2c59719d396544 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:34:46 UTC) from {username='slave'} at 127.0.0.1:44704
I20260809 15:34:46.053850 31600 tablet_replica.cc:330] T faac6e28aa184a199f2c59719d396544 P be7111d1b55843cfac6b7c428f2b40a2: stopping tablet replica
I20260809 15:34:46.054129 31600 raft_consensus.cc:2229] T faac6e28aa184a199f2c59719d396544 P be7111d1b55843cfac6b7c428f2b40a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:34:46.054345 31601 tablet_replica.cc:330] T faac6e28aa184a199f2c59719d396544 P ef7d0812626341ee96bfbbc3bbc5fc08: stopping tablet replica
I20260809 15:34:46.054410 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 31100
I20260809 15:34:46.054468 31600 raft_consensus.cc:2258] T faac6e28aa184a199f2c59719d396544 P be7111d1b55843cfac6b7c428f2b40a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:34:46.055145 31602 tablet_replica.cc:330] T faac6e28aa184a199f2c59719d396544 P 48bb6a13b0c948d2a1faaeca9ac55877: stopping tablet replica
I20260809 15:34:46.055349 31602 raft_consensus.cc:2229] T faac6e28aa184a199f2c59719d396544 P 48bb6a13b0c948d2a1faaeca9ac55877 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:34:46.055537 31602 raft_consensus.cc:2258] T faac6e28aa184a199f2c59719d396544 P 48bb6a13b0c948d2a1faaeca9ac55877 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:34:46.056951 31602 ts_tablet_manager.cc:1905] T faac6e28aa184a199f2c59719d396544 P 48bb6a13b0c948d2a1faaeca9ac55877: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:34:46.059376 31602 ts_tablet_manager.cc:1918] T faac6e28aa184a199f2c59719d396544 P 48bb6a13b0c948d2a1faaeca9ac55877: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:34:46.059481 31602 log.cc:1196] T faac6e28aa184a199f2c59719d396544 P 48bb6a13b0c948d2a1faaeca9ac55877: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-1/wal/wals/faac6e28aa184a199f2c59719d396544
I20260809 15:34:46.059751 31602 ts_tablet_manager.cc:1939] T faac6e28aa184a199f2c59719d396544 P 48bb6a13b0c948d2a1faaeca9ac55877: Deleting consensus metadata
I20260809 15:34:46.060933 31015 catalog_manager.cc:4841] TS 48bb6a13b0c948d2a1faaeca9ac55877 (127.11.146.2:42305): tablet faac6e28aa184a199f2c59719d396544 (table test-table [id=f8cd2d6c8838497e820ed05ed55bbdc2]) successfully deleted
I20260809 15:34:46.061185 31600 ts_tablet_manager.cc:1905] T faac6e28aa184a199f2c59719d396544 P be7111d1b55843cfac6b7c428f2b40a2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:34:46.063108 31600 ts_tablet_manager.cc:1918] T faac6e28aa184a199f2c59719d396544 P be7111d1b55843cfac6b7c428f2b40a2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:34:46.063211 31600 log.cc:1196] T faac6e28aa184a199f2c59719d396544 P be7111d1b55843cfac6b7c428f2b40a2: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786289437399694-11848-0/minicluster-data/ts-2/wal/wals/faac6e28aa184a199f2c59719d396544
I20260809 15:34:46.063463 31600 ts_tablet_manager.cc:1939] T faac6e28aa184a199f2c59719d396544 P be7111d1b55843cfac6b7c428f2b40a2: Deleting consensus metadata
I20260809 15:34:46.064533 31017 catalog_manager.cc:4841] TS be7111d1b55843cfac6b7c428f2b40a2 (127.11.146.3:38739): tablet faac6e28aa184a199f2c59719d396544 (table test-table [id=f8cd2d6c8838497e820ed05ed55bbdc2]) successfully deleted
W20260809 15:34:46.064890 31017 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.146.1:41001 (error 108)
I20260809 15:34:46.065191 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 31255
I20260809 15:34:46.066516 31568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:46.066166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:41001 (local address 127.0.0.1:55722)
0809 15:34:46.066350 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:46.066423 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.1:41001: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
W20260809 15:34:46.066671 31017 catalog_manager.cc:4584] TS ef7d0812626341ee96bfbbc3bbc5fc08 (127.11.146.1:41001): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet faac6e28aa184a199f2c59719d396544: Network error: Client connection negotiation failed: client connection to 127.11.146.1:41001: connect: Connection refused (error 111)
I20260809 15:34:46.072321 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 31411
I20260809 15:34:46.083125 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 30998
2026-08-09T15:34:46Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1127 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:34:46 dist-test-slave-1jjb krb5kdc[31606](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:34:46 dist-test-slave-1jjb krb5kdc[31606](info): set up 2 sockets
Aug 09 15:34:46 dist-test-slave-1jjb krb5kdc[31606](info): commencing operation
krb5kdc: starting...
W20260809 15:34:47.151367 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.046s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:34:47 dist-test-slave-1jjb krb5kdc[31606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289687, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:34:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:34:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.146.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
I20260809 15:34:47.267343 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:46387
--webserver_interface=127.11.146.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:43535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:46387
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:34:47.376415 31622 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:47.376659 31622 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:47.376698 31622 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:47.380788 31622 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:34:47.380836 31622 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:47.380853 31622 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:47.380877 31622 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:34:47.380894 31622 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:34:47.385855 31622 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:43535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:46387
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:46387
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31622
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:47.386768 31622 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:47.387668 31622 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:34:47.396027 31627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:47.396162 31622 server_base.cc:1034] running on GCE node
W20260809 15:34:47.396049 31630 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:47.396164 31628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:47.396871 31622 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:47.397874 31622 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:47.399039 31622 hybrid_clock.cc:648] HybridClock initialized: now 1786289687399010 us; error 39 us; skew 500 ppm
Aug 09 15:34:47 dist-test-slave-1jjb krb5kdc[31606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289687, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:34:47.401821 31622 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:34:47.402659 31622 webserver.cc:460] Webserver started at http://127.11.146.62:39611/ using document root <none> and password file <none>
I20260809 15:34:47.403136 31622 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:47.403190 31622 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:47.403342 31622 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:34:47.405326 31622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "45fefb4bcc8d4b0896ab6b84e8279a58"
format_stamp: "Formatted at 2026-08-09 15:34:47 on dist-test-slave-1jjb"
server_key: "2e662eab82b78352a17a0c954197bcc4"
server_key_iv: "58e1c21c2e021f607fdc0e62163d24bb"
server_key_version: "encryptionkey@0"
I20260809 15:34:47.405839 31622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "45fefb4bcc8d4b0896ab6b84e8279a58"
format_stamp: "Formatted at 2026-08-09 15:34:47 on dist-test-slave-1jjb"
server_key: "2e662eab82b78352a17a0c954197bcc4"
server_key_iv: "58e1c21c2e021f607fdc0e62163d24bb"
server_key_version: "encryptionkey@0"
I20260809 15:34:47.409318 31622 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 15:34:47.411634 31638 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:47.412999 31622 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:34:47.413094 31622 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "45fefb4bcc8d4b0896ab6b84e8279a58"
format_stamp: "Formatted at 2026-08-09 15:34:47 on dist-test-slave-1jjb"
server_key: "2e662eab82b78352a17a0c954197bcc4"
server_key_iv: "58e1c21c2e021f607fdc0e62163d24bb"
server_key_version: "encryptionkey@0"
I20260809 15:34:47.413172 31622 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:47.423245 31622 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:47.426178 31622 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:47.426330 31622 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:47.433403 31622 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:46387
I20260809 15:34:47.433437 31698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:46387 every 8 connection(s)
I20260809 15:34:47.434239 31622 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:34:47.436789 31699 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:34:47.441883 31699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45fefb4bcc8d4b0896ab6b84e8279a58: Bootstrap starting.
I20260809 15:34:47.442948 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 31622
I20260809 15:34:47.443066 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:34:47.443356 11848 external_mini_cluster.cc:1428] Setting key 044c0481a89da9788b5026bf6bbd96ee
I20260809 15:34:47.444429 31699 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 45fefb4bcc8d4b0896ab6b84e8279a58: Neither blocks nor log segments found. Creating new log.
I20260809 15:34:47.445348 31699 log.cc:824] T 00000000000000000000000000000000 P 45fefb4bcc8d4b0896ab6b84e8279a58: Log is configured to *not* fsync() on all Append() calls
I20260809 15:34:47.447372 31699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45fefb4bcc8d4b0896ab6b84e8279a58: No bootstrap required, opened a new log
I20260809 15:34:47.451438 31699 raft_consensus.cc:348] T 00000000000000000000000000000000 P 45fefb4bcc8d4b0896ab6b84e8279a58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45fefb4bcc8d4b0896ab6b84e8279a58" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 46387 } }
I20260809 15:34:47.451658 31699 raft_consensus.cc:374] T 00000000000000000000000000000000 P 45fefb4bcc8d4b0896ab6b84e8279a58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:34:47.451732 31699 raft_consensus.cc:729] T 00000000000000000000000000000000 P 45fefb4bcc8d4b0896ab6b84e8279a58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45fefb4bcc8d4b0896ab6b84e8279a58, State: Initialized, Role: FOLLOWER
I20260809 15:34:47.452207 31699 consensus_queue.cc:260] T 00000000000000000000000000000000 P 45fefb4bcc8d4b0896ab6b84e8279a58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45fefb4bcc8d4b0896ab6b84e8279a58" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 46387 } }
Aug 09 15:34:47 dist-test-slave-1jjb krb5kdc[31606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289687, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:34:47.452342 31699 raft_consensus.cc:388] T 00000000000000000000000000000000 P 45fefb4bcc8d4b0896ab6b84e8279a58 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:34:47.452397 31699 raft_consensus.cc:482] T 00000000000000000000000000000000 P 45fefb4bcc8d4b0896ab6b84e8279a58 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:34:47.452502 31699 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 45fefb4bcc8d4b0896ab6b84e8279a58 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:34:47.453575 31699 raft_consensus.cc:504] T 00000000000000000000000000000000 P 45fefb4bcc8d4b0896ab6b84e8279a58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45fefb4bcc8d4b0896ab6b84e8279a58" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 46387 } }
I20260809 15:34:47.453954 31699 leader_election.cc:302] T 00000000000000000000000000000000 P 45fefb4bcc8d4b0896ab6b84e8279a58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 45fefb4bcc8d4b0896ab6b84e8279a58; no voters:
I20260809 15:34:47.454299 31699 leader_election.cc:288] T 00000000000000000000000000000000 P 45fefb4bcc8d4b0896ab6b84e8279a58 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:34:47.454383 31704 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 45fefb4bcc8d4b0896ab6b84e8279a58 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:34:47.454624 31704 raft_consensus.cc:686] T 00000000000000000000000000000000 P 45fefb4bcc8d4b0896ab6b84e8279a58 [term 1 LEADER]: Becoming Leader. State: Replica: 45fefb4bcc8d4b0896ab6b84e8279a58, State: Running, Role: LEADER
I20260809 15:34:47.454965 31704 consensus_queue.cc:237] T 00000000000000000000000000000000 P 45fefb4bcc8d4b0896ab6b84e8279a58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45fefb4bcc8d4b0896ab6b84e8279a58" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 46387 } }
I20260809 15:34:47.455601 31699 sys_catalog.cc:564] T 00000000000000000000000000000000 P 45fefb4bcc8d4b0896ab6b84e8279a58 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:34:47.456624 31706 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45fefb4bcc8d4b0896ab6b84e8279a58 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45fefb4bcc8d4b0896ab6b84e8279a58. Latest consensus state: current_term: 1 leader_uuid: "45fefb4bcc8d4b0896ab6b84e8279a58" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45fefb4bcc8d4b0896ab6b84e8279a58" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 46387 } } }
I20260809 15:34:47.456768 31706 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45fefb4bcc8d4b0896ab6b84e8279a58 [sys.catalog]: This master's current role is: LEADER
I20260809 15:34:47.457059 31705 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45fefb4bcc8d4b0896ab6b84e8279a58 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "45fefb4bcc8d4b0896ab6b84e8279a58" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45fefb4bcc8d4b0896ab6b84e8279a58" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 46387 } } }
I20260809 15:34:47.457173 31705 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45fefb4bcc8d4b0896ab6b84e8279a58 [sys.catalog]: This master's current role is: LEADER
I20260809 15:34:47.458283 31702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:47.444416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50072 (local address 127.11.146.62:46387)
0809 15:34:47.444899 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:47.444918 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:47.444958 (+ 40us) server_negotiation.cc:407] Connection header received
0809 15:34:47.445801 (+ 843us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:47.445819 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:47.446168 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:47.446471 (+ 303us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:47.447138 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:47.448603 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:47.449458 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:47.450258 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:47.450414 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:47.452938 (+ 2524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:47.452944 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:47.452958 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:34:47.452987 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:47.454891 (+ 1904us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:47.455409 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:47.455415 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:47.455420 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:47.455550 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:47.455878 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:47.455881 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:47.455883 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:47.456408 (+ 525us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:47.456675 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:47.456962 (+ 287us) server_negotiation.cc:299] Negotiation successful
0809 15:34:47.457269 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":341,"thread_start_us":159,"threads_started":1}
W20260809 15:34:47.460558 31722 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 45fefb4bcc8d4b0896ab6b84e8279a58: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:34:47.460636 31722 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:34:47.460698 31714 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:34:47.461532 31714 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:34:47.466724 31714 catalog_manager.cc:1347] Generated new cluster ID: a2658510b44d4e03ab7e9440ba5d7b8e
I20260809 15:34:47.466794 31714 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:34:47.485215 31714 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:34:47.486106 31714 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:34:47.494575 31714 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 45fefb4bcc8d4b0896ab6b84e8279a58: Generated new TSK 0
I20260809 15:34:47.495329 31714 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.146.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
I20260809 15:34:47.530328 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.1:0
--local_ip_for_outbound_sockets=127.11.146.1
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:46387
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:43535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:34:47.638918 31728 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:47.639160 31728 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:47.639225 31728 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:47.643167 31728 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:47.643239 31728 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:47.643318 31728 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.1
I20260809 15:34:47.648268 31728 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:43535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:46387
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31728
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.1
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:47.649219 31728 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:47.650177 31728 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:34:47.659269 31736 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:47.659282 31734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:47.659296 31733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:47.659446 31728 server_base.cc:1034] running on GCE node
I20260809 15:34:47.659941 31728 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:47.660597 31728 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:47.661751 31728 hybrid_clock.cc:648] HybridClock initialized: now 1786289687661738 us; error 24 us; skew 500 ppm
Aug 09 15:34:47 dist-test-slave-1jjb krb5kdc[31606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289687, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:34:47.664486 31728 init.cc:377] Logged in from keytab as kudu/127.11.146.1@KRBTEST.COM (short username kudu)
I20260809 15:34:47.665259 31728 webserver.cc:460] Webserver started at http://127.11.146.1:35655/ using document root <none> and password file <none>
I20260809 15:34:47.665824 31728 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:47.665885 31728 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:47.666102 31728 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:34:47.667974 31728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-0/data/instance:
uuid: "fb0b57acfdc7409c9c9f9d8e7e7c1913"
format_stamp: "Formatted at 2026-08-09 15:34:47 on dist-test-slave-1jjb"
server_key: "31636f0c1fe45801620d9395948204ab"
server_key_iv: "d11f87fbd142d41654febd6fce2cfc7f"
server_key_version: "encryptionkey@0"
I20260809 15:34:47.668610 31728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance:
uuid: "fb0b57acfdc7409c9c9f9d8e7e7c1913"
format_stamp: "Formatted at 2026-08-09 15:34:47 on dist-test-slave-1jjb"
server_key: "31636f0c1fe45801620d9395948204ab"
server_key_iv: "d11f87fbd142d41654febd6fce2cfc7f"
server_key_version: "encryptionkey@0"
I20260809 15:34:47.672111 31728 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:34:47.674225 31746 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:47.675302 31728 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:34:47.675426 31728 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-0/wal
uuid: "fb0b57acfdc7409c9c9f9d8e7e7c1913"
format_stamp: "Formatted at 2026-08-09 15:34:47 on dist-test-slave-1jjb"
server_key: "31636f0c1fe45801620d9395948204ab"
server_key_iv: "d11f87fbd142d41654febd6fce2cfc7f"
server_key_version: "encryptionkey@0"
I20260809 15:34:47.675522 31728 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:47.688488 31728 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:47.691430 31728 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:47.691608 31728 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:47.692137 31728 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:34:47.692854 31728 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:34:47.692919 31728 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:47.692983 31728 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:34:47.693027 31728 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:47.701380 31728 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.1:41735
I20260809 15:34:47.701426 31868 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.1:41735 every 8 connection(s)
I20260809 15:34:47.702241 31728 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
I20260809 15:34:47.706450 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 31728
I20260809 15:34:47.706591 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance
I20260809 15:34:47.706856 11848 external_mini_cluster.cc:1428] Setting key 1b49452635ce722b4827b9bfbea82e81
Aug 09 15:34:47 dist-test-slave-1jjb krb5kdc[31606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289687, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:34:47.716408 31702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:47.704041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:36075 (local address 127.11.146.62:46387)
0809 15:34:47.704222 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:47.704226 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:47.705063 (+ 837us) server_negotiation.cc:407] Connection header received
0809 15:34:47.706354 (+ 1291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:47.706358 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:47.706418 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:47.706520 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:47.707833 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:47.708572 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:47.709671 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:47.710082 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:47.710207 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:47.713066 (+ 2859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:47.713069 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:47.713070 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:34:47.713093 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:47.714507 (+ 1414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:47.714976 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:47.714981 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:47.714983 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:47.715067 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:47.715389 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:47.715393 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:47.715395 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:47.715564 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:47.715673 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:47.716131 (+ 458us) server_negotiation.cc:299] Negotiation successful
0809 15:34:47.716251 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 15:34:47.717202 31871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:47.704488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:46387 (local address 127.11.146.1:36075)
0809 15:34:47.704930 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:47.704970 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:47.706159 (+ 1189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:47.706716 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:47.706722 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:47.707084 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:34:47.707687 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:47.707705 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:47.708696 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:47.708699 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:47.709549 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:47.709558 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:47.710219 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:47.710222 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:47.710460 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:47.711056 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:34:47.711079 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:34:47.712900 (+ 1821us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:34:47.714619 (+ 1719us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:34:47.714625 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:34:47.714637 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:34:47.714878 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:34:47.715163 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:34:47.715166 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:34:47.715168 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:34:47.715298 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:34:47.715671 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:34:47.715677 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:34:47.715897 (+ 220us) client_negotiation.cc:769] Sending connection context
0809 15:34:47.716069 (+ 172us) client_negotiation.cc:240] Negotiation successful
0809 15:34:47.716409 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":114,"threads_started":1}
I20260809 15:34:47.718585 31869 heartbeater.cc:347] Connected to a master server at 127.11.146.62:46387
I20260809 15:34:47.718812 31869 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.11.146.2@KRBTEST.COM; defaulting to no policy
I20260809 15:34:47.719238 31869 heartbeater.cc:511] Master 127.11.146.62:46387 requested a full tablet report, sending...
I20260809 15:34:47.720731 31658 ts_manager.cc:194] Registered new tserver with Master: fb0b57acfdc7409c9c9f9d8e7e7c1913 (127.11.146.1:41735)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.2@KRBTEST.COM" created.
I20260809 15:34:47.722146 31658 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.1@KRBTEST.COM'} at 127.11.146.1:36075
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
I20260809 15:34:47.736603 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.2:0
--local_ip_for_outbound_sockets=127.11.146.2
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:46387
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:43535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:34:47.842871 31874 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:47.843082 31874 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:47.843139 31874 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:47.847028 31874 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:47.847074 31874 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:47.847155 31874 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.2
I20260809 15:34:47.851967 31874 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:43535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:46387
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31874
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.2
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:47.852859 31874 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:47.853796 31874 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:34:47.862952 31880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:47.863065 31874 server_base.cc:1034] running on GCE node
W20260809 15:34:47.863001 31882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:47.863001 31879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:47.863571 31874 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:47.864225 31874 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:47.865396 31874 hybrid_clock.cc:648] HybridClock initialized: now 1786289687865378 us; error 48 us; skew 500 ppm
Aug 09 15:34:47 dist-test-slave-1jjb krb5kdc[31606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289687, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:34:47.867956 31874 init.cc:377] Logged in from keytab as kudu/127.11.146.2@KRBTEST.COM (short username kudu)
I20260809 15:34:47.868718 31874 webserver.cc:460] Webserver started at http://127.11.146.2:41421/ using document root <none> and password file <none>
I20260809 15:34:47.869246 31874 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:47.869333 31874 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:47.869552 31874 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:34:47.871398 31874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-1/data/instance:
uuid: "61c348e1af894ab9b8f3d1aa46ce0fe0"
format_stamp: "Formatted at 2026-08-09 15:34:47 on dist-test-slave-1jjb"
server_key: "5a3f5c3327be310de66e09e859e2e39b"
server_key_iv: "3c0fd067d4224e4409e7602dcaaec466"
server_key_version: "encryptionkey@0"
I20260809 15:34:47.871953 31874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance:
uuid: "61c348e1af894ab9b8f3d1aa46ce0fe0"
format_stamp: "Formatted at 2026-08-09 15:34:47 on dist-test-slave-1jjb"
server_key: "5a3f5c3327be310de66e09e859e2e39b"
server_key_iv: "3c0fd067d4224e4409e7602dcaaec466"
server_key_version: "encryptionkey@0"
I20260809 15:34:47.875247 31874 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.002s
I20260809 15:34:47.877462 31889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:47.878587 31874 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:34:47.878690 31874 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-1/wal
uuid: "61c348e1af894ab9b8f3d1aa46ce0fe0"
format_stamp: "Formatted at 2026-08-09 15:34:47 on dist-test-slave-1jjb"
server_key: "5a3f5c3327be310de66e09e859e2e39b"
server_key_iv: "3c0fd067d4224e4409e7602dcaaec466"
server_key_version: "encryptionkey@0"
I20260809 15:34:47.878787 31874 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:47.890493 31874 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:47.893074 31874 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:47.893255 31874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:47.893778 31874 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:34:47.894507 31874 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:34:47.894591 31874 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:47.894656 31874 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:34:47.894701 31874 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:47.903075 31874 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.2:36143
I20260809 15:34:47.903098 32017 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.2:36143 every 8 connection(s)
I20260809 15:34:47.903877 31874 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
I20260809 15:34:47.912242 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 31874
I20260809 15:34:47.912372 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance
Aug 09 15:34:47 dist-test-slave-1jjb krb5kdc[31606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289687, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:34:47.912667 11848 external_mini_cluster.cc:1428] Setting key 701576190d941b27cc4423c273c8c9b1
I20260809 15:34:47.916476 31702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:47.905585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:39487 (local address 127.11.146.62:46387)
0809 15:34:47.905722 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:47.905726 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:47.906477 (+ 751us) server_negotiation.cc:407] Connection header received
0809 15:34:47.907614 (+ 1137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:47.907617 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:47.907663 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:47.907734 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:47.908811 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:47.909345 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:47.910391 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:47.910574 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:47.910642 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:47.913004 (+ 2362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:47.913012 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:47.913014 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:34:47.913056 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:47.914466 (+ 1410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:47.914948 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:47.914952 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:47.914954 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:47.915037 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:47.915351 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:47.915355 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:47.915357 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:47.915525 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:47.915627 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:47.916142 (+ 515us) server_negotiation.cc:299] Negotiation successful
0809 15:34:47.916309 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 15:34:47.917222 32021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:47.905940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:46387 (local address 127.11.146.2:39487)
0809 15:34:47.906333 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:47.906370 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:47.907424 (+ 1054us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:47.907878 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:47.907884 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:47.908265 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:34:47.908684 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:47.908696 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:47.909445 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:47.909448 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:47.910286 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:47.910295 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:47.910683 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:47.910686 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:47.910804 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:47.911327 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:34:47.911341 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:34:47.912847 (+ 1506us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:34:47.914595 (+ 1748us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:34:47.914600 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:34:47.914612 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:34:47.914848 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:34:47.915126 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:34:47.915130 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:34:47.915131 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:34:47.915260 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:34:47.915627 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:34:47.915634 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:34:47.915876 (+ 242us) client_negotiation.cc:769] Sending connection context
0809 15:34:47.916051 (+ 175us) client_negotiation.cc:240] Negotiation successful
0809 15:34:47.916399 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":99,"threads_started":1}
I20260809 15:34:47.918263 32018 heartbeater.cc:347] Connected to a master server at 127.11.146.62:46387
I20260809 15:34:47.918476 32018 heartbeater.cc:464] Registering TS with master...
I20260809 15:34:47.918936 32018 heartbeater.cc:511] Master 127.11.146.62:46387 requested a full tablet report, sending...
I20260809 15:34:47.919920 31658 ts_manager.cc:194] Registered new tserver with Master: 61c348e1af894ab9b8f3d1aa46ce0fe0 (127.11.146.2:36143)
I20260809 15:34:47.920789 31658 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.2@KRBTEST.COM'} at 127.11.146.2:39487
WARNING: no policy specified for kudu/127.11.146.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
I20260809 15:34:47.939512 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.3:0
--local_ip_for_outbound_sockets=127.11.146.3
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:46387
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:43535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:34:48.047134 32025 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:48.047344 32025 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:48.047384 32025 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:48.051280 32025 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:48.051327 32025 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:48.051380 32025 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.3
I20260809 15:34:48.056456 32025 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:43535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:46387
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32025
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.3
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:48.057338 32025 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:48.058167 32025 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:34:48.067044 32030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:48.067107 32031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:48.067167 32025 server_base.cc:1034] running on GCE node
W20260809 15:34:48.067049 32033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:48.067682 32025 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:48.068284 32025 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:48.069453 32025 hybrid_clock.cc:648] HybridClock initialized: now 1786289688069438 us; error 23 us; skew 500 ppm
Aug 09 15:34:48 dist-test-slave-1jjb krb5kdc[31606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289688, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:34:48.071970 32025 init.cc:377] Logged in from keytab as kudu/127.11.146.3@KRBTEST.COM (short username kudu)
I20260809 15:34:48.072770 32025 webserver.cc:460] Webserver started at http://127.11.146.3:39485/ using document root <none> and password file <none>
I20260809 15:34:48.073256 32025 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:48.073338 32025 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:48.073555 32025 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:34:48.075398 32025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-2/data/instance:
uuid: "af758c39cd0f47fcaacd2c1bd8840aa4"
format_stamp: "Formatted at 2026-08-09 15:34:48 on dist-test-slave-1jjb"
server_key: "a83c2cf0e298230769604c249326a7ab"
server_key_iv: "31f588d42bd3b53b15b00c89213057ca"
server_key_version: "encryptionkey@0"
I20260809 15:34:48.075922 32025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance:
uuid: "af758c39cd0f47fcaacd2c1bd8840aa4"
format_stamp: "Formatted at 2026-08-09 15:34:48 on dist-test-slave-1jjb"
server_key: "a83c2cf0e298230769604c249326a7ab"
server_key_iv: "31f588d42bd3b53b15b00c89213057ca"
server_key_version: "encryptionkey@0"
I20260809 15:34:48.079499 32025 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:34:48.081840 32040 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:48.083019 32025 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:34:48.083163 32025 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-2/wal
uuid: "af758c39cd0f47fcaacd2c1bd8840aa4"
format_stamp: "Formatted at 2026-08-09 15:34:48 on dist-test-slave-1jjb"
server_key: "a83c2cf0e298230769604c249326a7ab"
server_key_iv: "31f588d42bd3b53b15b00c89213057ca"
server_key_version: "encryptionkey@0"
I20260809 15:34:48.083247 32025 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:48.099916 32025 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:48.102376 32025 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:48.102533 32025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:48.102983 32025 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:34:48.103669 32025 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:34:48.103714 32025 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:48.103761 32025 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:34:48.103782 32025 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:48.112280 32025 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.3:39835
I20260809 15:34:48.112401 32163 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.3:39835 every 8 connection(s)
I20260809 15:34:48.113126 32025 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
I20260809 15:34:48.115224 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 32025
I20260809 15:34:48.115347 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance
I20260809 15:34:48.115686 11848 external_mini_cluster.cc:1428] Setting key 821606dac8b2092d434a660eb90c8d81
Aug 09 15:34:48 dist-test-slave-1jjb krb5kdc[31606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289688, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:34:48.126127 31702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:48.114855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:39625 (local address 127.11.146.62:46387)
0809 15:34:48.114981 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:48.114985 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:48.115941 (+ 956us) server_negotiation.cc:407] Connection header received
0809 15:34:48.117462 (+ 1521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:48.117465 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:48.117531 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:48.117625 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:48.118680 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.119186 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.120332 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.120543 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.120659 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:48.122938 (+ 2279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:48.122941 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:48.122944 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:34:48.122972 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:48.124203 (+ 1231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:48.124686 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:48.124690 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:48.124692 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:48.124774 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:48.125104 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:48.125108 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:48.125110 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:48.125285 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:48.125391 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:48.125839 (+ 448us) server_negotiation.cc:299] Negotiation successful
0809 15:34:48.125964 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 15:34:48.126871 32166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:48.115273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:46387 (local address 127.11.146.3:39625)
0809 15:34:48.115804 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:48.115857 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:48.117262 (+ 1405us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:48.117790 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:48.117796 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:48.118126 (+ 330us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:34:48.118551 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:48.118563 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.119302 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.119305 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:48.120205 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:48.120215 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.120693 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.120697 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:48.120867 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:48.121337 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:34:48.121351 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:34:48.122797 (+ 1446us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:34:48.124308 (+ 1511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:34:48.124314 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:34:48.124326 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:34:48.124585 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:34:48.124863 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:34:48.124867 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:34:48.124868 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:34:48.125004 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:34:48.125389 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:34:48.125395 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:34:48.125618 (+ 223us) client_negotiation.cc:769] Sending connection context
0809 15:34:48.125790 (+ 172us) client_negotiation.cc:240] Negotiation successful
0809 15:34:48.126086 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":129,"threads_started":1}
I20260809 15:34:48.127846 32164 heartbeater.cc:347] Connected to a master server at 127.11.146.62:46387
I20260809 15:34:48.128063 32164 heartbeater.cc:464] Registering TS with master...
I20260809 15:34:48.128628 32164 heartbeater.cc:511] Master 127.11.146.62:46387 requested a full tablet report, sending...
I20260809 15:34:48.129632 31658 ts_manager.cc:194] Registered new tserver with Master: af758c39cd0f47fcaacd2c1bd8840aa4 (127.11.146.3:39835)
I20260809 15:34:48.130131 31658 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.3@KRBTEST.COM'} at 127.11.146.3:39625
I20260809 15:34:48.140993 11848 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:34:48.149514 31702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:48.142868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50086 (local address 127.11.146.62:46387)
0809 15:34:48.142978 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:48.142981 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:48.143154 (+ 173us) server_negotiation.cc:407] Connection header received
0809 15:34:48.143248 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:48.143250 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:48.143284 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:48.143350 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:48.143954 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.144454 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.145215 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.145414 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.145480 (+ 66us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:48.146842 (+ 1362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:48.146844 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:48.146846 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:34:48.146867 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:48.148084 (+ 1217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:48.148534 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:48.148537 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:48.148538 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:48.148600 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:48.148842 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:48.148844 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:48.148845 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:48.149007 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:48.149138 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:48.149348 (+ 210us) server_negotiation.cc:299] Negotiation successful
0809 15:34:48.149417 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 15:34:48.151994 31658 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50086:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:34:48.154778 31658 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:34:48.168952 32176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:48.162855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:36143 (local address 127.0.0.1:40904)
0809 15:34:48.163333 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:48.163347 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:48.163427 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:48.164315 (+ 888us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:48.164321 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:48.164344 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:34:48.164487 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:48.164494 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.165941 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.165944 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:48.167309 (+ 1365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:48.167320 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.168437 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.168441 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:48.168554 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:48.168589 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 15:34:48.168671 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 15:34:48.168792 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":407,"mutex_wait_us":3,"thread_start_us":93,"threads_started":1}
I20260809 15:34:48.169304 32179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:48.163941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:41735 (local address 127.0.0.1:41906)
0809 15:34:48.164179 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:48.164193 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:48.164332 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:48.165114 (+ 782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:48.165117 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:48.165136 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:34:48.165219 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:48.165225 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.166279 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.166282 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:48.167445 (+ 1163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:48.167453 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.168656 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.168661 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:48.168776 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:48.168796 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 15:34:48.168866 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 15:34:48.168922 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"mutex_wait_us":33,"thread_start_us":95,"threads_started":1}
I20260809 15:34:48.169406 32180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:48.164117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41906 (local address 127.11.146.1:41735)
0809 15:34:48.164771 (+ 654us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:48.164780 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:48.164798 (+ 18us) server_negotiation.cc:407] Connection header received
0809 15:34:48.164854 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:48.164857 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:48.164976 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:48.165131 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:34:48.165339 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.166121 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.167556 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.168327 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.168450 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:48.168592 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:48.168931 (+ 339us) server_negotiation.cc:299] Negotiation successful
0809 15:34:48.169254 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":547,"thread_start_us":151,"threads_started":1}
I20260809 15:34:48.169782 32178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:48.163416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40904 (local address 127.11.146.2:36143)
0809 15:34:48.163799 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:48.163811 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:48.163835 (+ 24us) server_negotiation.cc:407] Connection header received
0809 15:34:48.163906 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:48.163910 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:48.164104 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:48.164287 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:34:48.164619 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.165803 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.167429 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.168280 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.169187 (+ 907us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:48.169484 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:48.169544 (+ 60us) server_negotiation.cc:299] Negotiation successful
0809 15:34:48.169644 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":106,"threads_started":1}
I20260809 15:34:48.169564 32175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:48.162694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:39835 (local address 127.0.0.1:54938)
0809 15:34:48.163006 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:48.163049 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:48.163167 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:48.164482 (+ 1315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:48.164485 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:48.164512 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:34:48.164614 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:48.164620 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.167445 (+ 2825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.167447 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:48.168276 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:48.168284 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.169115 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.169119 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:48.169285 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:48.169309 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 15:34:48.169358 (+ 49us) client_negotiation.cc:240] Negotiation successful
0809 15:34:48.169428 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":69,"threads_started":1}
I20260809 15:34:48.170100 32177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:48.162812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54938 (local address 127.11.146.3:39835)
0809 15:34:48.163482 (+ 670us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:48.163494 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:48.163514 (+ 20us) server_negotiation.cc:407] Connection header received
0809 15:34:48.163577 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:48.163582 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:48.163764 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:48.164523 (+ 759us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:34:48.164726 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.165809 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.168377 (+ 2568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.168948 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.169665 (+ 717us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:48.169791 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:48.169840 (+ 49us) server_negotiation.cc:299] Negotiation successful
0809 15:34:48.169920 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":564,"thread_start_us":159,"threads_started":1}
I20260809 15:34:48.172546 31946 tablet_service.cc:1467] Processing CreateTablet for tablet 9e52d6a8b0e74bb0bf5f3e114d769333 (DEFAULT_TABLE table=test-table [id=6fd5f2d5b3524a999cefe4c897023c40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:34:48.172655 32092 tablet_service.cc:1467] Processing CreateTablet for tablet 9e52d6a8b0e74bb0bf5f3e114d769333 (DEFAULT_TABLE table=test-table [id=6fd5f2d5b3524a999cefe4c897023c40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:34:48.172782 31797 tablet_service.cc:1467] Processing CreateTablet for tablet 9e52d6a8b0e74bb0bf5f3e114d769333 (DEFAULT_TABLE table=test-table [id=6fd5f2d5b3524a999cefe4c897023c40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:34:48.173555 31946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e52d6a8b0e74bb0bf5f3e114d769333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:34:48.173619 31797 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e52d6a8b0e74bb0bf5f3e114d769333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:34:48.173624 32092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e52d6a8b0e74bb0bf5f3e114d769333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:34:48.179669 32181 tablet_bootstrap.cc:492] T 9e52d6a8b0e74bb0bf5f3e114d769333 P 61c348e1af894ab9b8f3d1aa46ce0fe0: Bootstrap starting.
I20260809 15:34:48.180264 32182 tablet_bootstrap.cc:492] T 9e52d6a8b0e74bb0bf5f3e114d769333 P fb0b57acfdc7409c9c9f9d8e7e7c1913: Bootstrap starting.
I20260809 15:34:48.181694 32183 tablet_bootstrap.cc:492] T 9e52d6a8b0e74bb0bf5f3e114d769333 P af758c39cd0f47fcaacd2c1bd8840aa4: Bootstrap starting.
I20260809 15:34:48.182443 32182 tablet_bootstrap.cc:654] T 9e52d6a8b0e74bb0bf5f3e114d769333 P fb0b57acfdc7409c9c9f9d8e7e7c1913: Neither blocks nor log segments found. Creating new log.
I20260809 15:34:48.182824 32181 tablet_bootstrap.cc:654] T 9e52d6a8b0e74bb0bf5f3e114d769333 P 61c348e1af894ab9b8f3d1aa46ce0fe0: Neither blocks nor log segments found. Creating new log.
I20260809 15:34:48.183439 32183 tablet_bootstrap.cc:654] T 9e52d6a8b0e74bb0bf5f3e114d769333 P af758c39cd0f47fcaacd2c1bd8840aa4: Neither blocks nor log segments found. Creating new log.
I20260809 15:34:48.183658 32181 log.cc:824] T 9e52d6a8b0e74bb0bf5f3e114d769333 P 61c348e1af894ab9b8f3d1aa46ce0fe0: Log is configured to *not* fsync() on all Append() calls
I20260809 15:34:48.183658 32182 log.cc:824] T 9e52d6a8b0e74bb0bf5f3e114d769333 P fb0b57acfdc7409c9c9f9d8e7e7c1913: Log is configured to *not* fsync() on all Append() calls
I20260809 15:34:48.184564 32183 log.cc:824] T 9e52d6a8b0e74bb0bf5f3e114d769333 P af758c39cd0f47fcaacd2c1bd8840aa4: Log is configured to *not* fsync() on all Append() calls
I20260809 15:34:48.185568 32182 tablet_bootstrap.cc:492] T 9e52d6a8b0e74bb0bf5f3e114d769333 P fb0b57acfdc7409c9c9f9d8e7e7c1913: No bootstrap required, opened a new log
I20260809 15:34:48.185763 32182 ts_tablet_manager.cc:1397] T 9e52d6a8b0e74bb0bf5f3e114d769333 P fb0b57acfdc7409c9c9f9d8e7e7c1913: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 15:34:48.186221 32183 tablet_bootstrap.cc:492] T 9e52d6a8b0e74bb0bf5f3e114d769333 P af758c39cd0f47fcaacd2c1bd8840aa4: No bootstrap required, opened a new log
I20260809 15:34:48.186388 32183 ts_tablet_manager.cc:1397] T 9e52d6a8b0e74bb0bf5f3e114d769333 P af758c39cd0f47fcaacd2c1bd8840aa4: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 15:34:48.188912 32182 raft_consensus.cc:348] T 9e52d6a8b0e74bb0bf5f3e114d769333 P fb0b57acfdc7409c9c9f9d8e7e7c1913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af758c39cd0f47fcaacd2c1bd8840aa4" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 39835 } } peers { permanent_uuid: "61c348e1af894ab9b8f3d1aa46ce0fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 36143 } } peers { permanent_uuid: "fb0b57acfdc7409c9c9f9d8e7e7c1913" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 41735 } }
I20260809 15:34:48.189133 32182 raft_consensus.cc:374] T 9e52d6a8b0e74bb0bf5f3e114d769333 P fb0b57acfdc7409c9c9f9d8e7e7c1913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:34:48.189209 32182 raft_consensus.cc:729] T 9e52d6a8b0e74bb0bf5f3e114d769333 P fb0b57acfdc7409c9c9f9d8e7e7c1913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb0b57acfdc7409c9c9f9d8e7e7c1913, State: Initialized, Role: FOLLOWER
I20260809 15:34:48.189606 32182 consensus_queue.cc:260] T 9e52d6a8b0e74bb0bf5f3e114d769333 P fb0b57acfdc7409c9c9f9d8e7e7c1913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af758c39cd0f47fcaacd2c1bd8840aa4" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 39835 } } peers { permanent_uuid: "61c348e1af894ab9b8f3d1aa46ce0fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 36143 } } peers { permanent_uuid: "fb0b57acfdc7409c9c9f9d8e7e7c1913" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 41735 } }
I20260809 15:34:48.189636 32183 raft_consensus.cc:348] T 9e52d6a8b0e74bb0bf5f3e114d769333 P af758c39cd0f47fcaacd2c1bd8840aa4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af758c39cd0f47fcaacd2c1bd8840aa4" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 39835 } } peers { permanent_uuid: "61c348e1af894ab9b8f3d1aa46ce0fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 36143 } } peers { permanent_uuid: "fb0b57acfdc7409c9c9f9d8e7e7c1913" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 41735 } }
I20260809 15:34:48.189898 32183 raft_consensus.cc:374] T 9e52d6a8b0e74bb0bf5f3e114d769333 P af758c39cd0f47fcaacd2c1bd8840aa4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:34:48.189992 32183 raft_consensus.cc:729] T 9e52d6a8b0e74bb0bf5f3e114d769333 P af758c39cd0f47fcaacd2c1bd8840aa4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af758c39cd0f47fcaacd2c1bd8840aa4, State: Initialized, Role: FOLLOWER
I20260809 15:34:48.190315 31869 heartbeater.cc:503] Master 127.11.146.62:46387 was elected leader, sending a full tablet report...
I20260809 15:34:48.190371 32183 consensus_queue.cc:260] T 9e52d6a8b0e74bb0bf5f3e114d769333 P af758c39cd0f47fcaacd2c1bd8840aa4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af758c39cd0f47fcaacd2c1bd8840aa4" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 39835 } } peers { permanent_uuid: "61c348e1af894ab9b8f3d1aa46ce0fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 36143 } } peers { permanent_uuid: "fb0b57acfdc7409c9c9f9d8e7e7c1913" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 41735 } }
I20260809 15:34:48.190580 32182 ts_tablet_manager.cc:1428] T 9e52d6a8b0e74bb0bf5f3e114d769333 P fb0b57acfdc7409c9c9f9d8e7e7c1913: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 15:34:48.190932 32164 heartbeater.cc:503] Master 127.11.146.62:46387 was elected leader, sending a full tablet report...
I20260809 15:34:48.191246 32183 ts_tablet_manager.cc:1428] T 9e52d6a8b0e74bb0bf5f3e114d769333 P af758c39cd0f47fcaacd2c1bd8840aa4: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 15:34:48.192199 32181 tablet_bootstrap.cc:492] T 9e52d6a8b0e74bb0bf5f3e114d769333 P 61c348e1af894ab9b8f3d1aa46ce0fe0: No bootstrap required, opened a new log
I20260809 15:34:48.192426 32181 ts_tablet_manager.cc:1397] T 9e52d6a8b0e74bb0bf5f3e114d769333 P 61c348e1af894ab9b8f3d1aa46ce0fe0: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.000s
I20260809 15:34:48.196204 32181 raft_consensus.cc:348] T 9e52d6a8b0e74bb0bf5f3e114d769333 P 61c348e1af894ab9b8f3d1aa46ce0fe0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af758c39cd0f47fcaacd2c1bd8840aa4" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 39835 } } peers { permanent_uuid: "61c348e1af894ab9b8f3d1aa46ce0fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 36143 } } peers { permanent_uuid: "fb0b57acfdc7409c9c9f9d8e7e7c1913" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 41735 } }
I20260809 15:34:48.196405 32181 raft_consensus.cc:374] T 9e52d6a8b0e74bb0bf5f3e114d769333 P 61c348e1af894ab9b8f3d1aa46ce0fe0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:34:48.196485 32181 raft_consensus.cc:729] T 9e52d6a8b0e74bb0bf5f3e114d769333 P 61c348e1af894ab9b8f3d1aa46ce0fe0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61c348e1af894ab9b8f3d1aa46ce0fe0, State: Initialized, Role: FOLLOWER
I20260809 15:34:48.196952 32181 consensus_queue.cc:260] T 9e52d6a8b0e74bb0bf5f3e114d769333 P 61c348e1af894ab9b8f3d1aa46ce0fe0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af758c39cd0f47fcaacd2c1bd8840aa4" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 39835 } } peers { permanent_uuid: "61c348e1af894ab9b8f3d1aa46ce0fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 36143 } } peers { permanent_uuid: "fb0b57acfdc7409c9c9f9d8e7e7c1913" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 41735 } }
I20260809 15:34:48.197561 32018 heartbeater.cc:503] Master 127.11.146.62:46387 was elected leader, sending a full tablet report...
I20260809 15:34:48.197717 32181 ts_tablet_manager.cc:1428] T 9e52d6a8b0e74bb0bf5f3e114d769333 P 61c348e1af894ab9b8f3d1aa46ce0fe0: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
W20260809 15:34:48.203225 31870 tablet.cc:2369] T 9e52d6a8b0e74bb0bf5f3e114d769333 P fb0b57acfdc7409c9c9f9d8e7e7c1913: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:34:48.223759 32188 raft_consensus.cc:482] T 9e52d6a8b0e74bb0bf5f3e114d769333 P af758c39cd0f47fcaacd2c1bd8840aa4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:34:48.223937 32188 raft_consensus.cc:504] T 9e52d6a8b0e74bb0bf5f3e114d769333 P af758c39cd0f47fcaacd2c1bd8840aa4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af758c39cd0f47fcaacd2c1bd8840aa4" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 39835 } } peers { permanent_uuid: "61c348e1af894ab9b8f3d1aa46ce0fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 36143 } } peers { permanent_uuid: "fb0b57acfdc7409c9c9f9d8e7e7c1913" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 41735 } }
I20260809 15:34:48.225200 32188 leader_election.cc:288] T 9e52d6a8b0e74bb0bf5f3e114d769333 P af758c39cd0f47fcaacd2c1bd8840aa4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61c348e1af894ab9b8f3d1aa46ce0fe0 (127.11.146.2:36143), fb0b57acfdc7409c9c9f9d8e7e7c1913 (127.11.146.1:41735)
I20260809 15:34:48.228550 32178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:48.225537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:58289 (local address 127.11.146.2:36143)
0809 15:34:48.225680 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:48.225685 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:48.225704 (+ 19us) server_negotiation.cc:407] Connection header received
0809 15:34:48.225743 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:48.225745 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:48.225779 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:48.225867 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:34:48.226128 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.226618 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.227605 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.228010 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.228162 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:48.228215 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:48.228373 (+ 158us) server_negotiation.cc:299] Negotiation successful
0809 15:34:48.228438 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 15:34:48.228550 32166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:48.225338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:36143 (local address 127.11.146.3:58289)
0809 15:34:48.225482 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:48.225510 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:48.225598 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:48.225887 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:48.225890 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:48.225906 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:34:48.226026 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:48.226031 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.226722 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.226728 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:48.227476 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:48.227485 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.228141 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.228145 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:48.228250 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:48.228275 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 15:34:48.228358 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 15:34:48.228427 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63,"spinlock_wait_cycles":6272}
I20260809 15:34:48.228935 32180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:48.225507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:48703 (local address 127.11.146.1:41735)
0809 15:34:48.225637 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:48.225641 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:48.225912 (+ 271us) server_negotiation.cc:407] Connection header received
0809 15:34:48.226047 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:48.226054 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:48.226092 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:48.226171 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:34:48.226441 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.226939 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.227967 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.228380 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.228498 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:48.228545 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:48.228751 (+ 206us) server_negotiation.cc:299] Negotiation successful
0809 15:34:48.228822 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 15:34:48.229182 31968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e52d6a8b0e74bb0bf5f3e114d769333" candidate_uuid: "af758c39cd0f47fcaacd2c1bd8840aa4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c348e1af894ab9b8f3d1aa46ce0fe0" is_pre_election: true
I20260809 15:34:48.229308 32190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:48.225434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:41735 (local address 127.11.146.3:48703)
0809 15:34:48.225814 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:48.225825 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:48.225939 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:48.226181 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:48.226183 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:48.226199 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:34:48.226321 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:48.226326 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.227050 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.227055 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:48.227826 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:48.227835 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.228492 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.228496 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:48.228591 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:48.228620 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 15:34:48.229102 (+ 482us) client_negotiation.cc:240] Negotiation successful
0809 15:34:48.229185 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"mutex_wait_us":8,"thread_start_us":126,"threads_started":1}
I20260809 15:34:48.229447 31968 raft_consensus.cc:2454] T 9e52d6a8b0e74bb0bf5f3e114d769333 P 61c348e1af894ab9b8f3d1aa46ce0fe0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af758c39cd0f47fcaacd2c1bd8840aa4 in term 0.
I20260809 15:34:48.229907 32044 leader_election.cc:302] T 9e52d6a8b0e74bb0bf5f3e114d769333 P af758c39cd0f47fcaacd2c1bd8840aa4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c348e1af894ab9b8f3d1aa46ce0fe0, af758c39cd0f47fcaacd2c1bd8840aa4; no voters:
I20260809 15:34:48.229936 31818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e52d6a8b0e74bb0bf5f3e114d769333" candidate_uuid: "af758c39cd0f47fcaacd2c1bd8840aa4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb0b57acfdc7409c9c9f9d8e7e7c1913" is_pre_election: true
I20260809 15:34:48.230151 32188 raft_consensus.cc:2781] T 9e52d6a8b0e74bb0bf5f3e114d769333 P af758c39cd0f47fcaacd2c1bd8840aa4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:34:48.230206 31818 raft_consensus.cc:2454] T 9e52d6a8b0e74bb0bf5f3e114d769333 P fb0b57acfdc7409c9c9f9d8e7e7c1913 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af758c39cd0f47fcaacd2c1bd8840aa4 in term 0.
I20260809 15:34:48.230255 32188 raft_consensus.cc:482] T 9e52d6a8b0e74bb0bf5f3e114d769333 P af758c39cd0f47fcaacd2c1bd8840aa4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:34:48.230300 32188 raft_consensus.cc:3037] T 9e52d6a8b0e74bb0bf5f3e114d769333 P af758c39cd0f47fcaacd2c1bd8840aa4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:34:48.231374 32188 raft_consensus.cc:504] T 9e52d6a8b0e74bb0bf5f3e114d769333 P af758c39cd0f47fcaacd2c1bd8840aa4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af758c39cd0f47fcaacd2c1bd8840aa4" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 39835 } } peers { permanent_uuid: "61c348e1af894ab9b8f3d1aa46ce0fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 36143 } } peers { permanent_uuid: "fb0b57acfdc7409c9c9f9d8e7e7c1913" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 41735 } }
I20260809 15:34:48.231662 32188 leader_election.cc:288] T 9e52d6a8b0e74bb0bf5f3e114d769333 P af758c39cd0f47fcaacd2c1bd8840aa4 [CANDIDATE]: Term 1 election: Requested vote from peers 61c348e1af894ab9b8f3d1aa46ce0fe0 (127.11.146.2:36143), fb0b57acfdc7409c9c9f9d8e7e7c1913 (127.11.146.1:41735)
I20260809 15:34:48.231925 31968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e52d6a8b0e74bb0bf5f3e114d769333" candidate_uuid: "af758c39cd0f47fcaacd2c1bd8840aa4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61c348e1af894ab9b8f3d1aa46ce0fe0"
I20260809 15:34:48.232038 31968 raft_consensus.cc:3037] T 9e52d6a8b0e74bb0bf5f3e114d769333 P 61c348e1af894ab9b8f3d1aa46ce0fe0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:34:48.232023 31818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e52d6a8b0e74bb0bf5f3e114d769333" candidate_uuid: "af758c39cd0f47fcaacd2c1bd8840aa4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb0b57acfdc7409c9c9f9d8e7e7c1913"
I20260809 15:34:48.232164 31818 raft_consensus.cc:3037] T 9e52d6a8b0e74bb0bf5f3e114d769333 P fb0b57acfdc7409c9c9f9d8e7e7c1913 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:34:48.233055 31968 raft_consensus.cc:2454] T 9e52d6a8b0e74bb0bf5f3e114d769333 P 61c348e1af894ab9b8f3d1aa46ce0fe0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af758c39cd0f47fcaacd2c1bd8840aa4 in term 1.
I20260809 15:34:48.233094 31818 raft_consensus.cc:2454] T 9e52d6a8b0e74bb0bf5f3e114d769333 P fb0b57acfdc7409c9c9f9d8e7e7c1913 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af758c39cd0f47fcaacd2c1bd8840aa4 in term 1.
I20260809 15:34:48.233341 32044 leader_election.cc:302] T 9e52d6a8b0e74bb0bf5f3e114d769333 P af758c39cd0f47fcaacd2c1bd8840aa4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61c348e1af894ab9b8f3d1aa46ce0fe0, af758c39cd0f47fcaacd2c1bd8840aa4; no voters:
I20260809 15:34:48.233522 32188 raft_consensus.cc:2781] T 9e52d6a8b0e74bb0bf5f3e114d769333 P af758c39cd0f47fcaacd2c1bd8840aa4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:34:48.233726 32188 raft_consensus.cc:686] T 9e52d6a8b0e74bb0bf5f3e114d769333 P af758c39cd0f47fcaacd2c1bd8840aa4 [term 1 LEADER]: Becoming Leader. State: Replica: af758c39cd0f47fcaacd2c1bd8840aa4, State: Running, Role: LEADER
I20260809 15:34:48.234002 32188 consensus_queue.cc:237] T 9e52d6a8b0e74bb0bf5f3e114d769333 P af758c39cd0f47fcaacd2c1bd8840aa4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af758c39cd0f47fcaacd2c1bd8840aa4" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 39835 } } peers { permanent_uuid: "61c348e1af894ab9b8f3d1aa46ce0fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 36143 } } peers { permanent_uuid: "fb0b57acfdc7409c9c9f9d8e7e7c1913" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 41735 } }
I20260809 15:34:48.236935 31658 catalog_manager.cc:5495] T 9e52d6a8b0e74bb0bf5f3e114d769333 P af758c39cd0f47fcaacd2c1bd8840aa4 reported cstate change: term changed from 0 to 1, leader changed from <none> to af758c39cd0f47fcaacd2c1bd8840aa4 (127.11.146.3). New cstate: current_term: 1 leader_uuid: "af758c39cd0f47fcaacd2c1bd8840aa4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af758c39cd0f47fcaacd2c1bd8840aa4" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 39835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61c348e1af894ab9b8f3d1aa46ce0fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 36143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb0b57acfdc7409c9c9f9d8e7e7c1913" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 41735 } health_report { overall_health: UNKNOWN } } }
I20260809 15:34:48.247771 32177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:48.244736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54942 (local address 127.11.146.3:39835)
0809 15:34:48.244849 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:48.244852 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:48.244879 (+ 27us) server_negotiation.cc:407] Connection header received
0809 15:34:48.244997 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:48.244999 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:48.245042 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:48.245120 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:34:48.245325 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.245787 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.246544 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.246741 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.246810 (+ 69us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:48.247048 (+ 238us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:34:48.247377 (+ 329us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:34:48.247527 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:48.247593 (+ 66us) server_negotiation.cc:299] Negotiation successful
0809 15:34:48.247645 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 15:34:48.252700 31818 raft_consensus.cc:1261] T 9e52d6a8b0e74bb0bf5f3e114d769333 P fb0b57acfdc7409c9c9f9d8e7e7c1913 [term 1 FOLLOWER]: Refusing update from remote peer af758c39cd0f47fcaacd2c1bd8840aa4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:34:48.252700 31968 raft_consensus.cc:1261] T 9e52d6a8b0e74bb0bf5f3e114d769333 P 61c348e1af894ab9b8f3d1aa46ce0fe0 [term 1 FOLLOWER]: Refusing update from remote peer af758c39cd0f47fcaacd2c1bd8840aa4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:34:48.253291 32188 consensus_queue.cc:1035] T 9e52d6a8b0e74bb0bf5f3e114d769333 P af758c39cd0f47fcaacd2c1bd8840aa4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb0b57acfdc7409c9c9f9d8e7e7c1913" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:34:48.253456 32191 consensus_queue.cc:1035] T 9e52d6a8b0e74bb0bf5f3e114d769333 P af758c39cd0f47fcaacd2c1bd8840aa4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61c348e1af894ab9b8f3d1aa46ce0fe0" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 36143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:34:48.261276 32196 mvcc.cc:205] Tried to move back new op lower bound from 7316642563077447680 to 7316642563009097728. Current Snapshot: MvccSnapshot[applied={T|T < 7316642563077447680}]
I20260809 15:34:48.262727 32195 mvcc.cc:205] Tried to move back new op lower bound from 7316642563077447680 to 7316642563009097728. Current Snapshot: MvccSnapshot[applied={T|T < 7316642563077447680}]
I20260809 15:34:48.268981 31658 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50086:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:34:48.269177 31658 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50086:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:34:48.271366 31658 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 45fefb4bcc8d4b0896ab6b84e8279a58: Sending DeleteTablet for 3 replicas of tablet 9e52d6a8b0e74bb0bf5f3e114d769333
I20260809 15:34:48.272048 31946 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e52d6a8b0e74bb0bf5f3e114d769333 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:34:48 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:40904
I20260809 15:34:48.272146 31797 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e52d6a8b0e74bb0bf5f3e114d769333 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:34:48 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:41906
I20260809 15:34:48.272248 32092 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e52d6a8b0e74bb0bf5f3e114d769333 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:34:48 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:54938
I20260809 15:34:48.272668 32204 tablet_replica.cc:330] T 9e52d6a8b0e74bb0bf5f3e114d769333 P fb0b57acfdc7409c9c9f9d8e7e7c1913: stopping tablet replica
I20260809 15:34:48.272930 32204 raft_consensus.cc:2229] T 9e52d6a8b0e74bb0bf5f3e114d769333 P fb0b57acfdc7409c9c9f9d8e7e7c1913 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:34:48.273159 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 31728
I20260809 15:34:48.276149 32205 tablet_replica.cc:330] T 9e52d6a8b0e74bb0bf5f3e114d769333 P 61c348e1af894ab9b8f3d1aa46ce0fe0: stopping tablet replica
I20260809 15:34:48.276414 32205 raft_consensus.cc:2229] T 9e52d6a8b0e74bb0bf5f3e114d769333 P 61c348e1af894ab9b8f3d1aa46ce0fe0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:34:48.276672 32205 raft_consensus.cc:2258] T 9e52d6a8b0e74bb0bf5f3e114d769333 P 61c348e1af894ab9b8f3d1aa46ce0fe0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:34:48.277356 32206 tablet_replica.cc:330] T 9e52d6a8b0e74bb0bf5f3e114d769333 P af758c39cd0f47fcaacd2c1bd8840aa4: stopping tablet replica
I20260809 15:34:48.277601 32206 raft_consensus.cc:2229] T 9e52d6a8b0e74bb0bf5f3e114d769333 P af758c39cd0f47fcaacd2c1bd8840aa4 [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:34:48.277920 32206 raft_consensus.cc:2258] T 9e52d6a8b0e74bb0bf5f3e114d769333 P af758c39cd0f47fcaacd2c1bd8840aa4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:34:48.278021 32205 ts_tablet_manager.cc:1905] T 9e52d6a8b0e74bb0bf5f3e114d769333 P 61c348e1af894ab9b8f3d1aa46ce0fe0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:34:48.279227 32206 ts_tablet_manager.cc:1905] T 9e52d6a8b0e74bb0bf5f3e114d769333 P af758c39cd0f47fcaacd2c1bd8840aa4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:34:48.280859 32205 ts_tablet_manager.cc:1918] T 9e52d6a8b0e74bb0bf5f3e114d769333 P 61c348e1af894ab9b8f3d1aa46ce0fe0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:34:48.280966 32205 log.cc:1196] T 9e52d6a8b0e74bb0bf5f3e114d769333 P 61c348e1af894ab9b8f3d1aa46ce0fe0: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-1/wal/wals/9e52d6a8b0e74bb0bf5f3e114d769333
I20260809 15:34:48.281443 32205 ts_tablet_manager.cc:1939] T 9e52d6a8b0e74bb0bf5f3e114d769333 P 61c348e1af894ab9b8f3d1aa46ce0fe0: Deleting consensus metadata
I20260809 15:34:48.282061 32206 ts_tablet_manager.cc:1918] T 9e52d6a8b0e74bb0bf5f3e114d769333 P af758c39cd0f47fcaacd2c1bd8840aa4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:34:48.282153 32206 log.cc:1196] T 9e52d6a8b0e74bb0bf5f3e114d769333 P af758c39cd0f47fcaacd2c1bd8840aa4: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786289437399694-11848-0/minicluster-data/ts-2/wal/wals/9e52d6a8b0e74bb0bf5f3e114d769333
I20260809 15:34:48.282469 32206 ts_tablet_manager.cc:1939] T 9e52d6a8b0e74bb0bf5f3e114d769333 P af758c39cd0f47fcaacd2c1bd8840aa4: Deleting consensus metadata
I20260809 15:34:48.282786 31643 catalog_manager.cc:4841] TS 61c348e1af894ab9b8f3d1aa46ce0fe0 (127.11.146.2:36143): tablet 9e52d6a8b0e74bb0bf5f3e114d769333 (table test-table [id=6fd5f2d5b3524a999cefe4c897023c40]) successfully deleted
I20260809 15:34:48.283494 31640 catalog_manager.cc:4841] TS af758c39cd0f47fcaacd2c1bd8840aa4 (127.11.146.3:39835): tablet 9e52d6a8b0e74bb0bf5f3e114d769333 (table test-table [id=6fd5f2d5b3524a999cefe4c897023c40]) successfully deleted
W20260809 15:34:48.285598 31640 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.146.1:41735 (error 108)
I20260809 15:34:48.286432 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 31874
I20260809 15:34:48.286556 32179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:48.286233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:41735 (local address 127.0.0.1:41908)
0809 15:34:48.286352 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:48.286423 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.1:41735: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 15:34:48.286744 31640 catalog_manager.cc:4584] TS fb0b57acfdc7409c9c9f9d8e7e7c1913 (127.11.146.1:41735): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9e52d6a8b0e74bb0bf5f3e114d769333: Network error: Client connection negotiation failed: client connection to 127.11.146.1:41735: connect: Connection refused (error 111)
I20260809 15:34:48.296494 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 32025
I20260809 15:34:48.303522 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 31622
2026-08-09T15:34:48Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2220 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-09T15:34:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:34:48Z Disabled control of system clock
I20260809 15:34:48.334606 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:37047
--webserver_interface=127.11.146.62
--webserver_port=0
--builtin_ntp_servers=127.11.146.20:46353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:37047
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 15:34:48.439162 32212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:48.439404 32212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:48.439437 32212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:48.443334 32212 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:34:48.443411 32212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:48.443427 32212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:48.443444 32212 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:34:48.443457 32212 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:34:48.448469 32212 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:46353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:37047
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:37047
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32212
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:48.449553 32212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:48.450884 32212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 15:34:48.459369 32212 server_base.cc:1034] running on GCE node
W20260809 15:34:48.459304 32219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:48.459403 32221 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:48.459286 32218 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:48.460314 32212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:48.461293 32212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:48.462452 32212 hybrid_clock.cc:648] HybridClock initialized: now 1786289688462439 us; error 26 us; skew 500 ppm
I20260809 15:34:48.464363 32212 webserver.cc:460] Webserver started at http://127.11.146.62:41125/ using document root <none> and password file <none>
I20260809 15:34:48.464929 32212 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:48.464993 32212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:48.465197 32212 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:34:48.467160 32212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "abfb279312864f99b69e47aa6b841dd1"
format_stamp: "Formatted at 2026-08-09 15:34:48 on dist-test-slave-1jjb"
server_key: "b373b84480eab9cb3e9c4ee530848880"
server_key_iv: "8bd02792639caadcf04038f2cf133eda"
server_key_version: "encryptionkey@0"
I20260809 15:34:48.467710 32212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "abfb279312864f99b69e47aa6b841dd1"
format_stamp: "Formatted at 2026-08-09 15:34:48 on dist-test-slave-1jjb"
server_key: "b373b84480eab9cb3e9c4ee530848880"
server_key_iv: "8bd02792639caadcf04038f2cf133eda"
server_key_version: "encryptionkey@0"
I20260809 15:34:48.471272 32212 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 15:34:48.473568 32228 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:48.474710 32212 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:34:48.474841 32212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "abfb279312864f99b69e47aa6b841dd1"
format_stamp: "Formatted at 2026-08-09 15:34:48 on dist-test-slave-1jjb"
server_key: "b373b84480eab9cb3e9c4ee530848880"
server_key_iv: "8bd02792639caadcf04038f2cf133eda"
server_key_version: "encryptionkey@0"
I20260809 15:34:48.474946 32212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:48.501744 32212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:48.502470 32212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:48.502671 32212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:48.509986 32212 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:37047
I20260809 15:34:48.510010 32285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:37047 every 8 connection(s)
I20260809 15:34:48.510995 32212 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:34:48.514144 32286 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:34:48.519474 32286 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abfb279312864f99b69e47aa6b841dd1: Bootstrap starting.
I20260809 15:34:48.520341 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 32212
I20260809 15:34:48.520483 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:34:48.520794 11848 external_mini_cluster.cc:1428] Setting key 9959926eaac093e114b664cf1aaea2aa
I20260809 15:34:48.522541 32286 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P abfb279312864f99b69e47aa6b841dd1: Neither blocks nor log segments found. Creating new log.
I20260809 15:34:48.523411 32286 log.cc:824] T 00000000000000000000000000000000 P abfb279312864f99b69e47aa6b841dd1: Log is configured to *not* fsync() on all Append() calls
I20260809 15:34:48.525617 32286 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abfb279312864f99b69e47aa6b841dd1: No bootstrap required, opened a new log
I20260809 15:34:48.529933 32286 raft_consensus.cc:348] T 00000000000000000000000000000000 P abfb279312864f99b69e47aa6b841dd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abfb279312864f99b69e47aa6b841dd1" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37047 } }
I20260809 15:34:48.530190 32286 raft_consensus.cc:374] T 00000000000000000000000000000000 P abfb279312864f99b69e47aa6b841dd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:34:48.530246 32286 raft_consensus.cc:729] T 00000000000000000000000000000000 P abfb279312864f99b69e47aa6b841dd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abfb279312864f99b69e47aa6b841dd1, State: Initialized, Role: FOLLOWER
I20260809 15:34:48.530707 32286 consensus_queue.cc:260] T 00000000000000000000000000000000 P abfb279312864f99b69e47aa6b841dd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abfb279312864f99b69e47aa6b841dd1" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37047 } }
I20260809 15:34:48.530864 32286 raft_consensus.cc:388] T 00000000000000000000000000000000 P abfb279312864f99b69e47aa6b841dd1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:34:48.530942 32286 raft_consensus.cc:482] T 00000000000000000000000000000000 P abfb279312864f99b69e47aa6b841dd1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:34:48.530951 32289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:48.522032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59778 (local address 127.11.146.62:37047)
0809 15:34:48.522802 (+ 770us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:48.522823 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:48.522862 (+ 39us) server_negotiation.cc:407] Connection header received
0809 15:34:48.523731 (+ 869us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:48.523757 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:48.524142 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:48.524495 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:48.524906 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.526312 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.527180 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.527897 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.528069 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:48.528876 (+ 807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:48.528885 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:48.528906 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:34:48.529441 (+ 535us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:48.529510 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:34:48.529537 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:48.529636 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:48.529745 (+ 109us) server_negotiation.cc:299] Negotiation successful
0809 15:34:48.530011 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":133,"threads_started":1}
I20260809 15:34:48.531077 32286 raft_consensus.cc:3037] T 00000000000000000000000000000000 P abfb279312864f99b69e47aa6b841dd1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:34:48.532186 32286 raft_consensus.cc:504] T 00000000000000000000000000000000 P abfb279312864f99b69e47aa6b841dd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abfb279312864f99b69e47aa6b841dd1" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37047 } }
I20260809 15:34:48.532516 32286 leader_election.cc:302] T 00000000000000000000000000000000 P abfb279312864f99b69e47aa6b841dd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: abfb279312864f99b69e47aa6b841dd1; no voters:
I20260809 15:34:48.532867 32286 leader_election.cc:288] T 00000000000000000000000000000000 P abfb279312864f99b69e47aa6b841dd1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:34:48.532955 32291 raft_consensus.cc:2781] T 00000000000000000000000000000000 P abfb279312864f99b69e47aa6b841dd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:34:48.533186 32291 raft_consensus.cc:686] T 00000000000000000000000000000000 P abfb279312864f99b69e47aa6b841dd1 [term 1 LEADER]: Becoming Leader. State: Replica: abfb279312864f99b69e47aa6b841dd1, State: Running, Role: LEADER
I20260809 15:34:48.533497 32291 consensus_queue.cc:237] T 00000000000000000000000000000000 P abfb279312864f99b69e47aa6b841dd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abfb279312864f99b69e47aa6b841dd1" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37047 } }
I20260809 15:34:48.534044 32286 sys_catalog.cc:564] T 00000000000000000000000000000000 P abfb279312864f99b69e47aa6b841dd1 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:34:48.534574 32291 sys_catalog.cc:455] T 00000000000000000000000000000000 P abfb279312864f99b69e47aa6b841dd1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader abfb279312864f99b69e47aa6b841dd1. Latest consensus state: current_term: 1 leader_uuid: "abfb279312864f99b69e47aa6b841dd1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abfb279312864f99b69e47aa6b841dd1" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37047 } } }
I20260809 15:34:48.534685 32291 sys_catalog.cc:458] T 00000000000000000000000000000000 P abfb279312864f99b69e47aa6b841dd1 [sys.catalog]: This master's current role is: LEADER
I20260809 15:34:48.535071 32296 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:34:48.535049 32292 sys_catalog.cc:455] T 00000000000000000000000000000000 P abfb279312864f99b69e47aa6b841dd1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "abfb279312864f99b69e47aa6b841dd1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abfb279312864f99b69e47aa6b841dd1" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37047 } } }
I20260809 15:34:48.535145 32292 sys_catalog.cc:458] T 00000000000000000000000000000000 P abfb279312864f99b69e47aa6b841dd1 [sys.catalog]: This master's current role is: LEADER
I20260809 15:34:48.537796 32296 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:34:48.542645 32296 catalog_manager.cc:1347] Generated new cluster ID: b7d8c510a8704b6781323df8b5771355
I20260809 15:34:48.542701 32296 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:34:48.551007 32296 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:34:48.551838 32296 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:34:48.555778 32296 catalog_manager.cc:5868] T 00000000000000000000000000000000 P abfb279312864f99b69e47aa6b841dd1: Generated new TSK 0
I20260809 15:34:48.556475 32296 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:34:48.558699 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.1:0
--local_ip_for_outbound_sockets=127.11.146.1
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:37047
--builtin_ntp_servers=127.11.146.20:46353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 15:34:48.668965 32312 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:48.669235 32312 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:48.669292 32312 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:48.673054 32312 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:48.673116 32312 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:48.673187 32312 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.1
I20260809 15:34:48.677599 32312 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:46353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:37047
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32312
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.1
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:48.678542 32312 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:48.679795 32312 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:34:48.688653 32318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:48.688671 32321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:48.688701 32319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:48.688804 32312 server_base.cc:1034] running on GCE node
I20260809 15:34:48.689363 32312 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:48.689945 32312 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:48.691118 32312 hybrid_clock.cc:648] HybridClock initialized: now 1786289688691086 us; error 44 us; skew 500 ppm
I20260809 15:34:48.692795 32312 webserver.cc:460] Webserver started at http://127.11.146.1:35757/ using document root <none> and password file <none>
I20260809 15:34:48.693320 32312 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:48.693436 32312 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:48.693645 32312 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:34:48.695454 32312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-0/data/instance:
uuid: "fb229046cb19466a8d0e84dbbf2c69a5"
format_stamp: "Formatted at 2026-08-09 15:34:48 on dist-test-slave-1jjb"
server_key: "39d179d7e46e0f3a01c383f224350f5c"
server_key_iv: "002454b0df6c3820705912adafd677df"
server_key_version: "encryptionkey@0"
I20260809 15:34:48.695962 32312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance:
uuid: "fb229046cb19466a8d0e84dbbf2c69a5"
format_stamp: "Formatted at 2026-08-09 15:34:48 on dist-test-slave-1jjb"
server_key: "39d179d7e46e0f3a01c383f224350f5c"
server_key_iv: "002454b0df6c3820705912adafd677df"
server_key_version: "encryptionkey@0"
I20260809 15:34:48.699347 32312 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:34:48.701592 32329 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:48.702649 32312 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:34:48.702770 32312 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-0/wal
uuid: "fb229046cb19466a8d0e84dbbf2c69a5"
format_stamp: "Formatted at 2026-08-09 15:34:48 on dist-test-slave-1jjb"
server_key: "39d179d7e46e0f3a01c383f224350f5c"
server_key_iv: "002454b0df6c3820705912adafd677df"
server_key_version: "encryptionkey@0"
I20260809 15:34:48.702869 32312 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:48.724013 32312 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:48.724625 32312 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:48.724807 32312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:48.725342 32312 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:34:48.726264 32312 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:34:48.726333 32312 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:48.726403 32312 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:34:48.726444 32312 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:48.734858 32312 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.1:37713
I20260809 15:34:48.734902 32453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.1:37713 every 8 connection(s)
I20260809 15:34:48.735742 32312 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
I20260809 15:34:48.744499 32289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:48.737508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:59845 (local address 127.11.146.62:37047)
0809 15:34:48.737653 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:48.737656 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:48.738730 (+ 1074us) server_negotiation.cc:407] Connection header received
0809 15:34:48.740013 (+ 1283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:48.740016 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:48.740062 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:48.740178 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:48.741002 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.741513 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.742534 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.742734 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.742842 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:48.744139 (+ 1297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:48.744143 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:48.744146 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:34:48.744163 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:48.744182 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:34:48.744190 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:48.744249 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:48.744345 (+ 96us) server_negotiation.cc:299] Negotiation successful
0809 15:34:48.744391 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 15:34:48.745293 32456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:48.737958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:37047 (local address 127.11.146.1:59845)
0809 15:34:48.738578 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:48.738616 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:48.739830 (+ 1214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:48.740335 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:48.740342 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:48.740430 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:34:48.740871 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:48.740882 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.741613 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.741615 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:48.742436 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:48.742444 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.742875 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.742882 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:48.743106 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:48.743857 (+ 751us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:34:48.743859 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:34:48.743914 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:34:48.743974 (+ 60us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:34:48.744250 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:34:48.744255 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:34:48.744259 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 15:34:48.744346 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 15:34:48.744570 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":107,"threads_started":1}
I20260809 15:34:48.745700 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 32312
I20260809 15:34:48.745822 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance
I20260809 15:34:48.746104 11848 external_mini_cluster.cc:1428] Setting key 13fb53fdce4425102be9a9d80e1f2576
I20260809 15:34:48.747483 32454 heartbeater.cc:347] Connected to a master server at 127.11.146.62:37047
I20260809 15:34:48.747725 32454 heartbeater.cc:464] Registering TS with master...
I20260809 15:34:48.748219 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.2:0
--local_ip_for_outbound_sockets=127.11.146.2
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:37047
--builtin_ntp_servers=127.11.146.20:46353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 15:34:48.748323 32454 heartbeater.cc:511] Master 127.11.146.62:37047 requested a full tablet report, sending...
I20260809 15:34:48.749800 32245 ts_manager.cc:194] Registered new tserver with Master: fb229046cb19466a8d0e84dbbf2c69a5 (127.11.146.1:37713)
I20260809 15:34:48.751466 32245 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.146.1:59845
W20260809 15:34:48.868940 32457 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:48.869161 32457 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:48.869195 32457 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:48.872917 32457 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:48.872957 32457 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:48.873013 32457 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.2
I20260809 15:34:48.877386 32457 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:46353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:37047
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32457
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.2
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:48.878299 32457 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:48.879590 32457 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:34:48.888842 32462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:48.888845 32465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:48.888845 32463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:48.889120 32457 server_base.cc:1034] running on GCE node
I20260809 15:34:48.889547 32457 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:48.890115 32457 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:48.891269 32457 hybrid_clock.cc:648] HybridClock initialized: now 1786289688891254 us; error 24 us; skew 500 ppm
I20260809 15:34:48.893133 32457 webserver.cc:460] Webserver started at http://127.11.146.2:38703/ using document root <none> and password file <none>
I20260809 15:34:48.893692 32457 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:48.893754 32457 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:48.893970 32457 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:34:48.895859 32457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-1/data/instance:
uuid: "a4d1d5156cae4d77b1887e3b02e4ac64"
format_stamp: "Formatted at 2026-08-09 15:34:48 on dist-test-slave-1jjb"
server_key: "598710e55373b9db2f866c7b92095c64"
server_key_iv: "449c746566e10051ae5a6a2ba04a04f6"
server_key_version: "encryptionkey@0"
I20260809 15:34:48.896421 32457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance:
uuid: "a4d1d5156cae4d77b1887e3b02e4ac64"
format_stamp: "Formatted at 2026-08-09 15:34:48 on dist-test-slave-1jjb"
server_key: "598710e55373b9db2f866c7b92095c64"
server_key_iv: "449c746566e10051ae5a6a2ba04a04f6"
server_key_version: "encryptionkey@0"
I20260809 15:34:48.899744 32457 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 15:34:48.902051 32473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:48.903123 32457 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:34:48.903246 32457 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-1/wal
uuid: "a4d1d5156cae4d77b1887e3b02e4ac64"
format_stamp: "Formatted at 2026-08-09 15:34:48 on dist-test-slave-1jjb"
server_key: "598710e55373b9db2f866c7b92095c64"
server_key_iv: "449c746566e10051ae5a6a2ba04a04f6"
server_key_version: "encryptionkey@0"
I20260809 15:34:48.903347 32457 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:48.914039 32457 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:48.914592 32457 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:48.914763 32457 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:48.915267 32457 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:34:48.916164 32457 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:34:48.916224 32457 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:48.916285 32457 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:34:48.916327 32457 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:48.924953 32457 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.2:33957
I20260809 15:34:48.925045 32598 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.2:33957 every 8 connection(s)
I20260809 15:34:48.925777 32457 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
I20260809 15:34:48.935117 32289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:48.927540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:59503 (local address 127.11.146.62:37047)
0809 15:34:48.927683 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:48.927687 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:48.928730 (+ 1043us) server_negotiation.cc:407] Connection header received
0809 15:34:48.930149 (+ 1419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:48.930153 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:48.930215 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:48.930327 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:48.931154 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.931713 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.932962 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.933193 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.933314 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:48.934581 (+ 1267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:48.934585 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:48.934587 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:34:48.934600 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:48.934621 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:34:48.934629 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:48.934715 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:48.934881 (+ 166us) server_negotiation.cc:299] Negotiation successful
0809 15:34:48.934946 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 15:34:48.935707 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 32457
I20260809 15:34:48.935845 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance
I20260809 15:34:48.936115 32601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:48.927848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:37047 (local address 127.11.146.2:59503)
0809 15:34:48.928586 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:48.928627 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:48.929942 (+ 1315us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:48.930490 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:48.930496 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:48.930571 (+ 75us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:34:48.931010 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:48.931022 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.931871 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.931873 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:48.932815 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:48.932826 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:48.933356 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:48.933360 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:48.933518 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:48.934177 (+ 659us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:34:48.934181 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:34:48.934235 (+ 54us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:34:48.934347 (+ 112us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:34:48.934717 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:34:48.934729 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:34:48.934738 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 15:34:48.934879 (+ 141us) client_negotiation.cc:240] Negotiation successful
0809 15:34:48.935130 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":124,"threads_started":1}
I20260809 15:34:48.936231 11848 external_mini_cluster.cc:1428] Setting key 73ad3acf795993f105ac4651b823764e
I20260809 15:34:48.937273 32599 heartbeater.cc:347] Connected to a master server at 127.11.146.62:37047
I20260809 15:34:48.937503 32599 heartbeater.cc:464] Registering TS with master...
I20260809 15:34:48.937999 32599 heartbeater.cc:511] Master 127.11.146.62:37047 requested a full tablet report, sending...
I20260809 15:34:48.938225 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.3:0
--local_ip_for_outbound_sockets=127.11.146.3
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:37047
--builtin_ntp_servers=127.11.146.20:46353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 15:34:48.939046 32245 ts_manager.cc:194] Registered new tserver with Master: a4d1d5156cae4d77b1887e3b02e4ac64 (127.11.146.2:33957)
I20260809 15:34:48.939632 32245 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.146.2:59503
W20260809 15:34:49.047731 32602 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:49.047986 32602 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:49.048079 32602 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:49.051923 32602 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:49.051992 32602 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:49.052125 32602 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.3
I20260809 15:34:49.056916 32602 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:46353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:37047
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32602
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.3
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:49.057837 32602 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:49.059094 32602 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:34:49.067864 32609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:49.067970 32607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:49.068027 32611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:49.068150 32602 server_base.cc:1034] running on GCE node
I20260809 15:34:49.068599 32602 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:49.069176 32602 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:49.070351 32602 hybrid_clock.cc:648] HybridClock initialized: now 1786289689070321 us; error 45 us; skew 500 ppm
I20260809 15:34:49.074919 32602 webserver.cc:460] Webserver started at http://127.11.146.3:39111/ using document root <none> and password file <none>
I20260809 15:34:49.075453 32602 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:49.075546 32602 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:49.075753 32602 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:34:49.077739 32602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-2/data/instance:
uuid: "250857dd9e964d2d8e39fa82e2f8a43e"
format_stamp: "Formatted at 2026-08-09 15:34:49 on dist-test-slave-1jjb"
server_key: "a077f2a42ae1385e7f91d7d3134e95ae"
server_key_iv: "93d2634110f94044057dc3c0d59daa5d"
server_key_version: "encryptionkey@0"
I20260809 15:34:49.078317 32602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance:
uuid: "250857dd9e964d2d8e39fa82e2f8a43e"
format_stamp: "Formatted at 2026-08-09 15:34:49 on dist-test-slave-1jjb"
server_key: "a077f2a42ae1385e7f91d7d3134e95ae"
server_key_iv: "93d2634110f94044057dc3c0d59daa5d"
server_key_version: "encryptionkey@0"
I20260809 15:34:49.081792 32602 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 15:34:49.084167 32618 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:49.085242 32602 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 15:34:49.085366 32602 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-2/wal
uuid: "250857dd9e964d2d8e39fa82e2f8a43e"
format_stamp: "Formatted at 2026-08-09 15:34:49 on dist-test-slave-1jjb"
server_key: "a077f2a42ae1385e7f91d7d3134e95ae"
server_key_iv: "93d2634110f94044057dc3c0d59daa5d"
server_key_version: "encryptionkey@0"
I20260809 15:34:49.085469 32602 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:49.101583 32602 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:49.102161 32602 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:49.102337 32602 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:49.102867 32602 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:34:49.103713 32602 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:34:49.103780 32602 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:49.103844 32602 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:34:49.103890 32602 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:49.112569 32602 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.3:43087
I20260809 15:34:49.112628 32739 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.3:43087 every 8 connection(s)
I20260809 15:34:49.113422 32602 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
I20260809 15:34:49.115056 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 32602
I20260809 15:34:49.115178 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance
I20260809 15:34:49.115515 11848 external_mini_cluster.cc:1428] Setting key 8a5dd88e00cb127455bbfdf93964bf84
I20260809 15:34:49.122234 32289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:49.115293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:55137 (local address 127.11.146.62:37047)
0809 15:34:49.115431 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:49.115435 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:49.116627 (+ 1192us) server_negotiation.cc:407] Connection header received
0809 15:34:49.118021 (+ 1394us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:49.118024 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:49.118081 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:49.118176 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:49.118976 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:49.119464 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:49.120573 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:49.120786 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:49.120856 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:49.121839 (+ 983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:49.121842 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:49.121844 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:34:49.121855 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:49.121873 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:34:49.121880 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:49.121936 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:49.122083 (+ 147us) server_negotiation.cc:299] Negotiation successful
0809 15:34:49.122131 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 15:34:49.123092 32743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:49.115704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:37047 (local address 127.11.146.3:55137)
0809 15:34:49.116467 (+ 763us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:49.116519 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:49.117835 (+ 1316us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:49.118320 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:49.118326 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:49.118401 (+ 75us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:34:49.118860 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:49.118872 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:49.119570 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:49.119573 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:49.120460 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:49.120470 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:49.120913 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:49.120916 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:49.121052 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:49.121602 (+ 550us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:34:49.121604 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:34:49.121640 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:34:49.121705 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:34:49.121963 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:34:49.121970 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:34:49.121974 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 15:34:49.122068 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 15:34:49.122265 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":159,"threads_started":1}
I20260809 15:34:49.123983 32741 heartbeater.cc:347] Connected to a master server at 127.11.146.62:37047
I20260809 15:34:49.124207 32741 heartbeater.cc:464] Registering TS with master...
I20260809 15:34:49.124667 32741 heartbeater.cc:511] Master 127.11.146.62:37047 requested a full tablet report, sending...
I20260809 15:34:49.125584 32245 ts_manager.cc:194] Registered new tserver with Master: 250857dd9e964d2d8e39fa82e2f8a43e (127.11.146.3:43087)
I20260809 15:34:49.126142 32245 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.146.3:55137
I20260809 15:34:49.129302 11848 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:34:49.134718 32289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:49.131234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59794 (local address 127.11.146.62:37047)
0809 15:34:49.131354 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:49.131358 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:49.131516 (+ 158us) server_negotiation.cc:407] Connection header received
0809 15:34:49.131606 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:49.131608 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:49.131640 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:49.131699 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:49.131916 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:49.132455 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:49.133207 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:49.133400 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:49.133483 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:49.134255 (+ 772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:49.134257 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:49.134259 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:34:49.134270 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:49.134285 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:34:49.134292 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:49.134385 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:49.134522 (+ 137us) server_negotiation.cc:299] Negotiation successful
0809 15:34:49.134577 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 15:34:49.137511 32245 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59794:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:34:49.140342 32245 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:34:49.153117 32752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:49.147832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:43087 (local address 127.0.0.1:43164)
0809 15:34:49.148418 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:49.148463 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:49.148568 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:49.149318 (+ 750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:49.149323 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:49.149345 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:34:49.149471 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:49.149482 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:49.150680 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:49.150685 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:49.151561 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:49.151570 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:49.152604 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:49.152608 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:49.152749 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:49.152800 (+ 51us) client_negotiation.cc:769] Sending connection context
0809 15:34:49.152871 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 15:34:49.152972 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"mutex_wait_us":2,"thread_start_us":74,"threads_started":1}
I20260809 15:34:49.154011 32754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:49.147914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43164 (local address 127.11.146.3:43087)
0809 15:34:49.148549 (+ 635us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:49.148560 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:49.148585 (+ 25us) server_negotiation.cc:407] Connection header received
0809 15:34:49.148958 (+ 373us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:49.148965 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:49.149168 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:49.149324 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:34:49.149600 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:49.150584 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:49.151681 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:49.152458 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:49.153465 (+ 1007us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:49.153708 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:49.153758 (+ 50us) server_negotiation.cc:299] Negotiation successful
0809 15:34:49.153856 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":518,"thread_start_us":104,"threads_started":1}
I20260809 15:34:49.154022 32757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:49.148849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:37713 (local address 127.0.0.1:43628)
0809 15:34:49.149229 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:49.149244 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:49.149319 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:49.150095 (+ 776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:49.150098 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:49.150116 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:34:49.150194 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:49.150199 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:49.151469 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:49.151472 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:49.152526 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:49.152536 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:49.153652 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:49.153655 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:49.153742 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:49.153766 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 15:34:49.153828 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 15:34:49.153886 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"mutex_wait_us":34,"thread_start_us":101,"threads_started":1}
I20260809 15:34:49.154160 32758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:49.149008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43628 (local address 127.11.146.1:37713)
0809 15:34:49.149663 (+ 655us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:49.149677 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:49.149699 (+ 22us) server_negotiation.cc:407] Connection header received
0809 15:34:49.149790 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:49.149796 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:49.149967 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:49.150124 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:34:49.150305 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:49.151366 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:49.152666 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:49.153500 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:49.153634 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:49.153825 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:49.153879 (+ 54us) server_negotiation.cc:299] Negotiation successful
0809 15:34:49.153981 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":547,"thread_start_us":155,"threads_started":1}
I20260809 15:34:49.154412 32756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:49.148185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56898 (local address 127.11.146.2:33957)
0809 15:34:49.149037 (+ 852us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:49.149057 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:49.149080 (+ 23us) server_negotiation.cc:407] Connection header received
0809 15:34:49.149562 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:49.149569 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:49.149768 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:49.149916 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:34:49.150162 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:49.151317 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:49.152798 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:49.153609 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:49.153698 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:49.153833 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:49.154148 (+ 315us) server_negotiation.cc:299] Negotiation successful
0809 15:34:49.154255 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":756,"thread_start_us":120,"threads_started":1}
I20260809 15:34:49.154805 32755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:49.147979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:33957 (local address 127.0.0.1:56898)
0809 15:34:49.148731 (+ 752us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:49.148746 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:49.149424 (+ 678us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:49.149890 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:49.149893 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:49.149911 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:34:49.150014 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:49.150025 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:49.151464 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:49.151467 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:49.152685 (+ 1218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:49.152695 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:49.153899 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:49.153903 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:49.153989 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:49.154011 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 15:34:49.154584 (+ 573us) client_negotiation.cc:240] Negotiation successful
0809 15:34:49.154667 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":686,"mutex_wait_us":45,"thread_start_us":121,"threads_started":1}
I20260809 15:34:49.156868 32669 tablet_service.cc:1467] Processing CreateTablet for tablet 5406fcc9c2ef44fbbe2323f396dcd688 (DEFAULT_TABLE table=test-table [id=b402000e80bb46ebbb502491d4f18c29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:34:49.156869 32381 tablet_service.cc:1467] Processing CreateTablet for tablet 5406fcc9c2ef44fbbe2323f396dcd688 (DEFAULT_TABLE table=test-table [id=b402000e80bb46ebbb502491d4f18c29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:34:49.157069 32525 tablet_service.cc:1467] Processing CreateTablet for tablet 5406fcc9c2ef44fbbe2323f396dcd688 (DEFAULT_TABLE table=test-table [id=b402000e80bb46ebbb502491d4f18c29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:34:49.157850 32525 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5406fcc9c2ef44fbbe2323f396dcd688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:34:49.157907 32669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5406fcc9c2ef44fbbe2323f396dcd688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:34:49.157907 32381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5406fcc9c2ef44fbbe2323f396dcd688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:34:49.163612 32759 tablet_bootstrap.cc:492] T 5406fcc9c2ef44fbbe2323f396dcd688 P a4d1d5156cae4d77b1887e3b02e4ac64: Bootstrap starting.
I20260809 15:34:49.165009 32761 tablet_bootstrap.cc:492] T 5406fcc9c2ef44fbbe2323f396dcd688 P 250857dd9e964d2d8e39fa82e2f8a43e: Bootstrap starting.
I20260809 15:34:49.166219 32759 tablet_bootstrap.cc:654] T 5406fcc9c2ef44fbbe2323f396dcd688 P a4d1d5156cae4d77b1887e3b02e4ac64: Neither blocks nor log segments found. Creating new log.
I20260809 15:34:49.166623 32761 tablet_bootstrap.cc:654] T 5406fcc9c2ef44fbbe2323f396dcd688 P 250857dd9e964d2d8e39fa82e2f8a43e: Neither blocks nor log segments found. Creating new log.
I20260809 15:34:49.166622 32760 tablet_bootstrap.cc:492] T 5406fcc9c2ef44fbbe2323f396dcd688 P fb229046cb19466a8d0e84dbbf2c69a5: Bootstrap starting.
I20260809 15:34:49.166967 32759 log.cc:824] T 5406fcc9c2ef44fbbe2323f396dcd688 P a4d1d5156cae4d77b1887e3b02e4ac64: Log is configured to *not* fsync() on all Append() calls
I20260809 15:34:49.167484 32761 log.cc:824] T 5406fcc9c2ef44fbbe2323f396dcd688 P 250857dd9e964d2d8e39fa82e2f8a43e: Log is configured to *not* fsync() on all Append() calls
I20260809 15:34:49.168637 32760 tablet_bootstrap.cc:654] T 5406fcc9c2ef44fbbe2323f396dcd688 P fb229046cb19466a8d0e84dbbf2c69a5: Neither blocks nor log segments found. Creating new log.
I20260809 15:34:49.168779 32759 tablet_bootstrap.cc:492] T 5406fcc9c2ef44fbbe2323f396dcd688 P a4d1d5156cae4d77b1887e3b02e4ac64: No bootstrap required, opened a new log
I20260809 15:34:49.168967 32759 ts_tablet_manager.cc:1397] T 5406fcc9c2ef44fbbe2323f396dcd688 P a4d1d5156cae4d77b1887e3b02e4ac64: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 15:34:49.169382 32761 tablet_bootstrap.cc:492] T 5406fcc9c2ef44fbbe2323f396dcd688 P 250857dd9e964d2d8e39fa82e2f8a43e: No bootstrap required, opened a new log
I20260809 15:34:49.169400 32760 log.cc:824] T 5406fcc9c2ef44fbbe2323f396dcd688 P fb229046cb19466a8d0e84dbbf2c69a5: Log is configured to *not* fsync() on all Append() calls
I20260809 15:34:49.169559 32761 ts_tablet_manager.cc:1397] T 5406fcc9c2ef44fbbe2323f396dcd688 P 250857dd9e964d2d8e39fa82e2f8a43e: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 15:34:49.171190 32760 tablet_bootstrap.cc:492] T 5406fcc9c2ef44fbbe2323f396dcd688 P fb229046cb19466a8d0e84dbbf2c69a5: No bootstrap required, opened a new log
I20260809 15:34:49.171353 32760 ts_tablet_manager.cc:1397] T 5406fcc9c2ef44fbbe2323f396dcd688 P fb229046cb19466a8d0e84dbbf2c69a5: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260809 15:34:49.172478 32759 raft_consensus.cc:348] T 5406fcc9c2ef44fbbe2323f396dcd688 P a4d1d5156cae4d77b1887e3b02e4ac64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "250857dd9e964d2d8e39fa82e2f8a43e" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43087 } } peers { permanent_uuid: "a4d1d5156cae4d77b1887e3b02e4ac64" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 33957 } } peers { permanent_uuid: "fb229046cb19466a8d0e84dbbf2c69a5" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37713 } }
I20260809 15:34:49.172713 32759 raft_consensus.cc:374] T 5406fcc9c2ef44fbbe2323f396dcd688 P a4d1d5156cae4d77b1887e3b02e4ac64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:34:49.172763 32759 raft_consensus.cc:729] T 5406fcc9c2ef44fbbe2323f396dcd688 P a4d1d5156cae4d77b1887e3b02e4ac64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4d1d5156cae4d77b1887e3b02e4ac64, State: Initialized, Role: FOLLOWER
I20260809 15:34:49.173173 32759 consensus_queue.cc:260] T 5406fcc9c2ef44fbbe2323f396dcd688 P a4d1d5156cae4d77b1887e3b02e4ac64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "250857dd9e964d2d8e39fa82e2f8a43e" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43087 } } peers { permanent_uuid: "a4d1d5156cae4d77b1887e3b02e4ac64" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 33957 } } peers { permanent_uuid: "fb229046cb19466a8d0e84dbbf2c69a5" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37713 } }
I20260809 15:34:49.173739 32599 heartbeater.cc:503] Master 127.11.146.62:37047 was elected leader, sending a full tablet report...
I20260809 15:34:49.173622 32761 raft_consensus.cc:348] T 5406fcc9c2ef44fbbe2323f396dcd688 P 250857dd9e964d2d8e39fa82e2f8a43e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "250857dd9e964d2d8e39fa82e2f8a43e" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43087 } } peers { permanent_uuid: "a4d1d5156cae4d77b1887e3b02e4ac64" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 33957 } } peers { permanent_uuid: "fb229046cb19466a8d0e84dbbf2c69a5" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37713 } }
I20260809 15:34:49.173830 32761 raft_consensus.cc:374] T 5406fcc9c2ef44fbbe2323f396dcd688 P 250857dd9e964d2d8e39fa82e2f8a43e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:34:49.173875 32761 raft_consensus.cc:729] T 5406fcc9c2ef44fbbe2323f396dcd688 P 250857dd9e964d2d8e39fa82e2f8a43e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 250857dd9e964d2d8e39fa82e2f8a43e, State: Initialized, Role: FOLLOWER
I20260809 15:34:49.174086 32759 ts_tablet_manager.cc:1428] T 5406fcc9c2ef44fbbe2323f396dcd688 P a4d1d5156cae4d77b1887e3b02e4ac64: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 15:34:49.174292 32761 consensus_queue.cc:260] T 5406fcc9c2ef44fbbe2323f396dcd688 P 250857dd9e964d2d8e39fa82e2f8a43e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "250857dd9e964d2d8e39fa82e2f8a43e" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43087 } } peers { permanent_uuid: "a4d1d5156cae4d77b1887e3b02e4ac64" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 33957 } } peers { permanent_uuid: "fb229046cb19466a8d0e84dbbf2c69a5" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37713 } }
I20260809 15:34:49.174846 32741 heartbeater.cc:503] Master 127.11.146.62:37047 was elected leader, sending a full tablet report...
I20260809 15:34:49.175115 32761 ts_tablet_manager.cc:1428] T 5406fcc9c2ef44fbbe2323f396dcd688 P 250857dd9e964d2d8e39fa82e2f8a43e: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 15:34:49.175215 32760 raft_consensus.cc:348] T 5406fcc9c2ef44fbbe2323f396dcd688 P fb229046cb19466a8d0e84dbbf2c69a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "250857dd9e964d2d8e39fa82e2f8a43e" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43087 } } peers { permanent_uuid: "a4d1d5156cae4d77b1887e3b02e4ac64" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 33957 } } peers { permanent_uuid: "fb229046cb19466a8d0e84dbbf2c69a5" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37713 } }
I20260809 15:34:49.175431 32760 raft_consensus.cc:374] T 5406fcc9c2ef44fbbe2323f396dcd688 P fb229046cb19466a8d0e84dbbf2c69a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:34:49.175464 32760 raft_consensus.cc:729] T 5406fcc9c2ef44fbbe2323f396dcd688 P fb229046cb19466a8d0e84dbbf2c69a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb229046cb19466a8d0e84dbbf2c69a5, State: Initialized, Role: FOLLOWER
I20260809 15:34:49.175843 32760 consensus_queue.cc:260] T 5406fcc9c2ef44fbbe2323f396dcd688 P fb229046cb19466a8d0e84dbbf2c69a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "250857dd9e964d2d8e39fa82e2f8a43e" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43087 } } peers { permanent_uuid: "a4d1d5156cae4d77b1887e3b02e4ac64" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 33957 } } peers { permanent_uuid: "fb229046cb19466a8d0e84dbbf2c69a5" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37713 } }
W20260809 15:34:49.176627 32600 tablet.cc:2369] T 5406fcc9c2ef44fbbe2323f396dcd688 P a4d1d5156cae4d77b1887e3b02e4ac64: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:34:49.176776 32454 heartbeater.cc:503] Master 127.11.146.62:37047 was elected leader, sending a full tablet report...
I20260809 15:34:49.176770 32760 ts_tablet_manager.cc:1428] T 5406fcc9c2ef44fbbe2323f396dcd688 P fb229046cb19466a8d0e84dbbf2c69a5: Time spent starting tablet: real 0.005s user 0.002s sys 0.003s
W20260809 15:34:49.236995 32455 tablet.cc:2369] T 5406fcc9c2ef44fbbe2323f396dcd688 P fb229046cb19466a8d0e84dbbf2c69a5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:34:49.267629 300 raft_consensus.cc:482] T 5406fcc9c2ef44fbbe2323f396dcd688 P fb229046cb19466a8d0e84dbbf2c69a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:34:49.267824 300 raft_consensus.cc:504] T 5406fcc9c2ef44fbbe2323f396dcd688 P fb229046cb19466a8d0e84dbbf2c69a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "250857dd9e964d2d8e39fa82e2f8a43e" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43087 } } peers { permanent_uuid: "a4d1d5156cae4d77b1887e3b02e4ac64" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 33957 } } peers { permanent_uuid: "fb229046cb19466a8d0e84dbbf2c69a5" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37713 } }
I20260809 15:34:49.268994 300 leader_election.cc:288] T 5406fcc9c2ef44fbbe2323f396dcd688 P fb229046cb19466a8d0e84dbbf2c69a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 250857dd9e964d2d8e39fa82e2f8a43e (127.11.146.3:43087), a4d1d5156cae4d77b1887e3b02e4ac64 (127.11.146.2:33957)
I20260809 15:34:49.272733 32754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:49.269323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:59383 (local address 127.11.146.3:43087)
0809 15:34:49.269456 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:49.269461 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:49.269596 (+ 135us) server_negotiation.cc:407] Connection header received
0809 15:34:49.269751 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:49.269754 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:49.269800 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:49.269874 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:34:49.270136 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:49.270688 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:49.271747 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:49.272213 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:49.272330 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:49.272380 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:49.272548 (+ 168us) server_negotiation.cc:299] Negotiation successful
0809 15:34:49.272607 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 15:34:49.272758 32756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:49.269370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:42319 (local address 127.11.146.2:33957)
0809 15:34:49.269496 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:49.269501 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:49.269698 (+ 197us) server_negotiation.cc:407] Connection header received
0809 15:34:49.269841 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:49.269844 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:49.269893 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:49.269967 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:34:49.270248 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:49.270741 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:49.271775 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:49.272223 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:49.272348 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:49.272393 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:49.272578 (+ 185us) server_negotiation.cc:299] Negotiation successful
0809 15:34:49.272639 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 15:34:49.272787 302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:49.269171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:43087 (local address 127.11.146.1:59383)
0809 15:34:49.269517 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:49.269528 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:49.269649 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:49.269897 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:49.269900 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:49.269916 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:34:49.270034 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:49.270040 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:49.270802 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:49.270807 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:49.271628 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:49.271637 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:49.272330 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:49.272334 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:49.272423 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:49.272455 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 15:34:49.272533 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 15:34:49.272600 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"mutex_wait_us":11,"thread_start_us":99,"threads_started":1}
I20260809 15:34:49.272794 301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:49.269276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:33957 (local address 127.11.146.1:42319)
0809 15:34:49.269607 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:49.269619 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:49.269733 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:49.269992 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:49.269994 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:49.270011 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:34:49.270125 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:49.270130 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:49.270847 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:49.270854 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:49.271652 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:49.271660 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:49.272348 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:49.272352 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:49.272453 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:49.272471 (+ 18us) client_negotiation.cc:769] Sending connection context
0809 15:34:49.272562 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 15:34:49.272630 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"mutex_wait_us":20,"thread_start_us":62,"threads_started":1}
I20260809 15:34:49.273391 32547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5406fcc9c2ef44fbbe2323f396dcd688" candidate_uuid: "fb229046cb19466a8d0e84dbbf2c69a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4d1d5156cae4d77b1887e3b02e4ac64" is_pre_election: true
I20260809 15:34:49.273402 32690 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5406fcc9c2ef44fbbe2323f396dcd688" candidate_uuid: "fb229046cb19466a8d0e84dbbf2c69a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "250857dd9e964d2d8e39fa82e2f8a43e" is_pre_election: true
I20260809 15:34:49.273658 32690 raft_consensus.cc:2454] T 5406fcc9c2ef44fbbe2323f396dcd688 P 250857dd9e964d2d8e39fa82e2f8a43e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb229046cb19466a8d0e84dbbf2c69a5 in term 0.
I20260809 15:34:49.273655 32547 raft_consensus.cc:2454] T 5406fcc9c2ef44fbbe2323f396dcd688 P a4d1d5156cae4d77b1887e3b02e4ac64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb229046cb19466a8d0e84dbbf2c69a5 in term 0.
I20260809 15:34:49.274112 32333 leader_election.cc:302] T 5406fcc9c2ef44fbbe2323f396dcd688 P fb229046cb19466a8d0e84dbbf2c69a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 250857dd9e964d2d8e39fa82e2f8a43e, fb229046cb19466a8d0e84dbbf2c69a5; no voters:
I20260809 15:34:49.274360 300 raft_consensus.cc:2781] T 5406fcc9c2ef44fbbe2323f396dcd688 P fb229046cb19466a8d0e84dbbf2c69a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:34:49.274446 300 raft_consensus.cc:482] T 5406fcc9c2ef44fbbe2323f396dcd688 P fb229046cb19466a8d0e84dbbf2c69a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:34:49.274489 300 raft_consensus.cc:3037] T 5406fcc9c2ef44fbbe2323f396dcd688 P fb229046cb19466a8d0e84dbbf2c69a5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:34:49.275454 300 raft_consensus.cc:504] T 5406fcc9c2ef44fbbe2323f396dcd688 P fb229046cb19466a8d0e84dbbf2c69a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "250857dd9e964d2d8e39fa82e2f8a43e" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43087 } } peers { permanent_uuid: "a4d1d5156cae4d77b1887e3b02e4ac64" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 33957 } } peers { permanent_uuid: "fb229046cb19466a8d0e84dbbf2c69a5" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37713 } }
I20260809 15:34:49.275767 300 leader_election.cc:288] T 5406fcc9c2ef44fbbe2323f396dcd688 P fb229046cb19466a8d0e84dbbf2c69a5 [CANDIDATE]: Term 1 election: Requested vote from peers 250857dd9e964d2d8e39fa82e2f8a43e (127.11.146.3:43087), a4d1d5156cae4d77b1887e3b02e4ac64 (127.11.146.2:33957)
I20260809 15:34:49.276052 32690 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5406fcc9c2ef44fbbe2323f396dcd688" candidate_uuid: "fb229046cb19466a8d0e84dbbf2c69a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "250857dd9e964d2d8e39fa82e2f8a43e"
I20260809 15:34:49.276139 32547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5406fcc9c2ef44fbbe2323f396dcd688" candidate_uuid: "fb229046cb19466a8d0e84dbbf2c69a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4d1d5156cae4d77b1887e3b02e4ac64"
I20260809 15:34:49.276219 32690 raft_consensus.cc:3037] T 5406fcc9c2ef44fbbe2323f396dcd688 P 250857dd9e964d2d8e39fa82e2f8a43e [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:34:49.276278 32547 raft_consensus.cc:3037] T 5406fcc9c2ef44fbbe2323f396dcd688 P a4d1d5156cae4d77b1887e3b02e4ac64 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:34:49.277220 32690 raft_consensus.cc:2454] T 5406fcc9c2ef44fbbe2323f396dcd688 P 250857dd9e964d2d8e39fa82e2f8a43e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb229046cb19466a8d0e84dbbf2c69a5 in term 1.
I20260809 15:34:49.277240 32547 raft_consensus.cc:2454] T 5406fcc9c2ef44fbbe2323f396dcd688 P a4d1d5156cae4d77b1887e3b02e4ac64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb229046cb19466a8d0e84dbbf2c69a5 in term 1.
I20260809 15:34:49.277518 32334 leader_election.cc:302] T 5406fcc9c2ef44fbbe2323f396dcd688 P fb229046cb19466a8d0e84dbbf2c69a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4d1d5156cae4d77b1887e3b02e4ac64, fb229046cb19466a8d0e84dbbf2c69a5; no voters:
I20260809 15:34:49.277694 300 raft_consensus.cc:2781] T 5406fcc9c2ef44fbbe2323f396dcd688 P fb229046cb19466a8d0e84dbbf2c69a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:34:49.277887 300 raft_consensus.cc:686] T 5406fcc9c2ef44fbbe2323f396dcd688 P fb229046cb19466a8d0e84dbbf2c69a5 [term 1 LEADER]: Becoming Leader. State: Replica: fb229046cb19466a8d0e84dbbf2c69a5, State: Running, Role: LEADER
I20260809 15:34:49.278215 300 consensus_queue.cc:237] T 5406fcc9c2ef44fbbe2323f396dcd688 P fb229046cb19466a8d0e84dbbf2c69a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "250857dd9e964d2d8e39fa82e2f8a43e" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43087 } } peers { permanent_uuid: "a4d1d5156cae4d77b1887e3b02e4ac64" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 33957 } } peers { permanent_uuid: "fb229046cb19466a8d0e84dbbf2c69a5" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37713 } }
I20260809 15:34:49.281185 32243 catalog_manager.cc:5495] T 5406fcc9c2ef44fbbe2323f396dcd688 P fb229046cb19466a8d0e84dbbf2c69a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to fb229046cb19466a8d0e84dbbf2c69a5 (127.11.146.1). New cstate: current_term: 1 leader_uuid: "fb229046cb19466a8d0e84dbbf2c69a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "250857dd9e964d2d8e39fa82e2f8a43e" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4d1d5156cae4d77b1887e3b02e4ac64" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 33957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb229046cb19466a8d0e84dbbf2c69a5" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260809 15:34:49.303926 32758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:49.300806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43636 (local address 127.11.146.1:37713)
0809 15:34:49.300922 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:49.300926 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:49.300938 (+ 12us) server_negotiation.cc:407] Connection header received
0809 15:34:49.301076 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:49.301079 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:49.301129 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:49.301210 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:34:49.301409 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:49.301857 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:49.302698 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:49.302891 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:49.302961 (+ 70us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:49.303202 (+ 241us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:34:49.303556 (+ 354us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:34:49.303657 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:49.303736 (+ 79us) server_negotiation.cc:299] Negotiation successful
0809 15:34:49.303764 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 15:34:49.309417 32690 raft_consensus.cc:1261] T 5406fcc9c2ef44fbbe2323f396dcd688 P 250857dd9e964d2d8e39fa82e2f8a43e [term 1 FOLLOWER]: Refusing update from remote peer fb229046cb19466a8d0e84dbbf2c69a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:34:49.309418 32547 raft_consensus.cc:1261] T 5406fcc9c2ef44fbbe2323f396dcd688 P a4d1d5156cae4d77b1887e3b02e4ac64 [term 1 FOLLOWER]: Refusing update from remote peer fb229046cb19466a8d0e84dbbf2c69a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:34:49.310060 300 consensus_queue.cc:1035] T 5406fcc9c2ef44fbbe2323f396dcd688 P fb229046cb19466a8d0e84dbbf2c69a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4d1d5156cae4d77b1887e3b02e4ac64" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 33957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:34:49.310288 304 consensus_queue.cc:1035] T 5406fcc9c2ef44fbbe2323f396dcd688 P fb229046cb19466a8d0e84dbbf2c69a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "250857dd9e964d2d8e39fa82e2f8a43e" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 43087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:34:49.318303 310 mvcc.cc:205] Tried to move back new op lower bound from 7316642567404675072 to 7316642567285874688. Current Snapshot: MvccSnapshot[applied={T|T < 7316642567404675072}]
I20260809 15:34:49.320326 308 mvcc.cc:205] Tried to move back new op lower bound from 7316642567404675072 to 7316642567285874688. Current Snapshot: MvccSnapshot[applied={T|T < 7316642567404675072 or (T in {7316642567404675072})}]
I20260809 15:34:49.325855 32243 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59794:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:34:49.326016 32243 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59794:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:34:49.328456 32243 catalog_manager.cc:5782] T 00000000000000000000000000000000 P abfb279312864f99b69e47aa6b841dd1: Sending DeleteTablet for 3 replicas of tablet 5406fcc9c2ef44fbbe2323f396dcd688
I20260809 15:34:49.329269 32669 tablet_service.cc:1514] Processing DeleteTablet for tablet 5406fcc9c2ef44fbbe2323f396dcd688 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:34:49 UTC) from {username='slave'} at 127.0.0.1:43164
I20260809 15:34:49.329326 32381 tablet_service.cc:1514] Processing DeleteTablet for tablet 5406fcc9c2ef44fbbe2323f396dcd688 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:34:49 UTC) from {username='slave'} at 127.0.0.1:43628
I20260809 15:34:49.329748 32525 tablet_service.cc:1514] Processing DeleteTablet for tablet 5406fcc9c2ef44fbbe2323f396dcd688 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:34:49 UTC) from {username='slave'} at 127.0.0.1:56898
I20260809 15:34:49.329818 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 32312
I20260809 15:34:49.330049 320 tablet_replica.cc:330] T 5406fcc9c2ef44fbbe2323f396dcd688 P fb229046cb19466a8d0e84dbbf2c69a5: stopping tablet replica
I20260809 15:34:49.332121 319 tablet_replica.cc:330] T 5406fcc9c2ef44fbbe2323f396dcd688 P 250857dd9e964d2d8e39fa82e2f8a43e: stopping tablet replica
I20260809 15:34:49.332566 319 raft_consensus.cc:2229] T 5406fcc9c2ef44fbbe2323f396dcd688 P 250857dd9e964d2d8e39fa82e2f8a43e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:34:49.333039 319 raft_consensus.cc:2258] T 5406fcc9c2ef44fbbe2323f396dcd688 P 250857dd9e964d2d8e39fa82e2f8a43e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:34:49.334450 319 ts_tablet_manager.cc:1905] T 5406fcc9c2ef44fbbe2323f396dcd688 P 250857dd9e964d2d8e39fa82e2f8a43e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:34:49.336742 319 ts_tablet_manager.cc:1918] T 5406fcc9c2ef44fbbe2323f396dcd688 P 250857dd9e964d2d8e39fa82e2f8a43e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:34:49.336843 319 log.cc:1196] T 5406fcc9c2ef44fbbe2323f396dcd688 P 250857dd9e964d2d8e39fa82e2f8a43e: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786289437399694-11848-0/minicluster-data/ts-2/wal/wals/5406fcc9c2ef44fbbe2323f396dcd688
I20260809 15:34:49.337153 319 ts_tablet_manager.cc:1939] T 5406fcc9c2ef44fbbe2323f396dcd688 P 250857dd9e964d2d8e39fa82e2f8a43e: Deleting consensus metadata
I20260809 15:34:49.338183 32231 catalog_manager.cc:4841] TS 250857dd9e964d2d8e39fa82e2f8a43e (127.11.146.3:43087): tablet 5406fcc9c2ef44fbbe2323f396dcd688 (table test-table [id=b402000e80bb46ebbb502491d4f18c29]) successfully deleted
W20260809 15:34:49.339350 32230 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.146.1:37713 (error 108)
I20260809 15:34:49.340096 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 32457
I20260809 15:34:49.340155 321 tablet_replica.cc:330] T 5406fcc9c2ef44fbbe2323f396dcd688 P a4d1d5156cae4d77b1887e3b02e4ac64: stopping tablet replica
I20260809 15:34:49.340317 32755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:49.340008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:37713 (local address 127.0.0.1:43640)
0809 15:34:49.340140 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:49.340233 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.1:37713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 15:34:49.340446 321 raft_consensus.cc:2229] T 5406fcc9c2ef44fbbe2323f396dcd688 P a4d1d5156cae4d77b1887e3b02e4ac64 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260809 15:34:49.340907 32230 catalog_manager.cc:4584] TS fb229046cb19466a8d0e84dbbf2c69a5 (127.11.146.1:37713): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5406fcc9c2ef44fbbe2323f396dcd688: Network error: Client connection negotiation failed: client connection to 127.11.146.1:37713: connect: Connection refused (error 111)
I20260809 15:34:49.347232 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 32602
I20260809 15:34:49.348704 32755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:49.347322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:33957 (local address 127.0.0.1:56902)
0809 15:34:49.348553 (+ 1231us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:49.348616 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.2:33957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1138}
I20260809 15:34:49.354051 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 32212
2026-08-09T15:34:49Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1049 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:34:49 dist-test-slave-1jjb krb5kdc[325](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:34:49 dist-test-slave-1jjb krb5kdc[325](info): set up 2 sockets
Aug 09 15:34:49 dist-test-slave-1jjb krb5kdc[325](info): commencing operation
krb5kdc: starting...
W20260809 15:34:50.413426 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.037s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:34:50 dist-test-slave-1jjb krb5kdc[325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289690, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:34:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:34:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.146.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
I20260809 15:34:50.535377 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:35529
--webserver_interface=127.11.146.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:38359
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:35529
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:34:50.645727 339 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:50.645985 339 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:50.646052 339 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:50.649987 339 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:34:50.650058 339 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:50.650094 339 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:50.650146 339 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:34:50.650183 339 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:34:50.654847 339 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:38359
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:35529
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:35529
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.339
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:50.655778 339 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:50.656736 339 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:34:50.664482 349 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:50.664506 347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:50.664853 339 server_base.cc:1034] running on GCE node
W20260809 15:34:50.664521 345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:50.667755 339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:50.668785 339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:50.669943 339 hybrid_clock.cc:648] HybridClock initialized: now 1786289690669925 us; error 28 us; skew 500 ppm
Aug 09 15:34:50 dist-test-slave-1jjb krb5kdc[325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289690, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:34:50.672592 339 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:34:50.673352 339 webserver.cc:460] Webserver started at http://127.11.146.62:43255/ using document root <none> and password file <none>
I20260809 15:34:50.673823 339 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:50.673875 339 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:50.674016 339 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:34:50.675751 339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "978d06888b75430b90c3f01ff7e2cb32"
format_stamp: "Formatted at 2026-08-09 15:34:50 on dist-test-slave-1jjb"
server_key: "8fbc0be93a6a72e33b0b3ec251e5d9fb"
server_key_iv: "e3e7182bc547e5432e688c77645f3c42"
server_key_version: "encryptionkey@0"
I20260809 15:34:50.676265 339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "978d06888b75430b90c3f01ff7e2cb32"
format_stamp: "Formatted at 2026-08-09 15:34:50 on dist-test-slave-1jjb"
server_key: "8fbc0be93a6a72e33b0b3ec251e5d9fb"
server_key_iv: "e3e7182bc547e5432e688c77645f3c42"
server_key_version: "encryptionkey@0"
I20260809 15:34:50.679514 339 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.001s
I20260809 15:34:50.681715 356 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:50.682796 339 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260809 15:34:50.682924 339 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "978d06888b75430b90c3f01ff7e2cb32"
format_stamp: "Formatted at 2026-08-09 15:34:50 on dist-test-slave-1jjb"
server_key: "8fbc0be93a6a72e33b0b3ec251e5d9fb"
server_key_iv: "e3e7182bc547e5432e688c77645f3c42"
server_key_version: "encryptionkey@0"
I20260809 15:34:50.683025 339 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:50.694126 339 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:50.696732 339 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:50.696911 339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:50.703995 339 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:35529
I20260809 15:34:50.704020 412 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:35529 every 8 connection(s)
I20260809 15:34:50.704896 339 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:34:50.707386 413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:34:50.711313 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 339
I20260809 15:34:50.711453 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:34:50.711752 11848 external_mini_cluster.cc:1428] Setting key a59621c3104058c9112114e87bcff3d1
I20260809 15:34:50.713173 413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 978d06888b75430b90c3f01ff7e2cb32: Bootstrap starting.
I20260809 15:34:50.715747 413 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 978d06888b75430b90c3f01ff7e2cb32: Neither blocks nor log segments found. Creating new log.
I20260809 15:34:50.716548 413 log.cc:824] T 00000000000000000000000000000000 P 978d06888b75430b90c3f01ff7e2cb32: Log is configured to *not* fsync() on all Append() calls
I20260809 15:34:50.718287 413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 978d06888b75430b90c3f01ff7e2cb32: No bootstrap required, opened a new log
Aug 09 15:34:50 dist-test-slave-1jjb krb5kdc[325](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289690, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:34:50.722329 413 raft_consensus.cc:348] T 00000000000000000000000000000000 P 978d06888b75430b90c3f01ff7e2cb32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "978d06888b75430b90c3f01ff7e2cb32" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 35529 } }
I20260809 15:34:50.722571 413 raft_consensus.cc:374] T 00000000000000000000000000000000 P 978d06888b75430b90c3f01ff7e2cb32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:34:50.722656 413 raft_consensus.cc:729] T 00000000000000000000000000000000 P 978d06888b75430b90c3f01ff7e2cb32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 978d06888b75430b90c3f01ff7e2cb32, State: Initialized, Role: FOLLOWER
I20260809 15:34:50.723037 413 consensus_queue.cc:260] T 00000000000000000000000000000000 P 978d06888b75430b90c3f01ff7e2cb32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "978d06888b75430b90c3f01ff7e2cb32" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 35529 } }
I20260809 15:34:50.723212 413 raft_consensus.cc:388] T 00000000000000000000000000000000 P 978d06888b75430b90c3f01ff7e2cb32 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:34:50.723290 413 raft_consensus.cc:482] T 00000000000000000000000000000000 P 978d06888b75430b90c3f01ff7e2cb32 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:34:50.723382 413 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 978d06888b75430b90c3f01ff7e2cb32 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:34:50.724213 413 raft_consensus.cc:504] T 00000000000000000000000000000000 P 978d06888b75430b90c3f01ff7e2cb32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "978d06888b75430b90c3f01ff7e2cb32" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 35529 } }
I20260809 15:34:50.724529 413 leader_election.cc:302] T 00000000000000000000000000000000 P 978d06888b75430b90c3f01ff7e2cb32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 978d06888b75430b90c3f01ff7e2cb32; no voters:
I20260809 15:34:50.724828 413 leader_election.cc:288] T 00000000000000000000000000000000 P 978d06888b75430b90c3f01ff7e2cb32 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:34:50.724936 419 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 978d06888b75430b90c3f01ff7e2cb32 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:34:50.725327 419 raft_consensus.cc:686] T 00000000000000000000000000000000 P 978d06888b75430b90c3f01ff7e2cb32 [term 1 LEADER]: Becoming Leader. State: Replica: 978d06888b75430b90c3f01ff7e2cb32, State: Running, Role: LEADER
I20260809 15:34:50.725662 419 consensus_queue.cc:237] T 00000000000000000000000000000000 P 978d06888b75430b90c3f01ff7e2cb32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "978d06888b75430b90c3f01ff7e2cb32" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 35529 } }
I20260809 15:34:50.725975 417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:50.713138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44078 (local address 127.11.146.62:35529)
0809 15:34:50.713560 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:50.713579 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:50.713619 (+ 40us) server_negotiation.cc:407] Connection header received
0809 15:34:50.714482 (+ 863us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:50.714505 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:50.714871 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:50.715204 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:50.715912 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:50.717018 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:50.717875 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:50.718347 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:50.718505 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:50.721152 (+ 2647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:50.721157 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:50.721168 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:34:50.721192 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:50.723005 (+ 1813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:50.723572 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:50.723576 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:50.723580 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:50.723682 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:50.723960 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:50.723964 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:50.723966 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:50.724423 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:50.724631 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:50.724850 (+ 219us) server_negotiation.cc:299] Negotiation successful
0809 15:34:50.725146 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":142,"threads_started":1}
I20260809 15:34:50.726046 413 sys_catalog.cc:564] T 00000000000000000000000000000000 P 978d06888b75430b90c3f01ff7e2cb32 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:34:50.727273 421 sys_catalog.cc:455] T 00000000000000000000000000000000 P 978d06888b75430b90c3f01ff7e2cb32 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 978d06888b75430b90c3f01ff7e2cb32. Latest consensus state: current_term: 1 leader_uuid: "978d06888b75430b90c3f01ff7e2cb32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "978d06888b75430b90c3f01ff7e2cb32" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 35529 } } }
I20260809 15:34:50.727414 421 sys_catalog.cc:458] T 00000000000000000000000000000000 P 978d06888b75430b90c3f01ff7e2cb32 [sys.catalog]: This master's current role is: LEADER
I20260809 15:34:50.727744 420 sys_catalog.cc:455] T 00000000000000000000000000000000 P 978d06888b75430b90c3f01ff7e2cb32 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "978d06888b75430b90c3f01ff7e2cb32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "978d06888b75430b90c3f01ff7e2cb32" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 35529 } } }
I20260809 15:34:50.727837 420 sys_catalog.cc:458] T 00000000000000000000000000000000 P 978d06888b75430b90c3f01ff7e2cb32 [sys.catalog]: This master's current role is: LEADER
I20260809 15:34:50.728746 428 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:34:50.731245 428 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:34:50.737454 428 catalog_manager.cc:1347] Generated new cluster ID: 7eb754c551c54f50a4d9a644d8ca4cbf
I20260809 15:34:50.737516 428 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:34:50.744009 428 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:34:50.744841 428 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:34:50.748968 428 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 978d06888b75430b90c3f01ff7e2cb32: Generated new TSK 0
I20260809 15:34:50.749615 428 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.146.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
Entry for principal kudu/127.11.146.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab.
I20260809 15:34:50.783026 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.1:0
--local_ip_for_outbound_sockets=127.11.146.1
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:35529
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:38359
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:34:50.891016 440 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:50.891242 440 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:50.891278 440 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:50.895012 440 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:50.895061 440 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:50.895112 440 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.1
I20260809 15:34:50.900183 440 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:38359
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.1.keytab
--principal=kudu/127.11.146.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:35529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.440
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.1
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:50.901077 440 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:50.902015 440 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:34:50.910892 447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:50.910878 449 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:50.910859 446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:50.911096 440 server_base.cc:1034] running on GCE node
I20260809 15:34:50.911550 440 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:50.912184 440 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:50.913384 440 hybrid_clock.cc:648] HybridClock initialized: now 1786289690913329 us; error 36 us; skew 500 ppm
Aug 09 15:34:50 dist-test-slave-1jjb krb5kdc[325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289690, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:34:50.916031 440 init.cc:377] Logged in from keytab as kudu/127.11.146.1@KRBTEST.COM (short username kudu)
I20260809 15:34:50.916827 440 webserver.cc:460] Webserver started at http://127.11.146.1:41011/ using document root <none> and password file <none>
I20260809 15:34:50.917366 440 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:50.917459 440 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:50.917672 440 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:34:50.920007 440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-0/data/instance:
uuid: "3122860fc73844c0a260b84feb67d039"
format_stamp: "Formatted at 2026-08-09 15:34:50 on dist-test-slave-1jjb"
server_key: "8eeac9371c6492434181fbd244a0ee05"
server_key_iv: "ac616e5ee0a7b7ad98e07ee3b55378cb"
server_key_version: "encryptionkey@0"
I20260809 15:34:50.920610 440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance:
uuid: "3122860fc73844c0a260b84feb67d039"
format_stamp: "Formatted at 2026-08-09 15:34:50 on dist-test-slave-1jjb"
server_key: "8eeac9371c6492434181fbd244a0ee05"
server_key_iv: "ac616e5ee0a7b7ad98e07ee3b55378cb"
server_key_version: "encryptionkey@0"
I20260809 15:34:50.924044 440 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 15:34:50.926404 456 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:50.927680 440 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:34:50.927837 440 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-0/wal
uuid: "3122860fc73844c0a260b84feb67d039"
format_stamp: "Formatted at 2026-08-09 15:34:50 on dist-test-slave-1jjb"
server_key: "8eeac9371c6492434181fbd244a0ee05"
server_key_iv: "ac616e5ee0a7b7ad98e07ee3b55378cb"
server_key_version: "encryptionkey@0"
I20260809 15:34:50.927964 440 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:50.942075 440 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:50.945107 440 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:50.945286 440 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:50.945789 440 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:34:50.946516 440 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:34:50.946620 440 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:50.946686 440 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:34:50.946731 440 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:50.955142 440 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.1:45279
I20260809 15:34:50.955180 583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.1:45279 every 8 connection(s)
I20260809 15:34:50.955937 440 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
I20260809 15:34:50.959854 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 440
I20260809 15:34:50.960033 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance
I20260809 15:34:50.960352 11848 external_mini_cluster.cc:1428] Setting key a4c0e31d364eb8696babd1f86e8ac42f
Aug 09 15:34:50 dist-test-slave-1jjb krb5kdc[325](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289690, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.1@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:34:50.969846 417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:50.957561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:34651 (local address 127.11.146.62:35529)
0809 15:34:50.957697 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:50.957701 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:50.958441 (+ 740us) server_negotiation.cc:407] Connection header received
0809 15:34:50.959679 (+ 1238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:50.959686 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:50.959749 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:50.959851 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:50.961169 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:50.961799 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:50.962934 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:50.963177 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:50.963289 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:50.966101 (+ 2812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:50.966104 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:50.966106 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:34:50.966129 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:50.967603 (+ 1474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:50.968271 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:50.968274 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:50.968275 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:50.968368 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:50.968764 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:50.968766 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:50.968767 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:50.968937 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:50.969012 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:50.969633 (+ 621us) server_negotiation.cc:299] Negotiation successful
0809 15:34:50.969730 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 15:34:50.970908 586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:50.957879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:35529 (local address 127.11.146.1:34651)
0809 15:34:50.958306 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:50.958344 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:50.959449 (+ 1105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:50.960030 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:50.960036 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:50.960444 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:34:50.961028 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:50.961044 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:50.961959 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:50.961963 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:50.962810 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:50.962819 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:50.963324 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:50.963328 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:50.963550 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:50.964190 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:34:50.964213 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:34:50.965942 (+ 1729us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:34:50.967726 (+ 1784us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:34:50.967735 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:34:50.967753 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:34:50.968167 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:34:50.968467 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:34:50.968472 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:34:50.968475 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:34:50.968667 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:34:50.969068 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:34:50.969075 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:34:50.969374 (+ 299us) client_negotiation.cc:769] Sending connection context
0809 15:34:50.969590 (+ 216us) client_negotiation.cc:240] Negotiation successful
0809 15:34:50.969907 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":115,"threads_started":1}
WARNING: no policy specified for kudu/127.11.146.2@KRBTEST.COM; defaulting to no policy
I20260809 15:34:50.971925 584 heartbeater.cc:347] Connected to a master server at 127.11.146.62:35529
I20260809 15:34:50.972173 584 heartbeater.cc:464] Registering TS with master...
I20260809 15:34:50.972720 584 heartbeater.cc:511] Master 127.11.146.62:35529 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.2@KRBTEST.COM" created.
I20260809 15:34:50.974179 375 ts_manager.cc:194] Registered new tserver with Master: 3122860fc73844c0a260b84feb67d039 (127.11.146.1:45279)
I20260809 15:34:50.975744 375 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.1@KRBTEST.COM'} at 127.11.146.1:34651
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
Entry for principal kudu/127.11.146.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab.
I20260809 15:34:50.988837 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.2:0
--local_ip_for_outbound_sockets=127.11.146.2
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:35529
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:38359
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:34:51.095897 590 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:51.096194 590 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:51.096273 590 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:51.100170 590 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:51.100239 590 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:51.100332 590 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.2
I20260809 15:34:51.105286 590 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:38359
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.2.keytab
--principal=kudu/127.11.146.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:35529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.590
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.2
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:51.106178 590 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:51.107132 590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:34:51.116111 600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:51.116243 590 server_base.cc:1034] running on GCE node
W20260809 15:34:51.116145 598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:51.116148 597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:51.116796 590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:51.117424 590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:51.118592 590 hybrid_clock.cc:648] HybridClock initialized: now 1786289691118572 us; error 44 us; skew 500 ppm
Aug 09 15:34:51 dist-test-slave-1jjb krb5kdc[325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289691, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:34:51.121289 590 init.cc:377] Logged in from keytab as kudu/127.11.146.2@KRBTEST.COM (short username kudu)
I20260809 15:34:51.122148 590 webserver.cc:460] Webserver started at http://127.11.146.2:46303/ using document root <none> and password file <none>
I20260809 15:34:51.122669 590 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:51.122751 590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:51.122952 590 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:34:51.124972 590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-1/data/instance:
uuid: "ea1bdb6f8c6f41fd9df860b692413bce"
format_stamp: "Formatted at 2026-08-09 15:34:51 on dist-test-slave-1jjb"
server_key: "4db4d4b63096101f18de1ad13a066483"
server_key_iv: "8276a2385993f2d7909dfc829341a381"
server_key_version: "encryptionkey@0"
I20260809 15:34:51.125527 590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance:
uuid: "ea1bdb6f8c6f41fd9df860b692413bce"
format_stamp: "Formatted at 2026-08-09 15:34:51 on dist-test-slave-1jjb"
server_key: "4db4d4b63096101f18de1ad13a066483"
server_key_iv: "8276a2385993f2d7909dfc829341a381"
server_key_version: "encryptionkey@0"
I20260809 15:34:51.129278 590 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 15:34:51.131513 609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:51.132683 590 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:34:51.132808 590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-1/wal
uuid: "ea1bdb6f8c6f41fd9df860b692413bce"
format_stamp: "Formatted at 2026-08-09 15:34:51 on dist-test-slave-1jjb"
server_key: "4db4d4b63096101f18de1ad13a066483"
server_key_iv: "8276a2385993f2d7909dfc829341a381"
server_key_version: "encryptionkey@0"
I20260809 15:34:51.132922 590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:51.154014 590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:51.156463 590 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:51.156633 590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:51.157202 590 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:34:51.157935 590 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:34:51.158010 590 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:51.158079 590 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:34:51.158119 590 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:51.166208 590 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.2:45211
I20260809 15:34:51.166261 738 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.2:45211 every 8 connection(s)
I20260809 15:34:51.166956 590 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
I20260809 15:34:51.174665 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 590
I20260809 15:34:51.174814 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance
I20260809 15:34:51.175120 11848 external_mini_cluster.cc:1428] Setting key 679efe9c1abc3a3532f430fb102c4ea9
Aug 09 15:34:51 dist-test-slave-1jjb krb5kdc[325](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289691, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.2@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:34:51.180243 417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:51.168563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:51965 (local address 127.11.146.62:35529)
0809 15:34:51.168679 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:51.168683 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:51.169362 (+ 679us) server_negotiation.cc:407] Connection header received
0809 15:34:51.170650 (+ 1288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:51.170654 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:51.170716 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:51.170809 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:51.171869 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:51.172443 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:51.173490 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:51.173699 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:51.173798 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:51.176396 (+ 2598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:51.176401 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:51.176404 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:34:51.176427 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:51.177884 (+ 1457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:51.178516 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:51.178519 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:51.178520 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:51.178601 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:51.179030 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:51.179036 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:51.179038 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:51.179281 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:51.179378 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:51.179821 (+ 443us) server_negotiation.cc:299] Negotiation successful
0809 15:34:51.179950 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 15:34:51.180903 742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:51.168806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:35529 (local address 127.11.146.2:51965)
0809 15:34:51.169220 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:51.169269 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:51.170458 (+ 1189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:51.170976 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:51.170983 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:51.171283 (+ 300us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:34:51.171704 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:51.171716 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:51.172560 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:51.172569 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:51.173379 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:51.173387 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:51.173832 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:51.173836 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:51.173985 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:51.174511 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:34:51.174531 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:34:51.176228 (+ 1697us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:34:51.177996 (+ 1768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:34:51.178005 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:34:51.178021 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:34:51.178426 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:34:51.178711 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:34:51.178717 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:34:51.178722 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:34:51.178912 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:34:51.179386 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:34:51.179391 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:34:51.179616 (+ 225us) client_negotiation.cc:769] Sending connection context
0809 15:34:51.179747 (+ 131us) client_negotiation.cc:240] Negotiation successful
0809 15:34:51.179959 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":104,"threads_started":1}
I20260809 15:34:51.182044 739 heartbeater.cc:347] Connected to a master server at 127.11.146.62:35529
I20260809 15:34:51.182256 739 heartbeater.cc:464] Registering TS with master...
I20260809 15:34:51.182726 739 heartbeater.cc:511] Master 127.11.146.62:35529 requested a full tablet report, sending...
I20260809 15:34:51.183696 375 ts_manager.cc:194] Registered new tserver with Master: ea1bdb6f8c6f41fd9df860b692413bce (127.11.146.2:45211)
I20260809 15:34:51.184257 375 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.2@KRBTEST.COM'} at 127.11.146.2:51965
WARNING: no policy specified for kudu/127.11.146.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
Entry for principal kudu/127.11.146.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab.
I20260809 15:34:51.202845 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.3:0
--local_ip_for_outbound_sockets=127.11.146.3
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:35529
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:38359
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:34:51.311596 745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:51.311874 745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:51.311939 745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:51.315948 745 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:51.316023 745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:51.316151 745 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.3
I20260809 15:34:51.321158 745 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:38359
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.3.keytab
--principal=kudu/127.11.146.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:35529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.745
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.3
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:51.322094 745 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:51.323020 745 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:34:51.332425 753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:51.332494 755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:51.332450 750 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:51.332603 745 server_base.cc:1034] running on GCE node
I20260809 15:34:51.332978 745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:51.333582 745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:51.334762 745 hybrid_clock.cc:648] HybridClock initialized: now 1786289691334742 us; error 40 us; skew 500 ppm
Aug 09 15:34:51 dist-test-slave-1jjb krb5kdc[325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289691, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:34:51.337558 745 init.cc:377] Logged in from keytab as kudu/127.11.146.3@KRBTEST.COM (short username kudu)
I20260809 15:34:51.338395 745 webserver.cc:460] Webserver started at http://127.11.146.3:36935/ using document root <none> and password file <none>
I20260809 15:34:51.338907 745 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:51.338990 745 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:51.339218 745 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:34:51.341131 745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-2/data/instance:
uuid: "e14875e92be541ffb2b1ece9b3d3bfe7"
format_stamp: "Formatted at 2026-08-09 15:34:51 on dist-test-slave-1jjb"
server_key: "0b365f0a26a396d2f2325e94d1f0bece"
server_key_iv: "f584f83e6eb657db5b150e18bec943b4"
server_key_version: "encryptionkey@0"
I20260809 15:34:51.341651 745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance:
uuid: "e14875e92be541ffb2b1ece9b3d3bfe7"
format_stamp: "Formatted at 2026-08-09 15:34:51 on dist-test-slave-1jjb"
server_key: "0b365f0a26a396d2f2325e94d1f0bece"
server_key_iv: "f584f83e6eb657db5b150e18bec943b4"
server_key_version: "encryptionkey@0"
I20260809 15:34:51.345132 745 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260809 15:34:51.347306 762 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:51.348435 745 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 15:34:51.348543 745 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-2/wal
uuid: "e14875e92be541ffb2b1ece9b3d3bfe7"
format_stamp: "Formatted at 2026-08-09 15:34:51 on dist-test-slave-1jjb"
server_key: "0b365f0a26a396d2f2325e94d1f0bece"
server_key_iv: "f584f83e6eb657db5b150e18bec943b4"
server_key_version: "encryptionkey@0"
I20260809 15:34:51.348631 745 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:51.378937 745 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:51.381989 745 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:51.382151 745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:51.382738 745 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:34:51.383517 745 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:34:51.383562 745 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:51.383627 745 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:34:51.383667 745 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:51.393432 745 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.3:38035
I20260809 15:34:51.393456 886 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.3:38035 every 8 connection(s)
I20260809 15:34:51.394323 745 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
I20260809 15:34:51.399008 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 745
I20260809 15:34:51.399104 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance
I20260809 15:34:51.399395 11848 external_mini_cluster.cc:1428] Setting key 211c75200c89bcf8d81874befbda94e4
Aug 09 15:34:51 dist-test-slave-1jjb krb5kdc[325](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289691, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.3@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:34:51.407589 417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:51.396098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:37661 (local address 127.11.146.62:35529)
0809 15:34:51.396231 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:51.396235 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:51.397086 (+ 851us) server_negotiation.cc:407] Connection header received
0809 15:34:51.398398 (+ 1312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:51.398401 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:51.398476 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:51.398570 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:51.399802 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:51.400617 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:51.401952 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:51.402164 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:51.402243 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:51.404541 (+ 2298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:51.404544 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:51.404546 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:34:51.404568 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:51.405923 (+ 1355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:51.406326 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:51.406329 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:51.406330 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:51.406406 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:51.406673 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:51.406675 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:51.406676 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:51.406828 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:51.406912 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:51.407380 (+ 468us) server_negotiation.cc:299] Negotiation successful
0809 15:34:51.407479 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 15:34:51.408311 890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:51.396503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:35529 (local address 127.11.146.3:37661)
0809 15:34:51.396934 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:51.396986 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:51.398197 (+ 1211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:51.398729 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:51.398735 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:51.399101 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:34:51.399634 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:51.399663 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:51.400749 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:51.400752 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:51.401849 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:51.401859 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:51.402300 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:51.402303 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:51.402433 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:51.402961 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:34:51.402977 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:34:51.404372 (+ 1395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:34:51.406013 (+ 1641us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:34:51.406017 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:34:51.406027 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:34:51.406247 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:34:51.406482 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:34:51.406484 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:34:51.406485 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:34:51.406599 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:34:51.406919 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:34:51.406924 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:34:51.407147 (+ 223us) client_negotiation.cc:769] Sending connection context
0809 15:34:51.407292 (+ 145us) client_negotiation.cc:240] Negotiation successful
0809 15:34:51.407510 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":114,"threads_started":1}
I20260809 15:34:51.409334 888 heartbeater.cc:347] Connected to a master server at 127.11.146.62:35529
I20260809 15:34:51.409544 888 heartbeater.cc:464] Registering TS with master...
I20260809 15:34:51.409977 888 heartbeater.cc:511] Master 127.11.146.62:35529 requested a full tablet report, sending...
I20260809 15:34:51.410868 375 ts_manager.cc:194] Registered new tserver with Master: e14875e92be541ffb2b1ece9b3d3bfe7 (127.11.146.3:38035)
I20260809 15:34:51.411331 375 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.146.3@KRBTEST.COM'} at 127.11.146.3:37661
I20260809 15:34:51.413086 11848 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:34:51.422015 417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:51.414946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42290 (local address 127.11.146.62:35529)
0809 15:34:51.415048 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:51.415053 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:51.415221 (+ 168us) server_negotiation.cc:407] Connection header received
0809 15:34:51.415379 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:51.415381 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:51.415419 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:51.415497 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:51.416134 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:51.416606 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:51.417410 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:51.417639 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:51.417740 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:51.419006 (+ 1266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:51.419009 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:51.419012 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:34:51.419036 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:51.420438 (+ 1402us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:51.420843 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:51.420847 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:51.420848 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:51.420934 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:51.421198 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:51.421201 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:51.421203 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:51.421400 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:51.421535 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:51.421754 (+ 219us) server_negotiation.cc:299] Negotiation successful
0809 15:34:51.421859 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 15:34:51.424575 375 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42290:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:34:51.427640 375 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:34:51.440917 903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:51.435400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:45211 (local address 127.0.0.1:57242)
0809 15:34:51.435768 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:51.435816 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:51.435932 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:51.436452 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:51.436458 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:51.436482 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:34:51.436709 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:51.436720 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:51.438077 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:51.438080 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:51.439286 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:51.439294 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:51.440418 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:51.440421 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:51.440530 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:51.440566 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 15:34:51.440688 (+ 122us) client_negotiation.cc:240] Negotiation successful
0809 15:34:51.440792 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":93,"threads_started":1}
I20260809 15:34:51.440955 904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:51.435582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57242 (local address 127.11.146.2:45211)
0809 15:34:51.435931 (+ 349us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:51.435943 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:51.435978 (+ 35us) server_negotiation.cc:407] Connection header received
0809 15:34:51.436054 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:51.436060 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:51.436271 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:51.436842 (+ 571us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:34:51.437051 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:51.437939 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:51.439395 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:51.440263 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:51.440398 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:51.440562 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:51.440726 (+ 164us) server_negotiation.cc:299] Negotiation successful
0809 15:34:51.440812 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":141,"threads_started":1}
I20260809 15:34:51.441577 906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:51.436473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:38035 (local address 127.0.0.1:54148)
0809 15:34:51.437029 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:51.437042 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:51.437130 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:51.437778 (+ 648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:51.437781 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:51.437799 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:34:51.437881 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:51.437886 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:51.439179 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:51.439182 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:51.439985 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:51.439994 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:51.441175 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:51.441179 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:51.441277 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:51.441298 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 15:34:51.441382 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 15:34:51.441468 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"mutex_wait_us":1,"thread_start_us":78,"threads_started":1}
I20260809 15:34:51.441619 908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:51.437019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54148 (local address 127.11.146.3:38035)
0809 15:34:51.437357 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:51.437370 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:51.437392 (+ 22us) server_negotiation.cc:407] Connection header received
0809 15:34:51.437462 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:51.437467 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:51.437636 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:51.437783 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:34:51.437982 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:51.439043 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:51.440194 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:51.441007 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:51.441160 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:51.441293 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:51.441410 (+ 117us) server_negotiation.cc:299] Negotiation successful
0809 15:34:51.441496 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247,"thread_start_us":162,"threads_started":1}
I20260809 15:34:51.442042 905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:51.436138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:45279 (local address 127.0.0.1:59472)
0809 15:34:51.436380 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:51.436395 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:51.436561 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:51.438012 (+ 1451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:51.438015 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:51.438038 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:34:51.438128 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:51.438133 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:51.439209 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:51.439212 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:51.440422 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:51.440433 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:51.441652 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:51.441656 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:51.441756 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:51.441777 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 15:34:51.441848 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 15:34:51.441906 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":1,"thread_start_us":102,"threads_started":1}
I20260809 15:34:51.442127 907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:51.436840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59472 (local address 127.11.146.1:45279)
0809 15:34:51.437357 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:51.437372 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:51.437400 (+ 28us) server_negotiation.cc:407] Connection header received
0809 15:34:51.437467 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:51.437471 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:51.437636 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:51.437782 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:34:51.438259 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:51.439068 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:51.440556 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:51.441387 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:51.441469 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:51.441586 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:51.441880 (+ 294us) server_negotiation.cc:299] Negotiation successful
0809 15:34:51.441961 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":418,"thread_start_us":117,"threads_started":1}
I20260809 15:34:51.444350 815 tablet_service.cc:1467] Processing CreateTablet for tablet a21159135cc44184969b8ab9d6031992 (DEFAULT_TABLE table=test-table [id=acf968f9ad014bd88b4694d7e830b45a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:34:51.444324 664 tablet_service.cc:1467] Processing CreateTablet for tablet a21159135cc44184969b8ab9d6031992 (DEFAULT_TABLE table=test-table [id=acf968f9ad014bd88b4694d7e830b45a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:34:51.444707 510 tablet_service.cc:1467] Processing CreateTablet for tablet a21159135cc44184969b8ab9d6031992 (DEFAULT_TABLE table=test-table [id=acf968f9ad014bd88b4694d7e830b45a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:34:51.445286 815 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a21159135cc44184969b8ab9d6031992. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:34:51.445381 664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a21159135cc44184969b8ab9d6031992. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:34:51.445520 510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a21159135cc44184969b8ab9d6031992. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:34:51.451213 909 tablet_bootstrap.cc:492] T a21159135cc44184969b8ab9d6031992 P e14875e92be541ffb2b1ece9b3d3bfe7: Bootstrap starting.
I20260809 15:34:51.452636 910 tablet_bootstrap.cc:492] T a21159135cc44184969b8ab9d6031992 P 3122860fc73844c0a260b84feb67d039: Bootstrap starting.
I20260809 15:34:51.453019 911 tablet_bootstrap.cc:492] T a21159135cc44184969b8ab9d6031992 P ea1bdb6f8c6f41fd9df860b692413bce: Bootstrap starting.
I20260809 15:34:51.453891 909 tablet_bootstrap.cc:654] T a21159135cc44184969b8ab9d6031992 P e14875e92be541ffb2b1ece9b3d3bfe7: Neither blocks nor log segments found. Creating new log.
I20260809 15:34:51.454609 910 tablet_bootstrap.cc:654] T a21159135cc44184969b8ab9d6031992 P 3122860fc73844c0a260b84feb67d039: Neither blocks nor log segments found. Creating new log.
I20260809 15:34:51.455129 909 log.cc:824] T a21159135cc44184969b8ab9d6031992 P e14875e92be541ffb2b1ece9b3d3bfe7: Log is configured to *not* fsync() on all Append() calls
I20260809 15:34:51.455399 911 tablet_bootstrap.cc:654] T a21159135cc44184969b8ab9d6031992 P ea1bdb6f8c6f41fd9df860b692413bce: Neither blocks nor log segments found. Creating new log.
I20260809 15:34:51.455947 910 log.cc:824] T a21159135cc44184969b8ab9d6031992 P 3122860fc73844c0a260b84feb67d039: Log is configured to *not* fsync() on all Append() calls
I20260809 15:34:51.456235 911 log.cc:824] T a21159135cc44184969b8ab9d6031992 P ea1bdb6f8c6f41fd9df860b692413bce: Log is configured to *not* fsync() on all Append() calls
I20260809 15:34:51.458086 910 tablet_bootstrap.cc:492] T a21159135cc44184969b8ab9d6031992 P 3122860fc73844c0a260b84feb67d039: No bootstrap required, opened a new log
I20260809 15:34:51.458086 911 tablet_bootstrap.cc:492] T a21159135cc44184969b8ab9d6031992 P ea1bdb6f8c6f41fd9df860b692413bce: No bootstrap required, opened a new log
I20260809 15:34:51.458285 910 ts_tablet_manager.cc:1397] T a21159135cc44184969b8ab9d6031992 P 3122860fc73844c0a260b84feb67d039: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.005s
I20260809 15:34:51.458287 911 ts_tablet_manager.cc:1397] T a21159135cc44184969b8ab9d6031992 P ea1bdb6f8c6f41fd9df860b692413bce: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.005s
I20260809 15:34:51.459233 909 tablet_bootstrap.cc:492] T a21159135cc44184969b8ab9d6031992 P e14875e92be541ffb2b1ece9b3d3bfe7: No bootstrap required, opened a new log
I20260809 15:34:51.459435 909 ts_tablet_manager.cc:1397] T a21159135cc44184969b8ab9d6031992 P e14875e92be541ffb2b1ece9b3d3bfe7: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260809 15:34:51.462301 910 raft_consensus.cc:348] T a21159135cc44184969b8ab9d6031992 P 3122860fc73844c0a260b84feb67d039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1bdb6f8c6f41fd9df860b692413bce" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 45211 } } peers { permanent_uuid: "3122860fc73844c0a260b84feb67d039" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45279 } } peers { permanent_uuid: "e14875e92be541ffb2b1ece9b3d3bfe7" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38035 } }
I20260809 15:34:51.462301 911 raft_consensus.cc:348] T a21159135cc44184969b8ab9d6031992 P ea1bdb6f8c6f41fd9df860b692413bce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1bdb6f8c6f41fd9df860b692413bce" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 45211 } } peers { permanent_uuid: "3122860fc73844c0a260b84feb67d039" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45279 } } peers { permanent_uuid: "e14875e92be541ffb2b1ece9b3d3bfe7" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38035 } }
I20260809 15:34:51.462566 911 raft_consensus.cc:374] T a21159135cc44184969b8ab9d6031992 P ea1bdb6f8c6f41fd9df860b692413bce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:34:51.462566 910 raft_consensus.cc:374] T a21159135cc44184969b8ab9d6031992 P 3122860fc73844c0a260b84feb67d039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:34:51.462630 910 raft_consensus.cc:729] T a21159135cc44184969b8ab9d6031992 P 3122860fc73844c0a260b84feb67d039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3122860fc73844c0a260b84feb67d039, State: Initialized, Role: FOLLOWER
I20260809 15:34:51.462657 911 raft_consensus.cc:729] T a21159135cc44184969b8ab9d6031992 P ea1bdb6f8c6f41fd9df860b692413bce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea1bdb6f8c6f41fd9df860b692413bce, State: Initialized, Role: FOLLOWER
I20260809 15:34:51.463130 910 consensus_queue.cc:260] T a21159135cc44184969b8ab9d6031992 P 3122860fc73844c0a260b84feb67d039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1bdb6f8c6f41fd9df860b692413bce" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 45211 } } peers { permanent_uuid: "3122860fc73844c0a260b84feb67d039" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45279 } } peers { permanent_uuid: "e14875e92be541ffb2b1ece9b3d3bfe7" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38035 } }
I20260809 15:34:51.463130 911 consensus_queue.cc:260] T a21159135cc44184969b8ab9d6031992 P ea1bdb6f8c6f41fd9df860b692413bce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1bdb6f8c6f41fd9df860b692413bce" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 45211 } } peers { permanent_uuid: "3122860fc73844c0a260b84feb67d039" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45279 } } peers { permanent_uuid: "e14875e92be541ffb2b1ece9b3d3bfe7" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38035 } }
I20260809 15:34:51.463164 909 raft_consensus.cc:348] T a21159135cc44184969b8ab9d6031992 P e14875e92be541ffb2b1ece9b3d3bfe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1bdb6f8c6f41fd9df860b692413bce" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 45211 } } peers { permanent_uuid: "3122860fc73844c0a260b84feb67d039" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45279 } } peers { permanent_uuid: "e14875e92be541ffb2b1ece9b3d3bfe7" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38035 } }
I20260809 15:34:51.463447 909 raft_consensus.cc:374] T a21159135cc44184969b8ab9d6031992 P e14875e92be541ffb2b1ece9b3d3bfe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:34:51.463526 909 raft_consensus.cc:729] T a21159135cc44184969b8ab9d6031992 P e14875e92be541ffb2b1ece9b3d3bfe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e14875e92be541ffb2b1ece9b3d3bfe7, State: Initialized, Role: FOLLOWER
I20260809 15:34:51.463970 909 consensus_queue.cc:260] T a21159135cc44184969b8ab9d6031992 P e14875e92be541ffb2b1ece9b3d3bfe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1bdb6f8c6f41fd9df860b692413bce" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 45211 } } peers { permanent_uuid: "3122860fc73844c0a260b84feb67d039" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45279 } } peers { permanent_uuid: "e14875e92be541ffb2b1ece9b3d3bfe7" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38035 } }
I20260809 15:34:51.464061 911 ts_tablet_manager.cc:1428] T a21159135cc44184969b8ab9d6031992 P ea1bdb6f8c6f41fd9df860b692413bce: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 15:34:51.464061 910 ts_tablet_manager.cc:1428] T a21159135cc44184969b8ab9d6031992 P 3122860fc73844c0a260b84feb67d039: Time spent starting tablet: real 0.006s user 0.000s sys 0.005s
I20260809 15:34:51.464406 584 heartbeater.cc:503] Master 127.11.146.62:35529 was elected leader, sending a full tablet report...
I20260809 15:34:51.464641 888 heartbeater.cc:503] Master 127.11.146.62:35529 was elected leader, sending a full tablet report...
I20260809 15:34:51.464864 909 ts_tablet_manager.cc:1428] T a21159135cc44184969b8ab9d6031992 P e14875e92be541ffb2b1ece9b3d3bfe7: Time spent starting tablet: real 0.005s user 0.001s sys 0.003s
I20260809 15:34:51.465456 739 heartbeater.cc:503] Master 127.11.146.62:35529 was elected leader, sending a full tablet report...
I20260809 15:34:51.500342 916 raft_consensus.cc:482] T a21159135cc44184969b8ab9d6031992 P 3122860fc73844c0a260b84feb67d039 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:34:51.500512 916 raft_consensus.cc:504] T a21159135cc44184969b8ab9d6031992 P 3122860fc73844c0a260b84feb67d039 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1bdb6f8c6f41fd9df860b692413bce" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 45211 } } peers { permanent_uuid: "3122860fc73844c0a260b84feb67d039" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45279 } } peers { permanent_uuid: "e14875e92be541ffb2b1ece9b3d3bfe7" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38035 } }
I20260809 15:34:51.501489 916 leader_election.cc:288] T a21159135cc44184969b8ab9d6031992 P 3122860fc73844c0a260b84feb67d039 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea1bdb6f8c6f41fd9df860b692413bce (127.11.146.2:45211), e14875e92be541ffb2b1ece9b3d3bfe7 (127.11.146.3:38035)
I20260809 15:34:51.505245 904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:51.501817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:58031 (local address 127.11.146.2:45211)
0809 15:34:51.501998 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:51.502004 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:51.502132 (+ 128us) server_negotiation.cc:407] Connection header received
0809 15:34:51.502318 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:51.502321 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:51.502384 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:51.502484 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:34:51.502756 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:51.503283 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:51.504338 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:51.504722 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:51.504842 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:51.504896 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:51.505059 (+ 163us) server_negotiation.cc:299] Negotiation successful
0809 15:34:51.505129 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 15:34:51.505259 918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:51.501690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:45211 (local address 127.11.146.1:58031)
0809 15:34:51.502028 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:51.502047 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:51.502172 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:51.502503 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:51.502507 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:51.502527 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:34:51.502653 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:51.502658 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:51.503388 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:51.503393 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:51.504229 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:51.504238 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:51.504836 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:51.504840 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:51.504935 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:51.504957 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 15:34:51.505044 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 15:34:51.505116 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":100,"threads_started":1}
I20260809 15:34:51.505999 687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a21159135cc44184969b8ab9d6031992" candidate_uuid: "3122860fc73844c0a260b84feb67d039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea1bdb6f8c6f41fd9df860b692413bce" is_pre_election: true
I20260809 15:34:51.506165 908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:51.502229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:60087 (local address 127.11.146.3:38035)
0809 15:34:51.502403 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:51.502409 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:51.502561 (+ 152us) server_negotiation.cc:407] Connection header received
0809 15:34:51.502715 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:51.502719 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:51.502770 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:51.502869 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:34:51.503199 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:51.503769 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:51.504983 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:51.505561 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:51.505763 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:51.505806 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:51.505983 (+ 177us) server_negotiation.cc:299] Negotiation successful
0809 15:34:51.506038 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260809 15:34:51.506191 920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:51.502078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:38035 (local address 127.11.146.1:60087)
0809 15:34:51.502457 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:51.502472 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:51.502605 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:51.502881 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:51.502885 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:51.502903 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:34:51.503060 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:51.503066 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:51.503895 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:51.503902 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:51.504843 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:51.504855 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:51.505749 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:51.505752 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:51.505865 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:51.505888 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 15:34:51.505971 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 15:34:51.506057 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":159,"threads_started":1}
I20260809 15:34:51.506297 687 raft_consensus.cc:2454] T a21159135cc44184969b8ab9d6031992 P ea1bdb6f8c6f41fd9df860b692413bce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3122860fc73844c0a260b84feb67d039 in term 0.
I20260809 15:34:51.506786 460 leader_election.cc:302] T a21159135cc44184969b8ab9d6031992 P 3122860fc73844c0a260b84feb67d039 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3122860fc73844c0a260b84feb67d039, ea1bdb6f8c6f41fd9df860b692413bce; no voters:
I20260809 15:34:51.507072 916 raft_consensus.cc:2781] T a21159135cc44184969b8ab9d6031992 P 3122860fc73844c0a260b84feb67d039 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:34:51.507067 837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a21159135cc44184969b8ab9d6031992" candidate_uuid: "3122860fc73844c0a260b84feb67d039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e14875e92be541ffb2b1ece9b3d3bfe7" is_pre_election: true
I20260809 15:34:51.507187 916 raft_consensus.cc:482] T a21159135cc44184969b8ab9d6031992 P 3122860fc73844c0a260b84feb67d039 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:34:51.507261 916 raft_consensus.cc:3037] T a21159135cc44184969b8ab9d6031992 P 3122860fc73844c0a260b84feb67d039 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:34:51.507367 837 raft_consensus.cc:2454] T a21159135cc44184969b8ab9d6031992 P e14875e92be541ffb2b1ece9b3d3bfe7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3122860fc73844c0a260b84feb67d039 in term 0.
I20260809 15:34:51.508615 916 raft_consensus.cc:504] T a21159135cc44184969b8ab9d6031992 P 3122860fc73844c0a260b84feb67d039 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1bdb6f8c6f41fd9df860b692413bce" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 45211 } } peers { permanent_uuid: "3122860fc73844c0a260b84feb67d039" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45279 } } peers { permanent_uuid: "e14875e92be541ffb2b1ece9b3d3bfe7" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38035 } }
I20260809 15:34:51.508961 916 leader_election.cc:288] T a21159135cc44184969b8ab9d6031992 P 3122860fc73844c0a260b84feb67d039 [CANDIDATE]: Term 1 election: Requested vote from peers ea1bdb6f8c6f41fd9df860b692413bce (127.11.146.2:45211), e14875e92be541ffb2b1ece9b3d3bfe7 (127.11.146.3:38035)
I20260809 15:34:51.509270 687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a21159135cc44184969b8ab9d6031992" candidate_uuid: "3122860fc73844c0a260b84feb67d039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea1bdb6f8c6f41fd9df860b692413bce"
I20260809 15:34:51.509397 687 raft_consensus.cc:3037] T a21159135cc44184969b8ab9d6031992 P ea1bdb6f8c6f41fd9df860b692413bce [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:34:51.509462 837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a21159135cc44184969b8ab9d6031992" candidate_uuid: "3122860fc73844c0a260b84feb67d039" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e14875e92be541ffb2b1ece9b3d3bfe7"
I20260809 15:34:51.509608 837 raft_consensus.cc:3037] T a21159135cc44184969b8ab9d6031992 P e14875e92be541ffb2b1ece9b3d3bfe7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:34:51.510587 687 raft_consensus.cc:2454] T a21159135cc44184969b8ab9d6031992 P ea1bdb6f8c6f41fd9df860b692413bce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3122860fc73844c0a260b84feb67d039 in term 1.
I20260809 15:34:51.510845 460 leader_election.cc:302] T a21159135cc44184969b8ab9d6031992 P 3122860fc73844c0a260b84feb67d039 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3122860fc73844c0a260b84feb67d039, ea1bdb6f8c6f41fd9df860b692413bce; no voters:
I20260809 15:34:51.510882 837 raft_consensus.cc:2454] T a21159135cc44184969b8ab9d6031992 P e14875e92be541ffb2b1ece9b3d3bfe7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3122860fc73844c0a260b84feb67d039 in term 1.
I20260809 15:34:51.511032 916 raft_consensus.cc:2781] T a21159135cc44184969b8ab9d6031992 P 3122860fc73844c0a260b84feb67d039 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:34:51.511310 916 raft_consensus.cc:686] T a21159135cc44184969b8ab9d6031992 P 3122860fc73844c0a260b84feb67d039 [term 1 LEADER]: Becoming Leader. State: Replica: 3122860fc73844c0a260b84feb67d039, State: Running, Role: LEADER
I20260809 15:34:51.511680 916 consensus_queue.cc:237] T a21159135cc44184969b8ab9d6031992 P 3122860fc73844c0a260b84feb67d039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1bdb6f8c6f41fd9df860b692413bce" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 45211 } } peers { permanent_uuid: "3122860fc73844c0a260b84feb67d039" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45279 } } peers { permanent_uuid: "e14875e92be541ffb2b1ece9b3d3bfe7" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38035 } }
I20260809 15:34:51.515285 374 catalog_manager.cc:5495] T a21159135cc44184969b8ab9d6031992 P 3122860fc73844c0a260b84feb67d039 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3122860fc73844c0a260b84feb67d039 (127.11.146.1). New cstate: current_term: 1 leader_uuid: "3122860fc73844c0a260b84feb67d039" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1bdb6f8c6f41fd9df860b692413bce" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 45211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3122860fc73844c0a260b84feb67d039" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e14875e92be541ffb2b1ece9b3d3bfe7" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38035 } health_report { overall_health: UNKNOWN } } }
I20260809 15:34:51.537395 907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:51.533844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59484 (local address 127.11.146.1:45279)
0809 15:34:51.533958 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:51.533962 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:51.534055 (+ 93us) server_negotiation.cc:407] Connection header received
0809 15:34:51.534197 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:51.534199 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:51.534248 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:51.534332 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:34:51.534728 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:51.535212 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:51.536028 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:51.536300 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:51.536383 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:51.536675 (+ 292us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:34:51.537107 (+ 432us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:34:51.537220 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:51.537254 (+ 34us) server_negotiation.cc:299] Negotiation successful
0809 15:34:51.537299 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 15:34:51.542698 837 raft_consensus.cc:1261] T a21159135cc44184969b8ab9d6031992 P e14875e92be541ffb2b1ece9b3d3bfe7 [term 1 FOLLOWER]: Refusing update from remote peer 3122860fc73844c0a260b84feb67d039: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:34:51.542698 687 raft_consensus.cc:1261] T a21159135cc44184969b8ab9d6031992 P ea1bdb6f8c6f41fd9df860b692413bce [term 1 FOLLOWER]: Refusing update from remote peer 3122860fc73844c0a260b84feb67d039: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:34:51.543352 921 consensus_queue.cc:1035] T a21159135cc44184969b8ab9d6031992 P 3122860fc73844c0a260b84feb67d039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e14875e92be541ffb2b1ece9b3d3bfe7" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 38035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:34:51.543565 916 consensus_queue.cc:1035] T a21159135cc44184969b8ab9d6031992 P 3122860fc73844c0a260b84feb67d039 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea1bdb6f8c6f41fd9df860b692413bce" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 45211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:34:51.553340 926 mvcc.cc:205] Tried to move back new op lower bound from 7316642576552435712 to 7316642576435290112. Current Snapshot: MvccSnapshot[applied={T|T < 7316642576552435712}]
I20260809 15:34:51.561103 374 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42290:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:34:51.561288 374 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42290:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:34:51.563911 374 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 978d06888b75430b90c3f01ff7e2cb32: Sending DeleteTablet for 3 replicas of tablet a21159135cc44184969b8ab9d6031992
I20260809 15:34:51.564726 664 tablet_service.cc:1514] Processing DeleteTablet for tablet a21159135cc44184969b8ab9d6031992 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:34:51 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:57242
I20260809 15:34:51.565052 510 tablet_service.cc:1514] Processing DeleteTablet for tablet a21159135cc44184969b8ab9d6031992 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:34:51 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:59472
I20260809 15:34:51.565186 815 tablet_service.cc:1514] Processing DeleteTablet for tablet a21159135cc44184969b8ab9d6031992 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:34:51 UTC) from {username='kudu', principal='kudu/127.11.146.62@KRBTEST.COM'} at 127.0.0.1:54148
I20260809 15:34:51.565510 937 tablet_replica.cc:330] T a21159135cc44184969b8ab9d6031992 P 3122860fc73844c0a260b84feb67d039: stopping tablet replica
I20260809 15:34:51.565558 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 440
I20260809 15:34:51.565915 937 raft_consensus.cc:2229] T a21159135cc44184969b8ab9d6031992 P 3122860fc73844c0a260b84feb67d039 [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:34:51.566825 936 tablet_replica.cc:330] T a21159135cc44184969b8ab9d6031992 P ea1bdb6f8c6f41fd9df860b692413bce: stopping tablet replica
I20260809 15:34:51.567109 936 raft_consensus.cc:2229] T a21159135cc44184969b8ab9d6031992 P ea1bdb6f8c6f41fd9df860b692413bce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:34:51.567277 938 tablet_replica.cc:330] T a21159135cc44184969b8ab9d6031992 P e14875e92be541ffb2b1ece9b3d3bfe7: stopping tablet replica
I20260809 15:34:51.567404 936 raft_consensus.cc:2258] T a21159135cc44184969b8ab9d6031992 P ea1bdb6f8c6f41fd9df860b692413bce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:34:51.567518 938 raft_consensus.cc:2229] T a21159135cc44184969b8ab9d6031992 P e14875e92be541ffb2b1ece9b3d3bfe7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:34:51.567764 938 raft_consensus.cc:2258] T a21159135cc44184969b8ab9d6031992 P e14875e92be541ffb2b1ece9b3d3bfe7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:34:51.570577 936 ts_tablet_manager.cc:1905] T a21159135cc44184969b8ab9d6031992 P ea1bdb6f8c6f41fd9df860b692413bce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:34:51.570559 938 ts_tablet_manager.cc:1905] T a21159135cc44184969b8ab9d6031992 P e14875e92be541ffb2b1ece9b3d3bfe7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:34:51.573294 936 ts_tablet_manager.cc:1918] T a21159135cc44184969b8ab9d6031992 P ea1bdb6f8c6f41fd9df860b692413bce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:34:51.573415 936 log.cc:1196] T a21159135cc44184969b8ab9d6031992 P ea1bdb6f8c6f41fd9df860b692413bce: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-1/wal/wals/a21159135cc44184969b8ab9d6031992
I20260809 15:34:51.573735 936 ts_tablet_manager.cc:1939] T a21159135cc44184969b8ab9d6031992 P ea1bdb6f8c6f41fd9df860b692413bce: Deleting consensus metadata
I20260809 15:34:51.574177 938 ts_tablet_manager.cc:1918] T a21159135cc44184969b8ab9d6031992 P e14875e92be541ffb2b1ece9b3d3bfe7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:34:51.574273 938 log.cc:1196] T a21159135cc44184969b8ab9d6031992 P e14875e92be541ffb2b1ece9b3d3bfe7: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786289437399694-11848-0/minicluster-data/ts-2/wal/wals/a21159135cc44184969b8ab9d6031992
I20260809 15:34:51.574626 938 ts_tablet_manager.cc:1939] T a21159135cc44184969b8ab9d6031992 P e14875e92be541ffb2b1ece9b3d3bfe7: Deleting consensus metadata
I20260809 15:34:51.574839 360 catalog_manager.cc:4841] TS ea1bdb6f8c6f41fd9df860b692413bce (127.11.146.2:45211): tablet a21159135cc44184969b8ab9d6031992 (table test-table [id=acf968f9ad014bd88b4694d7e830b45a]) successfully deleted
I20260809 15:34:51.575695 360 catalog_manager.cc:4841] TS e14875e92be541ffb2b1ece9b3d3bfe7 (127.11.146.3:38035): tablet a21159135cc44184969b8ab9d6031992 (table test-table [id=acf968f9ad014bd88b4694d7e830b45a]) successfully deleted
W20260809 15:34:51.579841 360 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.146.1:45279 (error 108)
I20260809 15:34:51.580647 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 590
I20260809 15:34:51.580886 903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:51.580566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:45279 (local address 127.0.0.1:59488)
0809 15:34:51.580707 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:51.580789 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.1:45279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 15:34:51.584465 360 catalog_manager.cc:4584] TS 3122860fc73844c0a260b84feb67d039 (127.11.146.1:45279): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a21159135cc44184969b8ab9d6031992: Network error: Client connection negotiation failed: client connection to 127.11.146.1:45279: connect: Connection refused (error 111)
I20260809 15:34:51.589726 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 745
I20260809 15:34:51.600673 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 339
2026-08-09T15:34:51Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2247 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-09T15:34:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:34:51Z Disabled control of system clock
I20260809 15:34:51.633030 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:37133
--webserver_interface=127.11.146.62
--webserver_port=0
--builtin_ntp_servers=127.11.146.20:45201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:37133
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 15:34:51.738827 943 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:51.739051 943 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:51.739085 943 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:51.742758 943 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:34:51.742801 943 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:51.742815 943 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:51.742847 943 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:34:51.742861 943 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:34:51.747247 943 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:45201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:37133
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:37133
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.943
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:51.748171 943 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:51.749394 943 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:34:51.757381 949 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:51.757416 953 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:51.757427 950 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:51.757495 943 server_base.cc:1034] running on GCE node
I20260809 15:34:51.758143 943 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:51.759089 943 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:51.760243 943 hybrid_clock.cc:648] HybridClock initialized: now 1786289691760216 us; error 38 us; skew 500 ppm
I20260809 15:34:51.762045 943 webserver.cc:460] Webserver started at http://127.11.146.62:38933/ using document root <none> and password file <none>
I20260809 15:34:51.762543 943 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:51.762600 943 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:51.762754 943 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:34:51.764721 943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "5bcc53bc16554d7594ae13f89f0ef392"
format_stamp: "Formatted at 2026-08-09 15:34:51 on dist-test-slave-1jjb"
server_key: "0483839bede506163fc526e4eab039b3"
server_key_iv: "81c84c8476651694a34712b4ee3c88ed"
server_key_version: "encryptionkey@0"
I20260809 15:34:51.765223 943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "5bcc53bc16554d7594ae13f89f0ef392"
format_stamp: "Formatted at 2026-08-09 15:34:51 on dist-test-slave-1jjb"
server_key: "0483839bede506163fc526e4eab039b3"
server_key_iv: "81c84c8476651694a34712b4ee3c88ed"
server_key_version: "encryptionkey@0"
I20260809 15:34:51.768632 943 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:34:51.770817 960 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:51.771927 943 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:34:51.772033 943 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "5bcc53bc16554d7594ae13f89f0ef392"
format_stamp: "Formatted at 2026-08-09 15:34:51 on dist-test-slave-1jjb"
server_key: "0483839bede506163fc526e4eab039b3"
server_key_iv: "81c84c8476651694a34712b4ee3c88ed"
server_key_version: "encryptionkey@0"
I20260809 15:34:51.772166 943 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:51.806492 943 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:51.807102 943 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:51.807250 943 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:51.814292 943 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:37133
I20260809 15:34:51.814306 1016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:37133 every 8 connection(s)
I20260809 15:34:51.815217 943 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:34:51.818159 1017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:34:51.818320 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 943
I20260809 15:34:51.818441 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:34:51.818746 11848 external_mini_cluster.cc:1428] Setting key 2ea9a9b1c7cf2c3c15ef0ccec09a1399
I20260809 15:34:51.825258 1017 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5bcc53bc16554d7594ae13f89f0ef392: Bootstrap starting.
I20260809 15:34:51.827728 1017 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5bcc53bc16554d7594ae13f89f0ef392: Neither blocks nor log segments found. Creating new log.
I20260809 15:34:51.828594 1017 log.cc:824] T 00000000000000000000000000000000 P 5bcc53bc16554d7594ae13f89f0ef392: Log is configured to *not* fsync() on all Append() calls
I20260809 15:34:51.828794 1020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:51.820174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57012 (local address 127.11.146.62:37133)
0809 15:34:51.820825 (+ 651us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:51.820843 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:51.820884 (+ 41us) server_negotiation.cc:407] Connection header received
0809 15:34:51.821633 (+ 749us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:51.821655 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:51.822152 (+ 497us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:51.822501 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:51.822912 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:51.824448 (+ 1536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:51.825306 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:51.825927 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:51.826088 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:51.826854 (+ 766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:51.826860 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:51.826873 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:34:51.827342 (+ 469us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:51.827409 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:34:51.827435 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:51.827538 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:51.827631 (+ 93us) server_negotiation.cc:299] Negotiation successful
0809 15:34:51.827888 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":115,"threads_started":1}
I20260809 15:34:51.830492 1017 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5bcc53bc16554d7594ae13f89f0ef392: No bootstrap required, opened a new log
I20260809 15:34:51.834056 1017 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5bcc53bc16554d7594ae13f89f0ef392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bcc53bc16554d7594ae13f89f0ef392" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37133 } }
I20260809 15:34:51.834262 1017 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5bcc53bc16554d7594ae13f89f0ef392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:34:51.834335 1017 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5bcc53bc16554d7594ae13f89f0ef392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bcc53bc16554d7594ae13f89f0ef392, State: Initialized, Role: FOLLOWER
I20260809 15:34:51.834724 1017 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5bcc53bc16554d7594ae13f89f0ef392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bcc53bc16554d7594ae13f89f0ef392" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37133 } }
I20260809 15:34:51.834878 1017 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5bcc53bc16554d7594ae13f89f0ef392 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:34:51.834967 1017 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5bcc53bc16554d7594ae13f89f0ef392 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:34:51.835069 1017 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5bcc53bc16554d7594ae13f89f0ef392 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:34:51.835861 1017 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5bcc53bc16554d7594ae13f89f0ef392 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bcc53bc16554d7594ae13f89f0ef392" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37133 } }
I20260809 15:34:51.836247 1017 leader_election.cc:302] T 00000000000000000000000000000000 P 5bcc53bc16554d7594ae13f89f0ef392 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5bcc53bc16554d7594ae13f89f0ef392; no voters:
I20260809 15:34:51.836534 1017 leader_election.cc:288] T 00000000000000000000000000000000 P 5bcc53bc16554d7594ae13f89f0ef392 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:34:51.836632 1023 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5bcc53bc16554d7594ae13f89f0ef392 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:34:51.836863 1023 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5bcc53bc16554d7594ae13f89f0ef392 [term 1 LEADER]: Becoming Leader. State: Replica: 5bcc53bc16554d7594ae13f89f0ef392, State: Running, Role: LEADER
I20260809 15:34:51.837214 1023 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5bcc53bc16554d7594ae13f89f0ef392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bcc53bc16554d7594ae13f89f0ef392" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37133 } }
I20260809 15:34:51.837680 1017 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5bcc53bc16554d7594ae13f89f0ef392 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:34:51.838732 1026 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5bcc53bc16554d7594ae13f89f0ef392 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5bcc53bc16554d7594ae13f89f0ef392. Latest consensus state: current_term: 1 leader_uuid: "5bcc53bc16554d7594ae13f89f0ef392" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bcc53bc16554d7594ae13f89f0ef392" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37133 } } }
I20260809 15:34:51.838881 1026 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5bcc53bc16554d7594ae13f89f0ef392 [sys.catalog]: This master's current role is: LEADER
I20260809 15:34:51.839305 1036 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:34:51.839598 1025 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5bcc53bc16554d7594ae13f89f0ef392 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5bcc53bc16554d7594ae13f89f0ef392" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bcc53bc16554d7594ae13f89f0ef392" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37133 } } }
I20260809 15:34:51.839692 1025 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5bcc53bc16554d7594ae13f89f0ef392 [sys.catalog]: This master's current role is: LEADER
I20260809 15:34:51.842262 1036 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:34:51.847407 1036 catalog_manager.cc:1347] Generated new cluster ID: 71def756e0604e6ebadc5486ca3ce807
I20260809 15:34:51.847468 1036 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:34:51.854404 1036 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:34:51.855131 1036 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:34:51.866588 1036 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5bcc53bc16554d7594ae13f89f0ef392: Generated new TSK 0
I20260809 15:34:51.867173 1036 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:34:51.871696 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.1:0
--local_ip_for_outbound_sockets=127.11.146.1
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:37133
--builtin_ntp_servers=127.11.146.20:45201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 15:34:51.995831 1047 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:51.996057 1047 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:51.996115 1047 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:51.999972 1047 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:52.000017 1047 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:52.000068 1047 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.1
I20260809 15:34:52.004617 1047 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:45201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.146.1
--webserver_port=0
--tserver_master_addrs=127.11.146.62:37133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1047
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.1
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:52.005570 1047 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:52.006843 1047 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:34:52.016031 1053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:52.016048 1052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:52.016038 1056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:52.016191 1047 server_base.cc:1034] running on GCE node
I20260809 15:34:52.016631 1047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:52.017254 1047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:52.018445 1047 hybrid_clock.cc:648] HybridClock initialized: now 1786289692018414 us; error 52 us; skew 500 ppm
I20260809 15:34:52.020208 1047 webserver.cc:460] Webserver started at http://127.11.146.1:43879/ using document root <none> and password file <none>
I20260809 15:34:52.020736 1047 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:52.020824 1047 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:52.021039 1047 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:34:52.022960 1047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-0/data/instance:
uuid: "c95b22fad87d4983a8bfb7dc59f59a04"
format_stamp: "Formatted at 2026-08-09 15:34:52 on dist-test-slave-1jjb"
server_key: "f4f5bc60f068892517fdffb32f04ecce"
server_key_iv: "cbf0cff4c74ad3c91f41725798bb46c0"
server_key_version: "encryptionkey@0"
I20260809 15:34:52.023501 1047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance:
uuid: "c95b22fad87d4983a8bfb7dc59f59a04"
format_stamp: "Formatted at 2026-08-09 15:34:52 on dist-test-slave-1jjb"
server_key: "f4f5bc60f068892517fdffb32f04ecce"
server_key_iv: "cbf0cff4c74ad3c91f41725798bb46c0"
server_key_version: "encryptionkey@0"
I20260809 15:34:52.026940 1047 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260809 15:34:52.029178 1062 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:52.030290 1047 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:34:52.030421 1047 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-0/wal
uuid: "c95b22fad87d4983a8bfb7dc59f59a04"
format_stamp: "Formatted at 2026-08-09 15:34:52 on dist-test-slave-1jjb"
server_key: "f4f5bc60f068892517fdffb32f04ecce"
server_key_iv: "cbf0cff4c74ad3c91f41725798bb46c0"
server_key_version: "encryptionkey@0"
I20260809 15:34:52.030522 1047 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:52.063486 1047 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:52.064038 1047 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:52.064235 1047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:52.064745 1047 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:34:52.065574 1047 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:34:52.065647 1047 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:52.065724 1047 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:34:52.065768 1047 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:52.074090 1047 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.1:45493
I20260809 15:34:52.074127 1187 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.1:45493 every 8 connection(s)
I20260809 15:34:52.074931 1047 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-0/data/info.pb
I20260809 15:34:52.079651 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 1047
I20260809 15:34:52.079746 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-0/wal/instance
I20260809 15:34:52.080060 11848 external_mini_cluster.cc:1428] Setting key dedf964ada42a30f3dd7d599052ec6e4
I20260809 15:34:52.081923 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.2:0
--local_ip_for_outbound_sockets=127.11.146.2
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:37133
--builtin_ntp_servers=127.11.146.20:45201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 15:34:52.083858 1020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:52.076563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.1:59261 (local address 127.11.146.62:37133)
0809 15:34:52.076688 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:52.076692 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:52.077635 (+ 943us) server_negotiation.cc:407] Connection header received
0809 15:34:52.078967 (+ 1332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:52.078970 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:52.079014 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:52.079083 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:52.079982 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.080732 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.081950 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.082293 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.082389 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:52.083367 (+ 978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:52.083370 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:52.083373 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:34:52.083384 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:52.083404 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:34:52.083417 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:52.083489 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:52.083663 (+ 174us) server_negotiation.cc:299] Negotiation successful
0809 15:34:52.083726 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 15:34:52.084662 1190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:52.076920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:37133 (local address 127.11.146.1:59261)
0809 15:34:52.077523 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:52.077560 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:52.078795 (+ 1235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:52.079229 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:52.079235 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:52.079307 (+ 72us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:34:52.079819 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:52.079841 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.080850 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.080854 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:52.081827 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:52.081837 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.082435 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.082439 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:52.082589 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:52.083142 (+ 553us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:34:52.083143 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:34:52.083177 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:34:52.083231 (+ 54us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:34:52.083492 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:34:52.083518 (+ 26us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:34:52.083526 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 15:34:52.083660 (+ 134us) client_negotiation.cc:240] Negotiation successful
0809 15:34:52.083906 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":135,"threads_started":1}
I20260809 15:34:52.085863 1188 heartbeater.cc:347] Connected to a master server at 127.11.146.62:37133
I20260809 15:34:52.086074 1188 heartbeater.cc:464] Registering TS with master...
I20260809 15:34:52.086525 1188 heartbeater.cc:511] Master 127.11.146.62:37133 requested a full tablet report, sending...
I20260809 15:34:52.088248 978 ts_manager.cc:194] Registered new tserver with Master: c95b22fad87d4983a8bfb7dc59f59a04 (127.11.146.1:45493)
I20260809 15:34:52.089984 978 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.146.1:59261
W20260809 15:34:52.189073 1191 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:52.189307 1191 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:52.189342 1191 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:52.193034 1191 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:52.193073 1191 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:52.193123 1191 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.2
I20260809 15:34:52.197496 1191 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:45201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.146.2
--webserver_port=0
--tserver_master_addrs=127.11.146.62:37133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1191
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.2
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:52.198302 1191 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:52.199527 1191 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:34:52.208154 1199 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:52.208211 1196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:52.208225 1197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:52.208339 1191 server_base.cc:1034] running on GCE node
I20260809 15:34:52.208873 1191 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:52.209440 1191 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:52.210614 1191 hybrid_clock.cc:648] HybridClock initialized: now 1786289692210588 us; error 42 us; skew 500 ppm
I20260809 15:34:52.212337 1191 webserver.cc:460] Webserver started at http://127.11.146.2:39453/ using document root <none> and password file <none>
I20260809 15:34:52.212853 1191 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:52.212935 1191 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:52.213128 1191 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:34:52.214923 1191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-1/data/instance:
uuid: "9ba2c32bdd5d48ffa03bcecbe8bbb089"
format_stamp: "Formatted at 2026-08-09 15:34:52 on dist-test-slave-1jjb"
server_key: "90ba07ed7b6aec1d281da837795a0bc3"
server_key_iv: "6b09387fedca4eb96e17e4a4c231c938"
server_key_version: "encryptionkey@0"
I20260809 15:34:52.215443 1191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance:
uuid: "9ba2c32bdd5d48ffa03bcecbe8bbb089"
format_stamp: "Formatted at 2026-08-09 15:34:52 on dist-test-slave-1jjb"
server_key: "90ba07ed7b6aec1d281da837795a0bc3"
server_key_iv: "6b09387fedca4eb96e17e4a4c231c938"
server_key_version: "encryptionkey@0"
I20260809 15:34:52.218820 1191 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 15:34:52.221079 1205 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:52.222133 1191 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:34:52.222254 1191 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-1/wal
uuid: "9ba2c32bdd5d48ffa03bcecbe8bbb089"
format_stamp: "Formatted at 2026-08-09 15:34:52 on dist-test-slave-1jjb"
server_key: "90ba07ed7b6aec1d281da837795a0bc3"
server_key_iv: "6b09387fedca4eb96e17e4a4c231c938"
server_key_version: "encryptionkey@0"
I20260809 15:34:52.222384 1191 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:52.239217 1191 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:52.239799 1191 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:52.239965 1191 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:52.240499 1191 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:34:52.241266 1191 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:34:52.241348 1191 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:52.241421 1191 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:34:52.241461 1191 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:52.249445 1191 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.2:40645
I20260809 15:34:52.249480 1333 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.2:40645 every 8 connection(s)
I20260809 15:34:52.250207 1191 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-1/data/info.pb
I20260809 15:34:52.258574 1020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:52.251781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:47851 (local address 127.11.146.62:37133)
0809 15:34:52.251905 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:52.251913 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:52.252814 (+ 901us) server_negotiation.cc:407] Connection header received
0809 15:34:52.254097 (+ 1283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:52.254101 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:52.254159 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:52.254254 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:52.255106 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.255643 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.256764 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.256991 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.257100 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:52.258104 (+ 1004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:52.258107 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:52.258110 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:34:52.258123 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:52.258147 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:34:52.258155 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:52.258228 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:52.258382 (+ 154us) server_negotiation.cc:299] Negotiation successful
0809 15:34:52.258439 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 15:34:52.259280 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 1191
I20260809 15:34:52.259413 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-1/wal/instance
I20260809 15:34:52.259502 1336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:52.252053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:37133 (local address 127.11.146.2:47851)
0809 15:34:52.252678 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:52.252713 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:52.253897 (+ 1184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:52.254411 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:52.254418 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:52.254492 (+ 74us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:34:52.254970 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:52.254982 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.255760 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.255764 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:52.256633 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:52.256643 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.257137 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.257141 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:52.257295 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:52.257852 (+ 557us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:34:52.257854 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:34:52.257890 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:34:52.257948 (+ 58us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:34:52.258229 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:34:52.258241 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:34:52.258249 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 15:34:52.258381 (+ 132us) client_negotiation.cc:240] Negotiation successful
0809 15:34:52.258630 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":103,"threads_started":1}
I20260809 15:34:52.259758 11848 external_mini_cluster.cc:1428] Setting key ba902dc75140c6370237821d537021e9
I20260809 15:34:52.260876 1334 heartbeater.cc:347] Connected to a master server at 127.11.146.62:37133
I20260809 15:34:52.261157 1334 heartbeater.cc:464] Registering TS with master...
I20260809 15:34:52.261662 1334 heartbeater.cc:511] Master 127.11.146.62:37133 requested a full tablet report, sending...
I20260809 15:34:52.262035 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.146.3:0
--local_ip_for_outbound_sockets=127.11.146.3
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:37133
--builtin_ntp_servers=127.11.146.20:45201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 15:34:52.262661 978 ts_manager.cc:194] Registered new tserver with Master: 9ba2c32bdd5d48ffa03bcecbe8bbb089 (127.11.146.2:40645)
I20260809 15:34:52.263422 978 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.146.2:47851
W20260809 15:34:52.371752 1337 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:52.371999 1337 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:52.372071 1337 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:52.376250 1337 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:52.376307 1337 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:52.376395 1337 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.3
I20260809 15:34:52.381048 1337 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:45201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.146.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.146.3
--webserver_port=0
--tserver_master_addrs=127.11.146.62:37133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1337
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.146.3
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:52.382022 1337 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:52.383437 1337 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:34:52.392560 1346 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:52.392599 1343 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:52.392784 1337 server_base.cc:1034] running on GCE node
W20260809 15:34:52.392599 1344 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:52.393323 1337 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:52.393975 1337 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:52.395174 1337 hybrid_clock.cc:648] HybridClock initialized: now 1786289692395161 us; error 24 us; skew 500 ppm
I20260809 15:34:52.397033 1337 webserver.cc:460] Webserver started at http://127.11.146.3:38131/ using document root <none> and password file <none>
I20260809 15:34:52.397640 1337 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:52.397732 1337 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:52.397967 1337 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:34:52.400161 1337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-2/data/instance:
uuid: "81d4681707ea408e8f171dfba571c0d3"
format_stamp: "Formatted at 2026-08-09 15:34:52 on dist-test-slave-1jjb"
server_key: "c027e2aa0fbf0852804ac0f176b9ea57"
server_key_iv: "dbbcab98f79f3439cbe4555ce7b9e2c3"
server_key_version: "encryptionkey@0"
I20260809 15:34:52.400750 1337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance:
uuid: "81d4681707ea408e8f171dfba571c0d3"
format_stamp: "Formatted at 2026-08-09 15:34:52 on dist-test-slave-1jjb"
server_key: "c027e2aa0fbf0852804ac0f176b9ea57"
server_key_iv: "dbbcab98f79f3439cbe4555ce7b9e2c3"
server_key_version: "encryptionkey@0"
I20260809 15:34:52.404522 1337 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 15:34:52.407058 1352 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:52.408313 1337 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:34:52.408457 1337 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-2/wal
uuid: "81d4681707ea408e8f171dfba571c0d3"
format_stamp: "Formatted at 2026-08-09 15:34:52 on dist-test-slave-1jjb"
server_key: "c027e2aa0fbf0852804ac0f176b9ea57"
server_key_iv: "dbbcab98f79f3439cbe4555ce7b9e2c3"
server_key_version: "encryptionkey@0"
I20260809 15:34:52.408603 1337 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:52.428815 1337 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:52.429469 1337 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:52.429656 1337 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:52.430210 1337 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 15:34:52.431120 1337 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 15:34:52.431186 1337 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:52.431253 1337 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 15:34:52.431298 1337 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:52.440358 1337 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.3:42147
I20260809 15:34:52.440413 1475 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.3:42147 every 8 connection(s)
I20260809 15:34:52.441232 1337 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-2/data/info.pb
I20260809 15:34:52.449225 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 1337
I20260809 15:34:52.449362 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-2/wal/instance
I20260809 15:34:52.449671 11848 external_mini_cluster.cc:1428] Setting key ea0dc88025952278aa60eadb5c93c07d
I20260809 15:34:52.449852 1020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:52.442987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.3:47845 (local address 127.11.146.62:37133)
0809 15:34:52.443119 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:52.443123 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:52.444129 (+ 1006us) server_negotiation.cc:407] Connection header received
0809 15:34:52.445437 (+ 1308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:52.445440 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:52.445492 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:52.445582 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:52.446406 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.446917 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.447961 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.448222 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.448301 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:52.449339 (+ 1038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:52.449344 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:52.449347 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:34:52.449361 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:52.449383 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:34:52.449395 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:52.449494 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:52.449648 (+ 154us) server_negotiation.cc:299] Negotiation successful
0809 15:34:52.449712 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 15:34:52.450618 1478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:52.443353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:37133 (local address 127.11.146.3:47845)
0809 15:34:52.443973 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:52.444011 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:52.445263 (+ 1252us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:52.445743 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:52.445749 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:52.445825 (+ 76us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:34:52.446292 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:52.446304 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.447019 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.447021 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:52.447851 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:52.447860 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.448345 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.448348 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:52.448480 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:52.449092 (+ 612us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 15:34:52.449093 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:34:52.449131 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 15:34:52.449190 (+ 59us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:34:52.449495 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:34:52.449503 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:34:52.449509 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 15:34:52.449623 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 15:34:52.449873 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":111,"threads_started":1}
I20260809 15:34:52.451704 1476 heartbeater.cc:347] Connected to a master server at 127.11.146.62:37133
I20260809 15:34:52.451925 1476 heartbeater.cc:464] Registering TS with master...
I20260809 15:34:52.452430 1476 heartbeater.cc:511] Master 127.11.146.62:37133 requested a full tablet report, sending...
I20260809 15:34:52.453369 978 ts_manager.cc:194] Registered new tserver with Master: 81d4681707ea408e8f171dfba571c0d3 (127.11.146.3:42147)
I20260809 15:34:52.453918 978 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.146.3:47845
I20260809 15:34:52.463232 11848 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 15:34:52.468340 1020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:52.465102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57020 (local address 127.11.146.62:37133)
0809 15:34:52.465208 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:52.465211 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:52.465330 (+ 119us) server_negotiation.cc:407] Connection header received
0809 15:34:52.465432 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:52.465434 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:52.465476 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:52.465535 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:52.465760 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.466207 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.466962 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.467178 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.467249 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:52.467988 (+ 739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:52.467990 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:52.467992 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:34:52.468001 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:52.468014 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:34:52.468021 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:52.468117 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:52.468194 (+ 77us) server_negotiation.cc:299] Negotiation successful
0809 15:34:52.468236 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 15:34:52.470839 978 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57020:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 15:34:52.473800 978 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 15:34:52.487417 1488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:52.481664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:42147 (local address 127.0.0.1:35916)
0809 15:34:52.482130 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:52.482165 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:52.482259 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:52.483056 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:52.483064 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:52.483090 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:34:52.483228 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:52.483238 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.484600 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.484603 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:52.485912 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:52.485922 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.486871 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.486874 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:52.486977 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:52.487032 (+ 55us) client_negotiation.cc:769] Sending connection context
0809 15:34:52.487155 (+ 123us) client_negotiation.cc:240] Negotiation successful
0809 15:34:52.487276 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"mutex_wait_us":25,"thread_start_us":81,"threads_started":1}
I20260809 15:34:52.487481 1491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:52.481795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35916 (local address 127.11.146.3:42147)
0809 15:34:52.482565 (+ 770us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:52.482577 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:52.482602 (+ 25us) server_negotiation.cc:407] Connection header received
0809 15:34:52.482679 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:52.482684 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:52.482873 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:52.483379 (+ 506us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:34:52.483519 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.484479 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.486044 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.486747 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.486847 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:52.487025 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:52.487198 (+ 173us) server_negotiation.cc:299] Negotiation successful
0809 15:34:52.487298 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":672,"thread_start_us":156,"threads_started":1}
I20260809 15:34:52.487747 1490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:52.481782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:45493 (local address 127.0.0.1:44522)
0809 15:34:52.482820 (+ 1038us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:52.482832 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:52.482938 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:52.483596 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:52.483598 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:52.483612 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:34:52.483685 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:52.483688 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.484962 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.484966 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:52.486167 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:52.486176 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.487339 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.487343 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:52.487422 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:52.487455 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 15:34:52.487528 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 15:34:52.487608 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":972,"mutex_wait_us":71,"thread_start_us":81,"threads_started":1}
I20260809 15:34:52.488045 1492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:52.482356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:40645 (local address 127.0.0.1:58500)
0809 15:34:52.483182 (+ 826us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:52.483195 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:52.483335 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:52.483923 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:52.483925 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:52.483942 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:34:52.484026 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:52.484031 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.485271 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.485276 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:52.486401 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:52.486412 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.487661 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.487665 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:52.487758 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:52.487786 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 15:34:52.487859 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 15:34:52.487918 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":767,"mutex_wait_us":3,"thread_start_us":95,"threads_started":1}
I20260809 15:34:52.488327 1493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:52.482436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44522 (local address 127.11.146.1:45493)
0809 15:34:52.482753 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:52.482765 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:52.483057 (+ 292us) server_negotiation.cc:407] Connection header received
0809 15:34:52.483138 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:52.483143 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:52.483320 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:52.483463 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:34:52.483794 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.484842 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.486287 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.486959 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.487072 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:52.487276 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:52.487964 (+ 688us) server_negotiation.cc:299] Negotiation successful
0809 15:34:52.488128 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":137,"threads_started":1}
I20260809 15:34:52.488482 1494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:52.482531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58500 (local address 127.11.146.2:40645)
0809 15:34:52.483055 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:52.483066 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:52.483268 (+ 202us) server_negotiation.cc:407] Connection header received
0809 15:34:52.483470 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:52.483475 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:52.483640 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:52.483752 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:34:52.484195 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.485170 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.486530 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.487308 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.487424 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:52.487595 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:52.488223 (+ 628us) server_negotiation.cc:299] Negotiation successful
0809 15:34:52.488326 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":103,"threads_started":1}
I20260809 15:34:52.490756 1117 tablet_service.cc:1467] Processing CreateTablet for tablet 5c2310e54c11474a87e9cff4cd4d3ade (DEFAULT_TABLE table=test-table [id=50bf2d01efdb4341a714887eb3bd743b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:34:52.490778 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 5c2310e54c11474a87e9cff4cd4d3ade (DEFAULT_TABLE table=test-table [id=50bf2d01efdb4341a714887eb3bd743b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:34:52.491087 1263 tablet_service.cc:1467] Processing CreateTablet for tablet 5c2310e54c11474a87e9cff4cd4d3ade (DEFAULT_TABLE table=test-table [id=50bf2d01efdb4341a714887eb3bd743b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 15:34:52.491817 1117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c2310e54c11474a87e9cff4cd4d3ade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:34:52.491858 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c2310e54c11474a87e9cff4cd4d3ade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:34:52.491976 1263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c2310e54c11474a87e9cff4cd4d3ade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:34:52.498202 1495 tablet_bootstrap.cc:492] T 5c2310e54c11474a87e9cff4cd4d3ade P c95b22fad87d4983a8bfb7dc59f59a04: Bootstrap starting.
I20260809 15:34:52.499230 1496 tablet_bootstrap.cc:492] T 5c2310e54c11474a87e9cff4cd4d3ade P 9ba2c32bdd5d48ffa03bcecbe8bbb089: Bootstrap starting.
I20260809 15:34:52.499553 1497 tablet_bootstrap.cc:492] T 5c2310e54c11474a87e9cff4cd4d3ade P 81d4681707ea408e8f171dfba571c0d3: Bootstrap starting.
I20260809 15:34:52.500407 1495 tablet_bootstrap.cc:654] T 5c2310e54c11474a87e9cff4cd4d3ade P c95b22fad87d4983a8bfb7dc59f59a04: Neither blocks nor log segments found. Creating new log.
I20260809 15:34:52.501092 1495 log.cc:824] T 5c2310e54c11474a87e9cff4cd4d3ade P c95b22fad87d4983a8bfb7dc59f59a04: Log is configured to *not* fsync() on all Append() calls
I20260809 15:34:52.501552 1497 tablet_bootstrap.cc:654] T 5c2310e54c11474a87e9cff4cd4d3ade P 81d4681707ea408e8f171dfba571c0d3: Neither blocks nor log segments found. Creating new log.
I20260809 15:34:52.502142 1496 tablet_bootstrap.cc:654] T 5c2310e54c11474a87e9cff4cd4d3ade P 9ba2c32bdd5d48ffa03bcecbe8bbb089: Neither blocks nor log segments found. Creating new log.
I20260809 15:34:52.502350 1497 log.cc:824] T 5c2310e54c11474a87e9cff4cd4d3ade P 81d4681707ea408e8f171dfba571c0d3: Log is configured to *not* fsync() on all Append() calls
I20260809 15:34:52.502934 1496 log.cc:824] T 5c2310e54c11474a87e9cff4cd4d3ade P 9ba2c32bdd5d48ffa03bcecbe8bbb089: Log is configured to *not* fsync() on all Append() calls
I20260809 15:34:52.503659 1495 tablet_bootstrap.cc:492] T 5c2310e54c11474a87e9cff4cd4d3ade P c95b22fad87d4983a8bfb7dc59f59a04: No bootstrap required, opened a new log
I20260809 15:34:52.503893 1495 ts_tablet_manager.cc:1397] T 5c2310e54c11474a87e9cff4cd4d3ade P c95b22fad87d4983a8bfb7dc59f59a04: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 15:34:52.504369 1497 tablet_bootstrap.cc:492] T 5c2310e54c11474a87e9cff4cd4d3ade P 81d4681707ea408e8f171dfba571c0d3: No bootstrap required, opened a new log
I20260809 15:34:52.504549 1497 ts_tablet_manager.cc:1397] T 5c2310e54c11474a87e9cff4cd4d3ade P 81d4681707ea408e8f171dfba571c0d3: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 15:34:52.504806 1496 tablet_bootstrap.cc:492] T 5c2310e54c11474a87e9cff4cd4d3ade P 9ba2c32bdd5d48ffa03bcecbe8bbb089: No bootstrap required, opened a new log
I20260809 15:34:52.504992 1496 ts_tablet_manager.cc:1397] T 5c2310e54c11474a87e9cff4cd4d3ade P 9ba2c32bdd5d48ffa03bcecbe8bbb089: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 15:34:52.507944 1496 raft_consensus.cc:348] T 5c2310e54c11474a87e9cff4cd4d3ade P 9ba2c32bdd5d48ffa03bcecbe8bbb089 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81d4681707ea408e8f171dfba571c0d3" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42147 } } peers { permanent_uuid: "c95b22fad87d4983a8bfb7dc59f59a04" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45493 } } peers { permanent_uuid: "9ba2c32bdd5d48ffa03bcecbe8bbb089" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 40645 } }
I20260809 15:34:52.507963 1495 raft_consensus.cc:348] T 5c2310e54c11474a87e9cff4cd4d3ade P c95b22fad87d4983a8bfb7dc59f59a04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81d4681707ea408e8f171dfba571c0d3" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42147 } } peers { permanent_uuid: "c95b22fad87d4983a8bfb7dc59f59a04" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45493 } } peers { permanent_uuid: "9ba2c32bdd5d48ffa03bcecbe8bbb089" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 40645 } }
I20260809 15:34:52.508205 1496 raft_consensus.cc:374] T 5c2310e54c11474a87e9cff4cd4d3ade P 9ba2c32bdd5d48ffa03bcecbe8bbb089 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:34:52.508229 1495 raft_consensus.cc:374] T 5c2310e54c11474a87e9cff4cd4d3ade P c95b22fad87d4983a8bfb7dc59f59a04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:34:52.508291 1496 raft_consensus.cc:729] T 5c2310e54c11474a87e9cff4cd4d3ade P 9ba2c32bdd5d48ffa03bcecbe8bbb089 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba2c32bdd5d48ffa03bcecbe8bbb089, State: Initialized, Role: FOLLOWER
I20260809 15:34:52.508330 1495 raft_consensus.cc:729] T 5c2310e54c11474a87e9cff4cd4d3ade P c95b22fad87d4983a8bfb7dc59f59a04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95b22fad87d4983a8bfb7dc59f59a04, State: Initialized, Role: FOLLOWER
I20260809 15:34:52.508747 1496 consensus_queue.cc:260] T 5c2310e54c11474a87e9cff4cd4d3ade P 9ba2c32bdd5d48ffa03bcecbe8bbb089 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81d4681707ea408e8f171dfba571c0d3" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42147 } } peers { permanent_uuid: "c95b22fad87d4983a8bfb7dc59f59a04" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45493 } } peers { permanent_uuid: "9ba2c32bdd5d48ffa03bcecbe8bbb089" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 40645 } }
I20260809 15:34:52.508790 1495 consensus_queue.cc:260] T 5c2310e54c11474a87e9cff4cd4d3ade P c95b22fad87d4983a8bfb7dc59f59a04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81d4681707ea408e8f171dfba571c0d3" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42147 } } peers { permanent_uuid: "c95b22fad87d4983a8bfb7dc59f59a04" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45493 } } peers { permanent_uuid: "9ba2c32bdd5d48ffa03bcecbe8bbb089" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 40645 } }
I20260809 15:34:52.508718 1497 raft_consensus.cc:348] T 5c2310e54c11474a87e9cff4cd4d3ade P 81d4681707ea408e8f171dfba571c0d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81d4681707ea408e8f171dfba571c0d3" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42147 } } peers { permanent_uuid: "c95b22fad87d4983a8bfb7dc59f59a04" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45493 } } peers { permanent_uuid: "9ba2c32bdd5d48ffa03bcecbe8bbb089" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 40645 } }
I20260809 15:34:52.508934 1497 raft_consensus.cc:374] T 5c2310e54c11474a87e9cff4cd4d3ade P 81d4681707ea408e8f171dfba571c0d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:34:52.509029 1497 raft_consensus.cc:729] T 5c2310e54c11474a87e9cff4cd4d3ade P 81d4681707ea408e8f171dfba571c0d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81d4681707ea408e8f171dfba571c0d3, State: Initialized, Role: FOLLOWER
I20260809 15:34:52.509368 1334 heartbeater.cc:503] Master 127.11.146.62:37133 was elected leader, sending a full tablet report...
I20260809 15:34:52.509555 1497 consensus_queue.cc:260] T 5c2310e54c11474a87e9cff4cd4d3ade P 81d4681707ea408e8f171dfba571c0d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81d4681707ea408e8f171dfba571c0d3" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42147 } } peers { permanent_uuid: "c95b22fad87d4983a8bfb7dc59f59a04" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45493 } } peers { permanent_uuid: "9ba2c32bdd5d48ffa03bcecbe8bbb089" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 40645 } }
I20260809 15:34:52.509830 1495 ts_tablet_manager.cc:1428] T 5c2310e54c11474a87e9cff4cd4d3ade P c95b22fad87d4983a8bfb7dc59f59a04: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 15:34:52.510134 1188 heartbeater.cc:503] Master 127.11.146.62:37133 was elected leader, sending a full tablet report...
I20260809 15:34:52.510430 1497 ts_tablet_manager.cc:1428] T 5c2310e54c11474a87e9cff4cd4d3ade P 81d4681707ea408e8f171dfba571c0d3: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 15:34:52.510598 1496 ts_tablet_manager.cc:1428] T 5c2310e54c11474a87e9cff4cd4d3ade P 9ba2c32bdd5d48ffa03bcecbe8bbb089: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 15:34:52.511034 1476 heartbeater.cc:503] Master 127.11.146.62:37133 was elected leader, sending a full tablet report...
W20260809 15:34:52.575924 1189 tablet.cc:2369] T 5c2310e54c11474a87e9cff4cd4d3ade P c95b22fad87d4983a8bfb7dc59f59a04: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 15:34:52.692207 1477 tablet.cc:2369] T 5c2310e54c11474a87e9cff4cd4d3ade P 81d4681707ea408e8f171dfba571c0d3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 15:34:52.751245 1335 tablet.cc:2369] T 5c2310e54c11474a87e9cff4cd4d3ade P 9ba2c32bdd5d48ffa03bcecbe8bbb089: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:34:52.845809 1501 raft_consensus.cc:482] T 5c2310e54c11474a87e9cff4cd4d3ade P 9ba2c32bdd5d48ffa03bcecbe8bbb089 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 15:34:52.846030 1501 raft_consensus.cc:504] T 5c2310e54c11474a87e9cff4cd4d3ade P 9ba2c32bdd5d48ffa03bcecbe8bbb089 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81d4681707ea408e8f171dfba571c0d3" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42147 } } peers { permanent_uuid: "c95b22fad87d4983a8bfb7dc59f59a04" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45493 } } peers { permanent_uuid: "9ba2c32bdd5d48ffa03bcecbe8bbb089" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 40645 } }
I20260809 15:34:52.847134 1501 leader_election.cc:288] T 5c2310e54c11474a87e9cff4cd4d3ade P 9ba2c32bdd5d48ffa03bcecbe8bbb089 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81d4681707ea408e8f171dfba571c0d3 (127.11.146.3:42147), c95b22fad87d4983a8bfb7dc59f59a04 (127.11.146.1:45493)
I20260809 15:34:52.850903 1493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:52.847469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:38469 (local address 127.11.146.1:45493)
0809 15:34:52.847594 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:52.847599 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:52.847752 (+ 153us) server_negotiation.cc:407] Connection header received
0809 15:34:52.847913 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:52.847916 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:52.847967 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:52.848047 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:34:52.848358 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.848845 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.849961 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.850364 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.850479 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:52.850539 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:52.850694 (+ 155us) server_negotiation.cc:299] Negotiation successful
0809 15:34:52.850776 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 15:34:52.850934 1491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:52.847708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.146.2:59777 (local address 127.11.146.3:42147)
0809 15:34:52.847835 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:52.847839 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:52.847854 (+ 15us) server_negotiation.cc:407] Connection header received
0809 15:34:52.847972 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:52.847975 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:52.848014 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:52.848114 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 15:34:52.848391 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.848850 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.849964 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.850375 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.850494 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:52.850538 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:52.850707 (+ 169us) server_negotiation.cc:299] Negotiation successful
0809 15:34:52.850815 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 15:34:52.850948 1505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:52.847367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:45493 (local address 127.11.146.2:38469)
0809 15:34:52.847662 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:52.847675 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:52.847800 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:52.848060 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:52.848063 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:52.848100 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:34:52.848235 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:52.848241 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.848972 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.848978 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:52.849832 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:52.849841 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.850474 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.850477 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:52.850569 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:52.850593 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 15:34:52.850678 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 15:34:52.850758 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"mutex_wait_us":26,"thread_start_us":88,"threads_started":1}
I20260809 15:34:52.850952 1504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:52.847371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.3:42147 (local address 127.11.146.2:59777)
0809 15:34:52.847741 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:52.847756 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:34:52.847855 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:34:52.848131 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:34:52.848134 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:34:52.848151 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 15:34:52.848268 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:52.848274 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.848992 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.848997 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:52.849834 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:34:52.849843 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.850494 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.850498 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:34:52.850597 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:52.850614 (+ 17us) client_negotiation.cc:769] Sending connection context
0809 15:34:52.850692 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 15:34:52.850775 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"mutex_wait_us":88,"thread_start_us":72,"threads_started":1}
I20260809 15:34:52.851791 1140 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c2310e54c11474a87e9cff4cd4d3ade" candidate_uuid: "9ba2c32bdd5d48ffa03bcecbe8bbb089" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95b22fad87d4983a8bfb7dc59f59a04" is_pre_election: true
I20260809 15:34:52.851856 1427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c2310e54c11474a87e9cff4cd4d3ade" candidate_uuid: "9ba2c32bdd5d48ffa03bcecbe8bbb089" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81d4681707ea408e8f171dfba571c0d3" is_pre_election: true
I20260809 15:34:52.852140 1427 raft_consensus.cc:2454] T 5c2310e54c11474a87e9cff4cd4d3ade P 81d4681707ea408e8f171dfba571c0d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba2c32bdd5d48ffa03bcecbe8bbb089 in term 0.
I20260809 15:34:52.852140 1140 raft_consensus.cc:2454] T 5c2310e54c11474a87e9cff4cd4d3ade P c95b22fad87d4983a8bfb7dc59f59a04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba2c32bdd5d48ffa03bcecbe8bbb089 in term 0.
I20260809 15:34:52.852572 1210 leader_election.cc:302] T 5c2310e54c11474a87e9cff4cd4d3ade P 9ba2c32bdd5d48ffa03bcecbe8bbb089 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ba2c32bdd5d48ffa03bcecbe8bbb089, c95b22fad87d4983a8bfb7dc59f59a04; no voters:
I20260809 15:34:52.852842 1501 raft_consensus.cc:2781] T 5c2310e54c11474a87e9cff4cd4d3ade P 9ba2c32bdd5d48ffa03bcecbe8bbb089 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 15:34:52.852923 1501 raft_consensus.cc:482] T 5c2310e54c11474a87e9cff4cd4d3ade P 9ba2c32bdd5d48ffa03bcecbe8bbb089 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 15:34:52.852967 1501 raft_consensus.cc:3037] T 5c2310e54c11474a87e9cff4cd4d3ade P 9ba2c32bdd5d48ffa03bcecbe8bbb089 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:34:52.853929 1501 raft_consensus.cc:504] T 5c2310e54c11474a87e9cff4cd4d3ade P 9ba2c32bdd5d48ffa03bcecbe8bbb089 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81d4681707ea408e8f171dfba571c0d3" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42147 } } peers { permanent_uuid: "c95b22fad87d4983a8bfb7dc59f59a04" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45493 } } peers { permanent_uuid: "9ba2c32bdd5d48ffa03bcecbe8bbb089" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 40645 } }
I20260809 15:34:52.854239 1501 leader_election.cc:288] T 5c2310e54c11474a87e9cff4cd4d3ade P 9ba2c32bdd5d48ffa03bcecbe8bbb089 [CANDIDATE]: Term 1 election: Requested vote from peers 81d4681707ea408e8f171dfba571c0d3 (127.11.146.3:42147), c95b22fad87d4983a8bfb7dc59f59a04 (127.11.146.1:45493)
I20260809 15:34:52.854517 1427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c2310e54c11474a87e9cff4cd4d3ade" candidate_uuid: "9ba2c32bdd5d48ffa03bcecbe8bbb089" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81d4681707ea408e8f171dfba571c0d3"
I20260809 15:34:52.854566 1140 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c2310e54c11474a87e9cff4cd4d3ade" candidate_uuid: "9ba2c32bdd5d48ffa03bcecbe8bbb089" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95b22fad87d4983a8bfb7dc59f59a04"
I20260809 15:34:52.854638 1427 raft_consensus.cc:3037] T 5c2310e54c11474a87e9cff4cd4d3ade P 81d4681707ea408e8f171dfba571c0d3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:34:52.854698 1140 raft_consensus.cc:3037] T 5c2310e54c11474a87e9cff4cd4d3ade P c95b22fad87d4983a8bfb7dc59f59a04 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:34:52.855615 1140 raft_consensus.cc:2454] T 5c2310e54c11474a87e9cff4cd4d3ade P c95b22fad87d4983a8bfb7dc59f59a04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba2c32bdd5d48ffa03bcecbe8bbb089 in term 1.
I20260809 15:34:52.855619 1427 raft_consensus.cc:2454] T 5c2310e54c11474a87e9cff4cd4d3ade P 81d4681707ea408e8f171dfba571c0d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba2c32bdd5d48ffa03bcecbe8bbb089 in term 1.
I20260809 15:34:52.855903 1210 leader_election.cc:302] T 5c2310e54c11474a87e9cff4cd4d3ade P 9ba2c32bdd5d48ffa03bcecbe8bbb089 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ba2c32bdd5d48ffa03bcecbe8bbb089, c95b22fad87d4983a8bfb7dc59f59a04; no voters:
I20260809 15:34:52.856091 1501 raft_consensus.cc:2781] T 5c2310e54c11474a87e9cff4cd4d3ade P 9ba2c32bdd5d48ffa03bcecbe8bbb089 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:34:52.856312 1501 raft_consensus.cc:686] T 5c2310e54c11474a87e9cff4cd4d3ade P 9ba2c32bdd5d48ffa03bcecbe8bbb089 [term 1 LEADER]: Becoming Leader. State: Replica: 9ba2c32bdd5d48ffa03bcecbe8bbb089, State: Running, Role: LEADER
I20260809 15:34:52.856644 1501 consensus_queue.cc:237] T 5c2310e54c11474a87e9cff4cd4d3ade P 9ba2c32bdd5d48ffa03bcecbe8bbb089 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81d4681707ea408e8f171dfba571c0d3" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42147 } } peers { permanent_uuid: "c95b22fad87d4983a8bfb7dc59f59a04" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45493 } } peers { permanent_uuid: "9ba2c32bdd5d48ffa03bcecbe8bbb089" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 40645 } }
I20260809 15:34:52.859622 977 catalog_manager.cc:5495] T 5c2310e54c11474a87e9cff4cd4d3ade P 9ba2c32bdd5d48ffa03bcecbe8bbb089 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ba2c32bdd5d48ffa03bcecbe8bbb089 (127.11.146.2). New cstate: current_term: 1 leader_uuid: "9ba2c32bdd5d48ffa03bcecbe8bbb089" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81d4681707ea408e8f171dfba571c0d3" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95b22fad87d4983a8bfb7dc59f59a04" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba2c32bdd5d48ffa03bcecbe8bbb089" member_type: VOTER last_known_addr { host: "127.11.146.2" port: 40645 } health_report { overall_health: HEALTHY } } }
I20260809 15:34:52.935541 1494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:52.931965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58504 (local address 127.11.146.2:40645)
0809 15:34:52.932114 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:52.932118 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:52.932132 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:34:52.932256 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:52.932258 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:52.932309 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:52.932409 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:34:52.932634 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.933096 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.934097 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:52.934293 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:52.934391 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:52.934698 (+ 307us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:34:52.935176 (+ 478us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:34:52.935299 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:52.935356 (+ 57us) server_negotiation.cc:299] Negotiation successful
0809 15:34:52.935405 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 15:34:52.941185 1140 raft_consensus.cc:1261] T 5c2310e54c11474a87e9cff4cd4d3ade P c95b22fad87d4983a8bfb7dc59f59a04 [term 1 FOLLOWER]: Refusing update from remote peer 9ba2c32bdd5d48ffa03bcecbe8bbb089: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:34:52.941185 1427 raft_consensus.cc:1261] T 5c2310e54c11474a87e9cff4cd4d3ade P 81d4681707ea408e8f171dfba571c0d3 [term 1 FOLLOWER]: Refusing update from remote peer 9ba2c32bdd5d48ffa03bcecbe8bbb089: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:34:52.941864 1506 consensus_queue.cc:1035] T 5c2310e54c11474a87e9cff4cd4d3ade P 9ba2c32bdd5d48ffa03bcecbe8bbb089 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81d4681707ea408e8f171dfba571c0d3" member_type: VOTER last_known_addr { host: "127.11.146.3" port: 42147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:34:52.942051 1501 consensus_queue.cc:1035] T 5c2310e54c11474a87e9cff4cd4d3ade P 9ba2c32bdd5d48ffa03bcecbe8bbb089 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95b22fad87d4983a8bfb7dc59f59a04" member_type: VOTER last_known_addr { host: "127.11.146.1" port: 45493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:34:52.951617 1513 mvcc.cc:205] Tried to move back new op lower bound from 7316642582280024064 to 7316642581943341056. Current Snapshot: MvccSnapshot[applied={T|T < 7316642582280024064 or (T in {7316642582280024064})}]
I20260809 15:34:52.958824 977 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57020:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:34:52.958981 977 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57020:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 15:34:52.961210 977 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5bcc53bc16554d7594ae13f89f0ef392: Sending DeleteTablet for 3 replicas of tablet 5c2310e54c11474a87e9cff4cd4d3ade
I20260809 15:34:52.961910 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c2310e54c11474a87e9cff4cd4d3ade with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:34:52 UTC) from {username='slave'} at 127.0.0.1:35916
I20260809 15:34:52.961949 1117 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c2310e54c11474a87e9cff4cd4d3ade with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:34:52 UTC) from {username='slave'} at 127.0.0.1:44522
I20260809 15:34:52.962059 1263 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c2310e54c11474a87e9cff4cd4d3ade with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 15:34:52 UTC) from {username='slave'} at 127.0.0.1:58500
I20260809 15:34:52.962356 1521 tablet_replica.cc:330] T 5c2310e54c11474a87e9cff4cd4d3ade P 81d4681707ea408e8f171dfba571c0d3: stopping tablet replica
I20260809 15:34:52.962639 1521 raft_consensus.cc:2229] T 5c2310e54c11474a87e9cff4cd4d3ade P 81d4681707ea408e8f171dfba571c0d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 15:34:52.962839 1522 tablet_replica.cc:330] T 5c2310e54c11474a87e9cff4cd4d3ade P c95b22fad87d4983a8bfb7dc59f59a04: stopping tablet replica
I20260809 15:34:52.962924 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 1047
I20260809 15:34:52.964021 1523 tablet_replica.cc:330] T 5c2310e54c11474a87e9cff4cd4d3ade P 9ba2c32bdd5d48ffa03bcecbe8bbb089: stopping tablet replica
I20260809 15:34:52.964375 1523 raft_consensus.cc:2229] T 5c2310e54c11474a87e9cff4cd4d3ade P 9ba2c32bdd5d48ffa03bcecbe8bbb089 [term 1 LEADER]: Raft consensus shutting down.
I20260809 15:34:52.964833 1523 raft_consensus.cc:2258] T 5c2310e54c11474a87e9cff4cd4d3ade P 9ba2c32bdd5d48ffa03bcecbe8bbb089 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:34:52.965019 1521 raft_consensus.cc:2258] T 5c2310e54c11474a87e9cff4cd4d3ade P 81d4681707ea408e8f171dfba571c0d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 15:34:52.968050 1521 ts_tablet_manager.cc:1905] T 5c2310e54c11474a87e9cff4cd4d3ade P 81d4681707ea408e8f171dfba571c0d3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:34:52.970371 1521 ts_tablet_manager.cc:1918] T 5c2310e54c11474a87e9cff4cd4d3ade P 81d4681707ea408e8f171dfba571c0d3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:34:52.970431 1521 log.cc:1196] T 5c2310e54c11474a87e9cff4cd4d3ade P 81d4681707ea408e8f171dfba571c0d3: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-2/wal/wals/5c2310e54c11474a87e9cff4cd4d3ade
I20260809 15:34:52.970647 1521 ts_tablet_manager.cc:1939] T 5c2310e54c11474a87e9cff4cd4d3ade P 81d4681707ea408e8f171dfba571c0d3: Deleting consensus metadata
I20260809 15:34:52.971634 1523 ts_tablet_manager.cc:1905] T 5c2310e54c11474a87e9cff4cd4d3ade P 9ba2c32bdd5d48ffa03bcecbe8bbb089: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 15:34:52.973567 1523 ts_tablet_manager.cc:1918] T 5c2310e54c11474a87e9cff4cd4d3ade P 9ba2c32bdd5d48ffa03bcecbe8bbb089: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 15:34:52.973664 1523 log.cc:1196] T 5c2310e54c11474a87e9cff4cd4d3ade P 9ba2c32bdd5d48ffa03bcecbe8bbb089: Deleting WAL directory at /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786289437399694-11848-0/minicluster-data/ts-1/wal/wals/5c2310e54c11474a87e9cff4cd4d3ade
I20260809 15:34:52.973991 1523 ts_tablet_manager.cc:1939] T 5c2310e54c11474a87e9cff4cd4d3ade P 9ba2c32bdd5d48ffa03bcecbe8bbb089: Deleting consensus metadata
W20260809 15:34:52.974020 964 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.146.1:45493 (error 108)
I20260809 15:34:52.974242 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 1191
I20260809 15:34:52.975244 1490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:52.974900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.1:45493 (local address 127.0.0.1:44528)
0809 15:34:52.975065 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:52.975135 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.1:45493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260809 15:34:52.975324 961 catalog_manager.cc:4841] TS 81d4681707ea408e8f171dfba571c0d3 (127.11.146.3:42147): tablet 5c2310e54c11474a87e9cff4cd4d3ade (table test-table [id=50bf2d01efdb4341a714887eb3bd743b]) successfully deleted
W20260809 15:34:52.975487 964 catalog_manager.cc:4584] TS c95b22fad87d4983a8bfb7dc59f59a04 (127.11.146.1:45493): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5c2310e54c11474a87e9cff4cd4d3ade: Network error: Client connection negotiation failed: client connection to 127.11.146.1:45493: connect: Connection refused (error 111)
I20260809 15:34:52.980549 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 1337
I20260809 15:34:52.981539 1490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:52.980667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.2:40645 (local address 127.0.0.1:58514)
0809 15:34:52.981405 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0809 15:34:52.981459 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.2:40645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":658}
I20260809 15:34:52.987620 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 943
2026-08-09T15:34:52Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1386 ms)
[----------] 6 tests from EncryptionPolicyTest (10304 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:34:53 dist-test-slave-1jjb krb5kdc[1527](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:34:53 dist-test-slave-1jjb krb5kdc[1527](info): set up 2 sockets
Aug 09 15:34:53 dist-test-slave-1jjb krb5kdc[1527](info): commencing operation
krb5kdc: starting...
W20260809 15:34:54.048578 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.038s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:34:54 dist-test-slave-1jjb krb5kdc[1527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289694, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:34:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:34:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 15:34:54.167213 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36093
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36093
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:34:54.271935 1542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:54.272193 1542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:54.272269 1542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:54.275991 1542 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:34:54.276070 1542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:54.276124 1542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:54.276186 1542 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:34:54.276221 1542 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:34:54.281024 1542 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36093
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36093
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1542
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:54.281873 1542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:54.282792 1542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:34:54.290861 1547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:54.290889 1548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:54.291049 1542 server_base.cc:1034] running on GCE node
W20260809 15:34:54.290899 1551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:54.291726 1542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:54.292791 1542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:54.293974 1542 hybrid_clock.cc:648] HybridClock initialized: now 1786289694293954 us; error 41 us; skew 500 ppm
Aug 09 15:34:54 dist-test-slave-1jjb krb5kdc[1527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289694, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:34:54.301355 1542 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 15:34:54.302258 1542 webserver.cc:460] Webserver started at http://127.0.0.1:33435/ using document root <none> and password file <none>
I20260809 15:34:54.302803 1542 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:54.302899 1542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:54.303146 1542 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:34:54.305115 1542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "f6eb929c63da4859a9ce953c73efc92a"
format_stamp: "Formatted at 2026-08-09 15:34:54 on dist-test-slave-1jjb"
server_key: "5f6c882123c712cc0acd52b37572d518"
server_key_iv: "655e4b317c4bbdefba9f1fecad086076"
server_key_version: "encryptionkey@0"
I20260809 15:34:54.305655 1542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "f6eb929c63da4859a9ce953c73efc92a"
format_stamp: "Formatted at 2026-08-09 15:34:54 on dist-test-slave-1jjb"
server_key: "5f6c882123c712cc0acd52b37572d518"
server_key_iv: "655e4b317c4bbdefba9f1fecad086076"
server_key_version: "encryptionkey@0"
I20260809 15:34:54.309170 1542 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260809 15:34:54.311538 1559 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:54.312709 1542 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 15:34:54.312845 1542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "f6eb929c63da4859a9ce953c73efc92a"
format_stamp: "Formatted at 2026-08-09 15:34:54 on dist-test-slave-1jjb"
server_key: "5f6c882123c712cc0acd52b37572d518"
server_key_iv: "655e4b317c4bbdefba9f1fecad086076"
server_key_version: "encryptionkey@0"
I20260809 15:34:54.312948 1542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:54.328531 1542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:54.331640 1542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:54.331836 1542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:54.338723 1542 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36093
I20260809 15:34:54.338733 1614 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36093 every 8 connection(s)
I20260809 15:34:54.339594 1542 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:34:54.342211 1615 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:34:54.342913 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 1542
I20260809 15:34:54.343010 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:34:54.343321 11848 external_mini_cluster.cc:1428] Setting key 7546a20b09ed38e620e778995f58ff32
I20260809 15:34:54.348013 1615 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6eb929c63da4859a9ce953c73efc92a: Bootstrap starting.
I20260809 15:34:54.350070 1615 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f6eb929c63da4859a9ce953c73efc92a: Neither blocks nor log segments found. Creating new log.
I20260809 15:34:54.350771 1615 log.cc:824] T 00000000000000000000000000000000 P f6eb929c63da4859a9ce953c73efc92a: Log is configured to *not* fsync() on all Append() calls
Aug 09 15:34:54 dist-test-slave-1jjb krb5kdc[1527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289694, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 15:34:54.352834 1615 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6eb929c63da4859a9ce953c73efc92a: No bootstrap required, opened a new log
I20260809 15:34:54.357074 1618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:54.344672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45643 (local address 127.0.0.1:36093)
0809 15:34:54.345087 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:54.345101 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:54.345134 (+ 33us) server_negotiation.cc:407] Connection header received
0809 15:34:54.345789 (+ 655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:54.345805 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:54.346089 (+ 284us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:54.346403 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:54.347183 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:54.348227 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:54.349074 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:54.349533 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:54.349710 (+ 177us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:54.352185 (+ 2475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:54.352191 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:54.352206 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:34:54.352235 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:54.354122 (+ 1887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:54.354599 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:54.354605 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:54.354610 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:54.354772 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:54.355071 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:54.355076 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:54.355078 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:54.355542 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:54.355732 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:54.355931 (+ 199us) server_negotiation.cc:299] Negotiation successful
0809 15:34:54.356182 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":136,"threads_started":1}
I20260809 15:34:54.357205 1615 raft_consensus.cc:348] T 00000000000000000000000000000000 P f6eb929c63da4859a9ce953c73efc92a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6eb929c63da4859a9ce953c73efc92a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36093 } }
I20260809 15:34:54.357451 1615 raft_consensus.cc:374] T 00000000000000000000000000000000 P f6eb929c63da4859a9ce953c73efc92a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:34:54.357510 1615 raft_consensus.cc:729] T 00000000000000000000000000000000 P f6eb929c63da4859a9ce953c73efc92a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eb929c63da4859a9ce953c73efc92a, State: Initialized, Role: FOLLOWER
I20260809 15:34:54.357946 1615 consensus_queue.cc:260] T 00000000000000000000000000000000 P f6eb929c63da4859a9ce953c73efc92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6eb929c63da4859a9ce953c73efc92a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36093 } }
I20260809 15:34:54.358106 1615 raft_consensus.cc:388] T 00000000000000000000000000000000 P f6eb929c63da4859a9ce953c73efc92a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:34:54.358176 1615 raft_consensus.cc:482] T 00000000000000000000000000000000 P f6eb929c63da4859a9ce953c73efc92a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:34:54.358269 1615 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f6eb929c63da4859a9ce953c73efc92a [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:34:54.359247 1615 raft_consensus.cc:504] T 00000000000000000000000000000000 P f6eb929c63da4859a9ce953c73efc92a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6eb929c63da4859a9ce953c73efc92a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36093 } }
I20260809 15:34:54.359607 1615 leader_election.cc:302] T 00000000000000000000000000000000 P f6eb929c63da4859a9ce953c73efc92a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f6eb929c63da4859a9ce953c73efc92a; no voters:
I20260809 15:34:54.360040 1615 leader_election.cc:288] T 00000000000000000000000000000000 P f6eb929c63da4859a9ce953c73efc92a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:34:54.360163 11848 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:34:54.360165 1620 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f6eb929c63da4859a9ce953c73efc92a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:34:54.360392 1620 raft_consensus.cc:686] T 00000000000000000000000000000000 P f6eb929c63da4859a9ce953c73efc92a [term 1 LEADER]: Becoming Leader. State: Replica: f6eb929c63da4859a9ce953c73efc92a, State: Running, Role: LEADER
I20260809 15:34:54.360725 1620 consensus_queue.cc:237] T 00000000000000000000000000000000 P f6eb929c63da4859a9ce953c73efc92a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6eb929c63da4859a9ce953c73efc92a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36093 } }
I20260809 15:34:54.361275 1615 sys_catalog.cc:564] T 00000000000000000000000000000000 P f6eb929c63da4859a9ce953c73efc92a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:34:54.362370 1621 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6eb929c63da4859a9ce953c73efc92a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f6eb929c63da4859a9ce953c73efc92a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6eb929c63da4859a9ce953c73efc92a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36093 } } }
I20260809 15:34:54.362413 1622 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6eb929c63da4859a9ce953c73efc92a [sys.catalog]: SysCatalogTable state changed. Reason: New leader f6eb929c63da4859a9ce953c73efc92a. Latest consensus state: current_term: 1 leader_uuid: "f6eb929c63da4859a9ce953c73efc92a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6eb929c63da4859a9ce953c73efc92a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36093 } } }
I20260809 15:34:54.362479 1621 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6eb929c63da4859a9ce953c73efc92a [sys.catalog]: This master's current role is: LEADER
I20260809 15:34:54.362506 1622 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6eb929c63da4859a9ce953c73efc92a [sys.catalog]: This master's current role is: LEADER
I20260809 15:34:54.362922 1630 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:34:54.366096 1630 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:34:54.371460 1618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:54.362241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40527 (local address 127.0.0.1:36093)
0809 15:34:54.362343 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:54.362347 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:54.362596 (+ 249us) server_negotiation.cc:407] Connection header received
0809 15:34:54.362762 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:54.362765 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:54.362826 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:54.362875 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:54.363795 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:54.364509 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:54.365599 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:54.365894 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:54.365966 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:54.367733 (+ 1767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:54.367737 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:54.367740 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:34:54.367766 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:54.369464 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:54.370085 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:54.370089 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:54.370090 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:54.370189 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:54.370598 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:54.370603 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:54.370608 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:54.370794 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:54.370955 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:54.371220 (+ 265us) server_negotiation.cc:299] Negotiation successful
0809 15:34:54.371315 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 15:34:54.372831 1630 catalog_manager.cc:1347] Generated new cluster ID: 0d3bc16fb373465683d866d9f8cc8094
I20260809 15:34:54.372900 1630 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:34:54.388010 1630 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:34:54.389086 1630 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:34:54.395561 1630 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f6eb929c63da4859a9ce953c73efc92a: Generated new TSK 0
I20260809 15:34:54.396307 1630 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:34:54.404620 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 1542
W20260809 15:34:54.414099 1525 connection.cc:535] client connection to 127.0.0.1:36093 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36093): Connection reset by peer (error 104)
2026-08-09T15:34:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1417 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:34:54 dist-test-slave-1jjb krb5kdc[1647](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:34:54 dist-test-slave-1jjb krb5kdc[1647](info): set up 2 sockets
Aug 09 15:34:54 dist-test-slave-1jjb krb5kdc[1647](info): commencing operation
krb5kdc: starting...
W20260809 15:34:55.464250 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.036s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:34:55 dist-test-slave-1jjb krb5kdc[1647](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289695, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:34:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:34:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 15:34:55.586297 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43043
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43043
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:34:55.703064 1660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:55.703264 1660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:55.703299 1660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:55.706986 1660 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:34:55.707037 1660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:55.707056 1660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:55.707072 1660 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:34:55.707087 1660 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:34:55.712116 1660 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43043
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43043
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1660
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:55.712967 1660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:55.713805 1660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:34:55.721683 1667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:55.721691 1666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:55.721698 1670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:55.721971 1660 server_base.cc:1034] running on GCE node
I20260809 15:34:55.722553 1660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:55.723481 1660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:55.724632 1660 hybrid_clock.cc:648] HybridClock initialized: now 1786289695724609 us; error 40 us; skew 500 ppm
Aug 09 15:34:55 dist-test-slave-1jjb krb5kdc[1647](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289695, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:34:55.727164 1660 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 15:34:55.727969 1660 webserver.cc:460] Webserver started at http://127.0.0.1:36657/ using document root <none> and password file <none>
I20260809 15:34:55.728502 1660 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:55.728562 1660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:55.728724 1660 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:34:55.730583 1660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "c2204b87afef47748340fbcafbf083b4"
format_stamp: "Formatted at 2026-08-09 15:34:55 on dist-test-slave-1jjb"
server_key: "d7b57ee68261476fce92757a9d19122b"
server_key_iv: "e76ead0c2268bf13acabe25e040641fa"
server_key_version: "encryptionkey@0"
I20260809 15:34:55.731061 1660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "c2204b87afef47748340fbcafbf083b4"
format_stamp: "Formatted at 2026-08-09 15:34:55 on dist-test-slave-1jjb"
server_key: "d7b57ee68261476fce92757a9d19122b"
server_key_iv: "e76ead0c2268bf13acabe25e040641fa"
server_key_version: "encryptionkey@0"
I20260809 15:34:55.734459 1660 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 15:34:55.736616 1677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:55.737739 1660 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:34:55.737874 1660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "c2204b87afef47748340fbcafbf083b4"
format_stamp: "Formatted at 2026-08-09 15:34:55 on dist-test-slave-1jjb"
server_key: "d7b57ee68261476fce92757a9d19122b"
server_key_iv: "e76ead0c2268bf13acabe25e040641fa"
server_key_version: "encryptionkey@0"
I20260809 15:34:55.737968 1660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:55.753222 1660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:55.755801 1660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:55.755998 1660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:55.762775 1660 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43043
I20260809 15:34:55.762801 1733 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43043 every 8 connection(s)
I20260809 15:34:55.763623 1660 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:34:55.765981 1734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:34:55.771055 1734 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2204b87afef47748340fbcafbf083b4: Bootstrap starting.
I20260809 15:34:55.772298 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 1660
I20260809 15:34:55.772423 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:34:55.772711 11848 external_mini_cluster.cc:1428] Setting key fd9f54cca84b6d45e4b85f50b7333801
I20260809 15:34:55.773502 1734 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c2204b87afef47748340fbcafbf083b4: Neither blocks nor log segments found. Creating new log.
I20260809 15:34:55.774304 1734 log.cc:824] T 00000000000000000000000000000000 P c2204b87afef47748340fbcafbf083b4: Log is configured to *not* fsync() on all Append() calls
I20260809 15:34:55.775985 1734 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2204b87afef47748340fbcafbf083b4: No bootstrap required, opened a new log
I20260809 15:34:55.778699 1734 raft_consensus.cc:348] T 00000000000000000000000000000000 P c2204b87afef47748340fbcafbf083b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2204b87afef47748340fbcafbf083b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43043 } }
I20260809 15:34:55.778910 1734 raft_consensus.cc:374] T 00000000000000000000000000000000 P c2204b87afef47748340fbcafbf083b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:34:55.779033 1734 raft_consensus.cc:729] T 00000000000000000000000000000000 P c2204b87afef47748340fbcafbf083b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2204b87afef47748340fbcafbf083b4, State: Initialized, Role: FOLLOWER
I20260809 15:34:55.779541 1734 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2204b87afef47748340fbcafbf083b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2204b87afef47748340fbcafbf083b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43043 } }
I20260809 15:34:55.779693 1734 raft_consensus.cc:388] T 00000000000000000000000000000000 P c2204b87afef47748340fbcafbf083b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:34:55.779753 1734 raft_consensus.cc:482] T 00000000000000000000000000000000 P c2204b87afef47748340fbcafbf083b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:34:55.779837 1734 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c2204b87afef47748340fbcafbf083b4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:34:55.780822 1734 raft_consensus.cc:504] T 00000000000000000000000000000000 P c2204b87afef47748340fbcafbf083b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2204b87afef47748340fbcafbf083b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43043 } }
I20260809 15:34:55.781158 1734 leader_election.cc:302] T 00000000000000000000000000000000 P c2204b87afef47748340fbcafbf083b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c2204b87afef47748340fbcafbf083b4; no voters:
I20260809 15:34:55.781325 1738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:55.773705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57433 (local address 127.0.0.1:43043)
0809 15:34:55.774100 (+ 395us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:55.774113 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:55.774144 (+ 31us) server_negotiation.cc:407] Connection header received
0809 15:34:55.774775 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:55.774791 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:55.775072 (+ 281us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:55.775406 (+ 334us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:55.775788 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:55.776763 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:55.777640 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:55.778539 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:55.778725 (+ 186us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:55.779545 (+ 820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:55.779549 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:55.779560 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:34:55.780006 (+ 446us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:55.780047 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:34:55.780067 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:55.780231 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:55.780467 (+ 236us) server_negotiation.cc:299] Negotiation successful
0809 15:34:55.780596 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":109,"threads_started":1}
I20260809 15:34:55.781464 1734 leader_election.cc:288] T 00000000000000000000000000000000 P c2204b87afef47748340fbcafbf083b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:34:55.781694 1740 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c2204b87afef47748340fbcafbf083b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:34:55.781962 1740 raft_consensus.cc:686] T 00000000000000000000000000000000 P c2204b87afef47748340fbcafbf083b4 [term 1 LEADER]: Becoming Leader. State: Replica: c2204b87afef47748340fbcafbf083b4, State: Running, Role: LEADER
I20260809 15:34:55.782253 1740 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2204b87afef47748340fbcafbf083b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2204b87afef47748340fbcafbf083b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43043 } }
I20260809 15:34:55.782620 1734 sys_catalog.cc:564] T 00000000000000000000000000000000 P c2204b87afef47748340fbcafbf083b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:34:55.783372 1740 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2204b87afef47748340fbcafbf083b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2204b87afef47748340fbcafbf083b4. Latest consensus state: current_term: 1 leader_uuid: "c2204b87afef47748340fbcafbf083b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2204b87afef47748340fbcafbf083b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43043 } } }
I20260809 15:34:55.784112 1740 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2204b87afef47748340fbcafbf083b4 [sys.catalog]: This master's current role is: LEADER
I20260809 15:34:55.783972 1741 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2204b87afef47748340fbcafbf083b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c2204b87afef47748340fbcafbf083b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2204b87afef47748340fbcafbf083b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43043 } } }
I20260809 15:34:55.784452 1741 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2204b87afef47748340fbcafbf083b4 [sys.catalog]: This master's current role is: LEADER
I20260809 15:34:55.784482 11848 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260809 15:34:55.787781 1756 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c2204b87afef47748340fbcafbf083b4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:34:55.787866 1756 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:34:55.787981 1753 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:34:55.788856 1753 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:34:55.791117 1738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:55.786624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51319 (local address 127.0.0.1:43043)
0809 15:34:55.786710 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:55.786715 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:55.786958 (+ 243us) server_negotiation.cc:407] Connection header received
0809 15:34:55.787061 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:55.787064 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:55.787109 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:55.787189 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:55.787510 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:55.788266 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:55.789374 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:55.789740 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:55.789843 (+ 103us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:55.790679 (+ 836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:55.790682 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:55.790684 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:34:55.790698 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:55.790725 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:34:55.790735 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:55.790827 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:55.790946 (+ 119us) server_negotiation.cc:299] Negotiation successful
0809 15:34:55.790977 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 15:34:55.794497 1753 catalog_manager.cc:1347] Generated new cluster ID: 2127f4be368a47bf9c841269fbf1bc1a
I20260809 15:34:55.794556 1753 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:34:55.807149 1753 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:34:55.807982 1753 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:34:55.814153 1753 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c2204b87afef47748340fbcafbf083b4: Generated new TSK 0
I20260809 15:34:55.814858 1753 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:34:55.820142 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 1660
W20260809 15:34:55.830049 1645 connection.cc:535] client connection to 127.0.0.1:43043 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43043): Connection reset by peer (error 104)
2026-08-09T15:34:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1415 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:34:55 dist-test-slave-1jjb krb5kdc[1769](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:34:55 dist-test-slave-1jjb krb5kdc[1769](info): set up 2 sockets
Aug 09 15:34:55 dist-test-slave-1jjb krb5kdc[1769](info): commencing operation
krb5kdc: starting...
W20260809 15:34:56.951633 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.108s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:34:57 dist-test-slave-1jjb krb5kdc[1769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289697, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:34:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:34:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 15:34:57.070905 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36703
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36703
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:34:57.177915 1782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:57.178138 1782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:57.178177 1782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:57.182008 1782 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:34:57.182053 1782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:57.182071 1782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:57.182086 1782 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:34:57.182101 1782 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:34:57.186888 1782 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36703
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36703
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1782
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:57.187788 1782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:57.188772 1782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:34:57.196893 1787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:57.196930 1789 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:57.197012 1782 server_base.cc:1034] running on GCE node
W20260809 15:34:57.196905 1792 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:57.197691 1782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:57.198679 1782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:57.199867 1782 hybrid_clock.cc:648] HybridClock initialized: now 1786289697199857 us; error 29 us; skew 500 ppm
Aug 09 15:34:57 dist-test-slave-1jjb krb5kdc[1769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289697, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:34:57.202639 1782 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 15:34:57.203405 1782 webserver.cc:460] Webserver started at http://127.0.0.1:46383/ using document root <none> and password file <none>
I20260809 15:34:57.203917 1782 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:57.203974 1782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:57.204195 1782 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:34:57.206166 1782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "202d29a6ea6041b8996bb21e024fbb03"
format_stamp: "Formatted at 2026-08-09 15:34:57 on dist-test-slave-1jjb"
server_key: "8ff7dd7fa13530c3740ade0055a0312e"
server_key_iv: "57fe81332316a9f2001038f184f2ab23"
server_key_version: "encryptionkey@0"
I20260809 15:34:57.206648 1782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "202d29a6ea6041b8996bb21e024fbb03"
format_stamp: "Formatted at 2026-08-09 15:34:57 on dist-test-slave-1jjb"
server_key: "8ff7dd7fa13530c3740ade0055a0312e"
server_key_iv: "57fe81332316a9f2001038f184f2ab23"
server_key_version: "encryptionkey@0"
I20260809 15:34:57.210116 1782 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 15:34:57.212284 1799 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:57.213438 1782 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:34:57.213574 1782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "202d29a6ea6041b8996bb21e024fbb03"
format_stamp: "Formatted at 2026-08-09 15:34:57 on dist-test-slave-1jjb"
server_key: "8ff7dd7fa13530c3740ade0055a0312e"
server_key_iv: "57fe81332316a9f2001038f184f2ab23"
server_key_version: "encryptionkey@0"
I20260809 15:34:57.213666 1782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:57.218111 1782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:57.221155 1782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:57.221338 1782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:57.228454 1782 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36703
I20260809 15:34:57.228492 1860 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36703 every 8 connection(s)
I20260809 15:34:57.229296 1782 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:34:57.231732 1861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:34:57.236575 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 1782
I20260809 15:34:57.236704 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:34:57.236865 1861 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 202d29a6ea6041b8996bb21e024fbb03: Bootstrap starting.
I20260809 15:34:57.237000 11848 external_mini_cluster.cc:1428] Setting key a5ddf7558b1f1ae95e20f42a7f8a1b04
I20260809 15:34:57.239374 1861 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 202d29a6ea6041b8996bb21e024fbb03: Neither blocks nor log segments found. Creating new log.
I20260809 15:34:57.240198 1861 log.cc:824] T 00000000000000000000000000000000 P 202d29a6ea6041b8996bb21e024fbb03: Log is configured to *not* fsync() on all Append() calls
I20260809 15:34:57.242192 1864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:57.238244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36007 (local address 127.0.0.1:36703)
0809 15:34:57.238688 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:57.238705 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:57.238743 (+ 38us) server_negotiation.cc:407] Connection header received
0809 15:34:57.239515 (+ 772us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:57.239537 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:57.239851 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:57.240207 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:57.240908 (+ 701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:57.240914 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:57.240927 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:34:57.240939 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:57.240994 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:34:57.241021 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:57.241149 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:57.241277 (+ 128us) server_negotiation.cc:299] Negotiation successful
0809 15:34:57.241402 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":287,"thread_start_us":116,"threads_started":1}
I20260809 15:34:57.242280 1861 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 202d29a6ea6041b8996bb21e024fbb03: No bootstrap required, opened a new log
I20260809 15:34:57.244949 11848 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:34:57.246236 1861 raft_consensus.cc:348] T 00000000000000000000000000000000 P 202d29a6ea6041b8996bb21e024fbb03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "202d29a6ea6041b8996bb21e024fbb03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36703 } }
I20260809 15:34:57.246423 1861 raft_consensus.cc:374] T 00000000000000000000000000000000 P 202d29a6ea6041b8996bb21e024fbb03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:34:57.246491 1861 raft_consensus.cc:729] T 00000000000000000000000000000000 P 202d29a6ea6041b8996bb21e024fbb03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 202d29a6ea6041b8996bb21e024fbb03, State: Initialized, Role: FOLLOWER
I20260809 15:34:57.246958 1861 consensus_queue.cc:260] T 00000000000000000000000000000000 P 202d29a6ea6041b8996bb21e024fbb03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "202d29a6ea6041b8996bb21e024fbb03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36703 } }
I20260809 15:34:57.247128 1861 raft_consensus.cc:388] T 00000000000000000000000000000000 P 202d29a6ea6041b8996bb21e024fbb03 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:34:57.247196 1861 raft_consensus.cc:482] T 00000000000000000000000000000000 P 202d29a6ea6041b8996bb21e024fbb03 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:34:57.247287 1861 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 202d29a6ea6041b8996bb21e024fbb03 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:34:57.248284 1861 raft_consensus.cc:504] T 00000000000000000000000000000000 P 202d29a6ea6041b8996bb21e024fbb03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "202d29a6ea6041b8996bb21e024fbb03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36703 } }
I20260809 15:34:57.248634 1861 leader_election.cc:302] T 00000000000000000000000000000000 P 202d29a6ea6041b8996bb21e024fbb03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 202d29a6ea6041b8996bb21e024fbb03; no voters:
I20260809 15:34:57.248726 1864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:57.246955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47415 (local address 127.0.0.1:36703)
0809 15:34:57.247070 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:57.247075 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:57.247290 (+ 215us) server_negotiation.cc:407] Connection header received
0809 15:34:57.247469 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:57.247475 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:57.247521 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:57.247636 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:57.248294 (+ 658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:57.248301 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:57.248303 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:34:57.248316 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:57.248341 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:34:57.248355 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:57.248445 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:57.248550 (+ 105us) server_negotiation.cc:299] Negotiation successful
0809 15:34:57.248585 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 15:34:57.248967 1861 leader_election.cc:288] T 00000000000000000000000000000000 P 202d29a6ea6041b8996bb21e024fbb03 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:34:57.249068 1872 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 202d29a6ea6041b8996bb21e024fbb03 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:34:57.249303 1872 raft_consensus.cc:686] T 00000000000000000000000000000000 P 202d29a6ea6041b8996bb21e024fbb03 [term 1 LEADER]: Becoming Leader. State: Replica: 202d29a6ea6041b8996bb21e024fbb03, State: Running, Role: LEADER
I20260809 15:34:57.249665 1872 consensus_queue.cc:237] T 00000000000000000000000000000000 P 202d29a6ea6041b8996bb21e024fbb03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "202d29a6ea6041b8996bb21e024fbb03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36703 } }
I20260809 15:34:57.250157 1861 sys_catalog.cc:564] T 00000000000000000000000000000000 P 202d29a6ea6041b8996bb21e024fbb03 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:34:57.250707 1872 sys_catalog.cc:455] T 00000000000000000000000000000000 P 202d29a6ea6041b8996bb21e024fbb03 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 202d29a6ea6041b8996bb21e024fbb03. Latest consensus state: current_term: 1 leader_uuid: "202d29a6ea6041b8996bb21e024fbb03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "202d29a6ea6041b8996bb21e024fbb03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36703 } } }
I20260809 15:34:57.250883 1872 sys_catalog.cc:458] T 00000000000000000000000000000000 P 202d29a6ea6041b8996bb21e024fbb03 [sys.catalog]: This master's current role is: LEADER
I20260809 15:34:57.251657 1874 sys_catalog.cc:455] T 00000000000000000000000000000000 P 202d29a6ea6041b8996bb21e024fbb03 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "202d29a6ea6041b8996bb21e024fbb03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "202d29a6ea6041b8996bb21e024fbb03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36703 } } }
I20260809 15:34:57.251791 1874 sys_catalog.cc:458] T 00000000000000000000000000000000 P 202d29a6ea6041b8996bb21e024fbb03 [sys.catalog]: This master's current role is: LEADER
W20260809 15:34:57.254470 1889 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 202d29a6ea6041b8996bb21e024fbb03: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:34:57.254554 1889 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:34:57.254662 1881 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:34:57.255358 1881 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:34:57.260941 1881 catalog_manager.cc:1347] Generated new cluster ID: a494bc4350f3445c951ee729caa9b931
I20260809 15:34:57.261009 1881 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:34:57.268628 1881 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:34:57.268919 1881 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:34:57.277913 1881 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 202d29a6ea6041b8996bb21e024fbb03: Generated new TSK 0
I20260809 15:34:57.278455 1881 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:34:57.288708 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 1782
2026-08-09T15:34:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1467 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:34:57 dist-test-slave-1jjb krb5kdc[1896](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:34:57 dist-test-slave-1jjb krb5kdc[1896](info): set up 2 sockets
Aug 09 15:34:57 dist-test-slave-1jjb krb5kdc[1896](info): commencing operation
krb5kdc: starting...
W20260809 15:34:58.348040 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.036s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:34:58 dist-test-slave-1jjb krb5kdc[1896](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289698, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:34:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:34:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 15:34:58.469380 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45491
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45491
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:34:58.576565 1910 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:34:58.576781 1910 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:34:58.576836 1910 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:34:58.580705 1910 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:34:58.580750 1910 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:34:58.580770 1910 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:34:58.580785 1910 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:34:58.580798 1910 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:34:58.585754 1910 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45491
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45491
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1910
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:34:58.586589 1910 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:34:58.587430 1910 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:34:58.595484 1915 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:58.595507 1918 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:34:58.595530 1916 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:34:58.595614 1910 server_base.cc:1034] running on GCE node
I20260809 15:34:58.596256 1910 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:34:58.597232 1910 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:34:58.598392 1910 hybrid_clock.cc:648] HybridClock initialized: now 1786289698598363 us; error 37 us; skew 500 ppm
Aug 09 15:34:58 dist-test-slave-1jjb krb5kdc[1896](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289698, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:34:58.601294 1910 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 15:34:58.602334 1910 webserver.cc:460] Webserver started at http://127.0.0.1:40857/ using document root <none> and password file <none>
I20260809 15:34:58.603005 1910 fs_manager.cc:359] Metadata directory not provided
I20260809 15:34:58.603093 1910 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:34:58.603332 1910 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:34:58.605441 1910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "9803e3100774402cb953c43d2a25c3b0"
format_stamp: "Formatted at 2026-08-09 15:34:58 on dist-test-slave-1jjb"
server_key: "9415ce0cf35256ad5d3cddacc5bbcc84"
server_key_iv: "ae525524049070b98aab4a51d313cd86"
server_key_version: "encryptionkey@0"
I20260809 15:34:58.605981 1910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "9803e3100774402cb953c43d2a25c3b0"
format_stamp: "Formatted at 2026-08-09 15:34:58 on dist-test-slave-1jjb"
server_key: "9415ce0cf35256ad5d3cddacc5bbcc84"
server_key_iv: "ae525524049070b98aab4a51d313cd86"
server_key_version: "encryptionkey@0"
I20260809 15:34:58.609503 1910 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 15:34:58.611829 1925 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:34:58.613018 1910 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:34:58.613171 1910 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "9803e3100774402cb953c43d2a25c3b0"
format_stamp: "Formatted at 2026-08-09 15:34:58 on dist-test-slave-1jjb"
server_key: "9415ce0cf35256ad5d3cddacc5bbcc84"
server_key_iv: "ae525524049070b98aab4a51d313cd86"
server_key_version: "encryptionkey@0"
I20260809 15:34:58.613271 1910 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:34:58.632406 1910 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:34:58.635001 1910 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:34:58.635215 1910 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:34:58.642117 1910 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45491
I20260809 15:34:58.642143 1983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45491 every 8 connection(s)
I20260809 15:34:58.643007 1910 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:34:58.645292 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 1910
I20260809 15:34:58.645411 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:34:58.645622 1984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:34:58.645689 11848 external_mini_cluster.cc:1428] Setting key be3fe426d9787c877716f786ef91e6ae
I20260809 15:34:58.651623 1984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9803e3100774402cb953c43d2a25c3b0: Bootstrap starting.
I20260809 15:34:58.654003 1984 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9803e3100774402cb953c43d2a25c3b0: Neither blocks nor log segments found. Creating new log.
Aug 09 15:34:58 dist-test-slave-1jjb krb5kdc[1896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289698, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 15:34:58.654906 1984 log.cc:824] T 00000000000000000000000000000000 P 9803e3100774402cb953c43d2a25c3b0: Log is configured to *not* fsync() on all Append() calls
I20260809 15:34:58.656740 1984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9803e3100774402cb953c43d2a25c3b0: No bootstrap required, opened a new log
I20260809 15:34:58.659418 1987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:58.646945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44069 (local address 127.0.0.1:45491)
0809 15:34:58.647369 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:58.647382 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:58.647435 (+ 53us) server_negotiation.cc:407] Connection header received
0809 15:34:58.648239 (+ 804us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:58.648257 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:58.648581 (+ 324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:58.648900 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:58.649736 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:58.650691 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:58.651512 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:58.652003 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:58.652202 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:58.654873 (+ 2671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:58.654878 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:58.654890 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:34:58.654915 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:58.656807 (+ 1892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:58.657258 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:58.657263 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:58.657269 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:58.657385 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:58.657677 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:58.657681 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:58.657683 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:58.658042 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:58.658237 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:58.658534 (+ 297us) server_negotiation.cc:299] Negotiation successful
0809 15:34:58.658797 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":141,"threads_started":1}
I20260809 15:34:58.660229 1984 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9803e3100774402cb953c43d2a25c3b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9803e3100774402cb953c43d2a25c3b0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45491 } }
I20260809 15:34:58.660439 1984 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9803e3100774402cb953c43d2a25c3b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:34:58.660514 1984 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9803e3100774402cb953c43d2a25c3b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9803e3100774402cb953c43d2a25c3b0, State: Initialized, Role: FOLLOWER
I20260809 15:34:58.660909 1984 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9803e3100774402cb953c43d2a25c3b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9803e3100774402cb953c43d2a25c3b0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45491 } }
I20260809 15:34:58.661032 1984 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9803e3100774402cb953c43d2a25c3b0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:34:58.661180 1984 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9803e3100774402cb953c43d2a25c3b0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:34:58.661293 1984 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9803e3100774402cb953c43d2a25c3b0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:34:58.662096 1984 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9803e3100774402cb953c43d2a25c3b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9803e3100774402cb953c43d2a25c3b0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45491 } }
I20260809 15:34:58.662197 11848 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:34:58.662438 1984 leader_election.cc:302] T 00000000000000000000000000000000 P 9803e3100774402cb953c43d2a25c3b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9803e3100774402cb953c43d2a25c3b0; no voters:
I20260809 15:34:58.662755 1984 leader_election.cc:288] T 00000000000000000000000000000000 P 9803e3100774402cb953c43d2a25c3b0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:34:58.662854 1989 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9803e3100774402cb953c43d2a25c3b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:34:58.663086 1989 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9803e3100774402cb953c43d2a25c3b0 [term 1 LEADER]: Becoming Leader. State: Replica: 9803e3100774402cb953c43d2a25c3b0, State: Running, Role: LEADER
I20260809 15:34:58.663400 1989 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9803e3100774402cb953c43d2a25c3b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9803e3100774402cb953c43d2a25c3b0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45491 } }
I20260809 15:34:58.664043 1984 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9803e3100774402cb953c43d2a25c3b0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:34:58.665045 1991 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9803e3100774402cb953c43d2a25c3b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9803e3100774402cb953c43d2a25c3b0. Latest consensus state: current_term: 1 leader_uuid: "9803e3100774402cb953c43d2a25c3b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9803e3100774402cb953c43d2a25c3b0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45491 } } }
I20260809 15:34:58.665197 1991 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9803e3100774402cb953c43d2a25c3b0 [sys.catalog]: This master's current role is: LEADER
I20260809 15:34:58.665624 2004 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:34:58.665571 1990 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9803e3100774402cb953c43d2a25c3b0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9803e3100774402cb953c43d2a25c3b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9803e3100774402cb953c43d2a25c3b0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45491 } } }
I20260809 15:34:58.665684 1990 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9803e3100774402cb953c43d2a25c3b0 [sys.catalog]: This master's current role is: LEADER
I20260809 15:34:58.668694 2004 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:34:58.673012 1987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:34:58.664415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35007 (local address 127.0.0.1:45491)
0809 15:34:58.664544 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 15:34:58.664548 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:34:58.664828 (+ 280us) server_negotiation.cc:407] Connection header received
0809 15:34:58.664982 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:34:58.664986 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:34:58.665048 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:34:58.665134 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:34:58.666099 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:58.666815 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:58.667902 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:34:58.668229 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:34:58.668340 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:34:58.669653 (+ 1313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:34:58.669656 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:34:58.669659 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:34:58.669683 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:34:58.671099 (+ 1416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:58.671483 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:58.671486 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:58.671488 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:58.671569 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:34:58.671837 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:34:58.671840 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:34:58.671841 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:34:58.672019 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:34:58.672173 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 15:34:58.672405 (+ 232us) server_negotiation.cc:299] Negotiation successful
0809 15:34:58.672521 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 15:34:58.674467 2004 catalog_manager.cc:1347] Generated new cluster ID: c9c3dae1b82149a690e8769f32ba8f3e
I20260809 15:34:58.674526 2004 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:34:58.692437 2004 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:34:58.693362 2004 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:34:58.702246 2004 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9803e3100774402cb953c43d2a25c3b0: Generated new TSK 0
I20260809 15:34:58.702951 2004 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:34:58.716970 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 1910
2026-08-09T15:34:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1428 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:34:58 dist-test-slave-1jjb krb5kdc[2017](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:34:58 dist-test-slave-1jjb krb5kdc[2017](info): set up 2 sockets
Aug 09 15:34:58 dist-test-slave-1jjb krb5kdc[2017](info): commencing operation
krb5kdc: starting...
W20260809 15:34:59.787717 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.047s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:34:59 dist-test-slave-1jjb krb5kdc[2017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:34:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:34:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 15:34:59.906970 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32937
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32937
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:35:00.017309 2031 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:35:00.017584 2031 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:35:00.017665 2031 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:35:00.021629 2031 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:35:00.021698 2031 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:35:00.021741 2031 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:35:00.021776 2031 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:35:00.021809 2031 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:35:00.026913 2031 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32937
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32937
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2031
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:35:00.027882 2031 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:35:00.028903 2031 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:35:00.037320 2039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:00.037482 2036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:35:00.037550 2031 server_base.cc:1034] running on GCE node
W20260809 15:35:00.037667 2037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:35:00.038214 2031 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:35:00.039657 2031 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:35:00.040831 2031 hybrid_clock.cc:648] HybridClock initialized: now 1786289700040816 us; error 30 us; skew 500 ppm
Aug 09 15:35:00 dist-test-slave-1jjb krb5kdc[2017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289700, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:35:00.050429 2031 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 15:35:00.051337 2031 webserver.cc:460] Webserver started at http://127.0.0.1:41857/ using document root <none> and password file <none>
I20260809 15:35:00.051930 2031 fs_manager.cc:359] Metadata directory not provided
I20260809 15:35:00.052023 2031 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:35:00.052259 2031 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:35:00.054205 2031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "9c258c1b60ac4fc0aab5dfd56f84cdb4"
format_stamp: "Formatted at 2026-08-09 15:35:00 on dist-test-slave-1jjb"
server_key: "8406c0a677ce0482c1c8a44b06c74b28"
server_key_iv: "ba5fbcb10f1566ca638e3dff96c1e9ce"
server_key_version: "encryptionkey@0"
I20260809 15:35:00.054772 2031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "9c258c1b60ac4fc0aab5dfd56f84cdb4"
format_stamp: "Formatted at 2026-08-09 15:35:00 on dist-test-slave-1jjb"
server_key: "8406c0a677ce0482c1c8a44b06c74b28"
server_key_iv: "ba5fbcb10f1566ca638e3dff96c1e9ce"
server_key_version: "encryptionkey@0"
I20260809 15:35:00.058382 2031 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260809 15:35:00.060834 2046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:35:00.062175 2031 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:35:00.062302 2031 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "9c258c1b60ac4fc0aab5dfd56f84cdb4"
format_stamp: "Formatted at 2026-08-09 15:35:00 on dist-test-slave-1jjb"
server_key: "8406c0a677ce0482c1c8a44b06c74b28"
server_key_iv: "ba5fbcb10f1566ca638e3dff96c1e9ce"
server_key_version: "encryptionkey@0"
I20260809 15:35:00.062412 2031 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:35:00.077044 2031 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:35:00.079581 2031 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:35:00.079772 2031 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:35:00.086607 2031 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32937
I20260809 15:35:00.086618 2101 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32937 every 8 connection(s)
I20260809 15:35:00.087538 2031 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:35:00.090238 2102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:35:00.092654 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 2031
I20260809 15:35:00.092803 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:35:00.093092 11848 external_mini_cluster.cc:1428] Setting key ae2cea8c5de42ea8ebe28e612ced6102
I20260809 15:35:00.095903 2102 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c258c1b60ac4fc0aab5dfd56f84cdb4: Bootstrap starting.
I20260809 15:35:00.098354 2102 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c258c1b60ac4fc0aab5dfd56f84cdb4: Neither blocks nor log segments found. Creating new log.
I20260809 15:35:00.099128 2102 log.cc:824] T 00000000000000000000000000000000 P 9c258c1b60ac4fc0aab5dfd56f84cdb4: Log is configured to *not* fsync() on all Append() calls
I20260809 15:35:00.101228 2102 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c258c1b60ac4fc0aab5dfd56f84cdb4: No bootstrap required, opened a new log
I20260809 15:35:00.101662 2105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:00.094375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34973 (local address 127.0.0.1:32937)
0809 15:35:00.094753 (+ 378us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:00.094769 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:00.094802 (+ 33us) server_negotiation.cc:407] Connection header received
0809 15:35:00.095402 (+ 600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:00.095417 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:00.095712 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:00.095964 (+ 252us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:00.096383 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:00.097271 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:00.098502 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:00.098956 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:00.099068 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:00.099957 (+ 889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:00.099970 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:00.099982 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:35:00.100386 (+ 404us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:00.100445 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:35:00.100467 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:00.100541 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:00.100708 (+ 167us) server_negotiation.cc:299] Negotiation successful
0809 15:35:00.100917 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":238,"thread_start_us":112,"threads_started":1}
I20260809 15:35:00.104514 11848 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:35:00.105233 2102 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c258c1b60ac4fc0aab5dfd56f84cdb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c258c1b60ac4fc0aab5dfd56f84cdb4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32937 } }
I20260809 15:35:00.105494 2102 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9c258c1b60ac4fc0aab5dfd56f84cdb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:35:00.105554 2102 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c258c1b60ac4fc0aab5dfd56f84cdb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c258c1b60ac4fc0aab5dfd56f84cdb4, State: Initialized, Role: FOLLOWER
I20260809 15:35:00.106019 2102 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c258c1b60ac4fc0aab5dfd56f84cdb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c258c1b60ac4fc0aab5dfd56f84cdb4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32937 } }
I20260809 15:35:00.106177 2102 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9c258c1b60ac4fc0aab5dfd56f84cdb4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:35:00.106247 2102 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c258c1b60ac4fc0aab5dfd56f84cdb4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:35:00.106343 2102 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c258c1b60ac4fc0aab5dfd56f84cdb4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:35:00.107460 2102 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c258c1b60ac4fc0aab5dfd56f84cdb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c258c1b60ac4fc0aab5dfd56f84cdb4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32937 } }
I20260809 15:35:00.107851 2102 leader_election.cc:302] T 00000000000000000000000000000000 P 9c258c1b60ac4fc0aab5dfd56f84cdb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c258c1b60ac4fc0aab5dfd56f84cdb4; no voters:
I20260809 15:35:00.108167 2102 leader_election.cc:288] T 00000000000000000000000000000000 P 9c258c1b60ac4fc0aab5dfd56f84cdb4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:35:00.108273 2113 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9c258c1b60ac4fc0aab5dfd56f84cdb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:35:00.108479 2113 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9c258c1b60ac4fc0aab5dfd56f84cdb4 [term 1 LEADER]: Becoming Leader. State: Replica: 9c258c1b60ac4fc0aab5dfd56f84cdb4, State: Running, Role: LEADER
I20260809 15:35:00.108758 2113 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c258c1b60ac4fc0aab5dfd56f84cdb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c258c1b60ac4fc0aab5dfd56f84cdb4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32937 } }
I20260809 15:35:00.109411 2102 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c258c1b60ac4fc0aab5dfd56f84cdb4 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:35:00.109875 2113 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c258c1b60ac4fc0aab5dfd56f84cdb4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c258c1b60ac4fc0aab5dfd56f84cdb4. Latest consensus state: current_term: 1 leader_uuid: "9c258c1b60ac4fc0aab5dfd56f84cdb4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c258c1b60ac4fc0aab5dfd56f84cdb4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32937 } } }
I20260809 15:35:00.110008 2113 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c258c1b60ac4fc0aab5dfd56f84cdb4 [sys.catalog]: This master's current role is: LEADER
I20260809 15:35:00.110435 2117 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:35:00.111456 2105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:00.106673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36701 (local address 127.0.0.1:32937)
0809 15:35:00.106785 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:00.106789 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:00.106981 (+ 192us) server_negotiation.cc:407] Connection header received
0809 15:35:00.107060 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:00.107063 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:00.107105 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:00.107189 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:00.107405 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:00.108177 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:00.109295 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:00.109639 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:00.109757 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:00.110752 (+ 995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:00.110755 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:00.110758 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:35:00.110769 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:00.110793 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:35:00.110805 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:00.110871 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:00.111194 (+ 323us) server_negotiation.cc:299] Negotiation successful
0809 15:35:00.111256 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 15:35:00.110675 2114 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c258c1b60ac4fc0aab5dfd56f84cdb4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9c258c1b60ac4fc0aab5dfd56f84cdb4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c258c1b60ac4fc0aab5dfd56f84cdb4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32937 } } }
I20260809 15:35:00.111640 2114 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c258c1b60ac4fc0aab5dfd56f84cdb4 [sys.catalog]: This master's current role is: LEADER
I20260809 15:35:00.113938 2117 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:35:00.119345 2117 catalog_manager.cc:1347] Generated new cluster ID: 6781f983fcd24ff292fe65107af0ca71
I20260809 15:35:00.119416 2117 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:35:00.127462 2117 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:35:00.128336 2117 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:35:00.133291 2117 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9c258c1b60ac4fc0aab5dfd56f84cdb4: Generated new TSK 0
I20260809 15:35:00.133931 2117 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:35:00.142433 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 2031
2026-08-09T15:35:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1426 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:35:00 dist-test-slave-1jjb krb5kdc[2135](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:35:00 dist-test-slave-1jjb krb5kdc[2135](info): set up 2 sockets
Aug 09 15:35:00 dist-test-slave-1jjb krb5kdc[2135](info): commencing operation
krb5kdc: starting...
W20260809 15:35:01.208364 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.042s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:35:01 dist-test-slave-1jjb krb5kdc[2135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289701, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:35:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:35:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 15:35:01.326938 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45353
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45353
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:35:01.432821 2150 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:35:01.433041 2150 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:35:01.433099 2150 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:35:01.437227 2150 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:35:01.437286 2150 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:35:01.437306 2150 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:35:01.437374 2150 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:35:01.437413 2150 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:35:01.442699 2150 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45353
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45353
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2150
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:35:01.443598 2150 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:35:01.444550 2150 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:35:01.452490 2159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:01.452486 2157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:01.452490 2156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:35:01.452780 2150 server_base.cc:1034] running on GCE node
I20260809 15:35:01.453306 2150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:35:01.454239 2150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:35:01.455411 2150 hybrid_clock.cc:648] HybridClock initialized: now 1786289701455394 us; error 28 us; skew 500 ppm
Aug 09 15:35:01 dist-test-slave-1jjb krb5kdc[2135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289701, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:35:01.458266 2150 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 15:35:01.459074 2150 webserver.cc:460] Webserver started at http://127.0.0.1:34769/ using document root <none> and password file <none>
I20260809 15:35:01.459619 2150 fs_manager.cc:359] Metadata directory not provided
I20260809 15:35:01.459743 2150 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:35:01.459990 2150 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:35:01.461922 2150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "51439ea4289445ff9dfc700c85b5911c"
format_stamp: "Formatted at 2026-08-09 15:35:01 on dist-test-slave-1jjb"
server_key: "f4316a1a004f164264f8b0e3e2b200cb"
server_key_iv: "0e066208b152ad6845fda515bb6d0ecb"
server_key_version: "encryptionkey@0"
I20260809 15:35:01.462471 2150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "51439ea4289445ff9dfc700c85b5911c"
format_stamp: "Formatted at 2026-08-09 15:35:01 on dist-test-slave-1jjb"
server_key: "f4316a1a004f164264f8b0e3e2b200cb"
server_key_iv: "0e066208b152ad6845fda515bb6d0ecb"
server_key_version: "encryptionkey@0"
I20260809 15:35:01.466033 2150 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 15:35:01.468246 2167 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:35:01.469419 2150 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 15:35:01.469559 2150 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "51439ea4289445ff9dfc700c85b5911c"
format_stamp: "Formatted at 2026-08-09 15:35:01 on dist-test-slave-1jjb"
server_key: "f4316a1a004f164264f8b0e3e2b200cb"
server_key_iv: "0e066208b152ad6845fda515bb6d0ecb"
server_key_version: "encryptionkey@0"
I20260809 15:35:01.469662 2150 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:35:01.475644 2150 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:35:01.479092 2150 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:35:01.479249 2150 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:35:01.486577 2150 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45353
I20260809 15:35:01.486584 2223 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45353 every 8 connection(s)
I20260809 15:35:01.487422 2150 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:35:01.490054 2224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:35:01.492583 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 2150
I20260809 15:35:01.492738 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:35:01.493006 11848 external_mini_cluster.cc:1428] Setting key de1b40302a653c684ed29ac9c8982ae1
I20260809 15:35:01.495563 2224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51439ea4289445ff9dfc700c85b5911c: Bootstrap starting.
I20260809 15:35:01.497845 2227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:01.494338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40603 (local address 127.0.0.1:45353)
0809 15:35:01.494754 (+ 416us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:01.494770 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:01.494801 (+ 31us) server_negotiation.cc:407] Connection header received
0809 15:35:01.495385 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:01.495400 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:01.495652 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:01.495947 (+ 295us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:01.496736 (+ 789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:01.496740 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:01.496750 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:35:01.496759 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:01.496804 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:35:01.496822 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:01.496924 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:01.497053 (+ 129us) server_negotiation.cc:299] Negotiation successful
0809 15:35:01.497215 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":132,"threads_started":1}
I20260809 15:35:01.498116 2224 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 51439ea4289445ff9dfc700c85b5911c: Neither blocks nor log segments found. Creating new log.
I20260809 15:35:01.498973 2224 log.cc:824] T 00000000000000000000000000000000 P 51439ea4289445ff9dfc700c85b5911c: Log is configured to *not* fsync() on all Append() calls
I20260809 15:35:01.500725 11848 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:35:01.501060 2224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51439ea4289445ff9dfc700c85b5911c: No bootstrap required, opened a new log
I20260809 15:35:01.504245 2227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:01.502682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57223 (local address 127.0.0.1:45353)
0809 15:35:01.502786 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:01.502789 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:01.503005 (+ 216us) server_negotiation.cc:407] Connection header received
0809 15:35:01.503105 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:01.503107 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:01.503131 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:01.503191 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:01.503814 (+ 623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:01.503817 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:01.503818 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:35:01.503828 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:01.503850 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:35:01.503860 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:01.503925 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:01.504033 (+ 108us) server_negotiation.cc:299] Negotiation successful
0809 15:35:01.504059 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 15:35:01.505384 2224 raft_consensus.cc:348] T 00000000000000000000000000000000 P 51439ea4289445ff9dfc700c85b5911c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51439ea4289445ff9dfc700c85b5911c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45353 } }
I20260809 15:35:01.505582 2224 raft_consensus.cc:374] T 00000000000000000000000000000000 P 51439ea4289445ff9dfc700c85b5911c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:35:01.505652 2224 raft_consensus.cc:729] T 00000000000000000000000000000000 P 51439ea4289445ff9dfc700c85b5911c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51439ea4289445ff9dfc700c85b5911c, State: Initialized, Role: FOLLOWER
I20260809 15:35:01.506072 2224 consensus_queue.cc:260] T 00000000000000000000000000000000 P 51439ea4289445ff9dfc700c85b5911c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51439ea4289445ff9dfc700c85b5911c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45353 } }
I20260809 15:35:01.506217 2224 raft_consensus.cc:388] T 00000000000000000000000000000000 P 51439ea4289445ff9dfc700c85b5911c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:35:01.506299 2224 raft_consensus.cc:482] T 00000000000000000000000000000000 P 51439ea4289445ff9dfc700c85b5911c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:35:01.506398 2224 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 51439ea4289445ff9dfc700c85b5911c [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:35:01.507202 2224 raft_consensus.cc:504] T 00000000000000000000000000000000 P 51439ea4289445ff9dfc700c85b5911c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51439ea4289445ff9dfc700c85b5911c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45353 } }
I20260809 15:35:01.507570 2224 leader_election.cc:302] T 00000000000000000000000000000000 P 51439ea4289445ff9dfc700c85b5911c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 51439ea4289445ff9dfc700c85b5911c; no voters:
I20260809 15:35:01.507879 2224 leader_election.cc:288] T 00000000000000000000000000000000 P 51439ea4289445ff9dfc700c85b5911c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:35:01.507987 2234 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 51439ea4289445ff9dfc700c85b5911c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:35:01.508235 2234 raft_consensus.cc:686] T 00000000000000000000000000000000 P 51439ea4289445ff9dfc700c85b5911c [term 1 LEADER]: Becoming Leader. State: Replica: 51439ea4289445ff9dfc700c85b5911c, State: Running, Role: LEADER
I20260809 15:35:01.508529 2234 consensus_queue.cc:237] T 00000000000000000000000000000000 P 51439ea4289445ff9dfc700c85b5911c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51439ea4289445ff9dfc700c85b5911c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45353 } }
I20260809 15:35:01.509024 2224 sys_catalog.cc:564] T 00000000000000000000000000000000 P 51439ea4289445ff9dfc700c85b5911c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:35:01.510144 2236 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51439ea4289445ff9dfc700c85b5911c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 51439ea4289445ff9dfc700c85b5911c. Latest consensus state: current_term: 1 leader_uuid: "51439ea4289445ff9dfc700c85b5911c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51439ea4289445ff9dfc700c85b5911c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45353 } } }
I20260809 15:35:01.510286 2236 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51439ea4289445ff9dfc700c85b5911c [sys.catalog]: This master's current role is: LEADER
I20260809 15:35:01.510598 2235 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51439ea4289445ff9dfc700c85b5911c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "51439ea4289445ff9dfc700c85b5911c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51439ea4289445ff9dfc700c85b5911c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45353 } } }
I20260809 15:35:01.510689 2235 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51439ea4289445ff9dfc700c85b5911c [sys.catalog]: This master's current role is: LEADER
I20260809 15:35:01.510766 2243 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:35:01.513794 2243 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:35:01.519268 2243 catalog_manager.cc:1347] Generated new cluster ID: 81592b434f39411aa4ca09c2edb44f68
I20260809 15:35:01.519335 2243 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:35:01.527201 2243 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:35:01.527490 2243 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:35:01.532749 2243 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 51439ea4289445ff9dfc700c85b5911c: Generated new TSK 0
I20260809 15:35:01.533373 2243 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:35:01.537572 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 2150
2026-08-09T15:35:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1393 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:35:01 dist-test-slave-1jjb krb5kdc[2256](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:35:01 dist-test-slave-1jjb krb5kdc[2256](info): set up 2 sockets
Aug 09 15:35:01 dist-test-slave-1jjb krb5kdc[2256](info): commencing operation
krb5kdc: starting...
W20260809 15:35:02.585192 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.025s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:35:02 dist-test-slave-1jjb krb5kdc[2256](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289702, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:35:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:35:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 15:35:02.707419 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43225
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43225
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:35:02.817561 2270 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:35:02.817840 2270 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:35:02.817941 2270 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:35:02.821915 2270 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:35:02.822002 2270 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:35:02.822053 2270 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:35:02.822108 2270 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:35:02.822149 2270 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:35:02.827030 2270 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43225
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43225
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2270
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:35:02.828019 2270 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:35:02.829005 2270 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:35:02.837103 2277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:02.837102 2275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:02.837129 2279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:35:02.837389 2270 server_base.cc:1034] running on GCE node
I20260809 15:35:02.837936 2270 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:35:02.838949 2270 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:35:02.840142 2270 hybrid_clock.cc:648] HybridClock initialized: now 1786289702840136 us; error 37 us; skew 500 ppm
Aug 09 15:35:02 dist-test-slave-1jjb krb5kdc[2256](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289702, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:35:02.842527 2270 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 15:35:02.843360 2270 webserver.cc:460] Webserver started at http://127.0.0.1:34573/ using document root <none> and password file <none>
I20260809 15:35:02.843864 2270 fs_manager.cc:359] Metadata directory not provided
I20260809 15:35:02.843952 2270 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:35:02.844240 2270 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:35:02.846091 2270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "3f1623f94429495ba957127b2fb70ff7"
format_stamp: "Formatted at 2026-08-09 15:35:02 on dist-test-slave-1jjb"
server_key: "431b342a05e5f94bd8cc60c2f0ecf2e1"
server_key_iv: "4f0b7e6ffa768341ef68c3097b379446"
server_key_version: "encryptionkey@0"
I20260809 15:35:02.846632 2270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "3f1623f94429495ba957127b2fb70ff7"
format_stamp: "Formatted at 2026-08-09 15:35:02 on dist-test-slave-1jjb"
server_key: "431b342a05e5f94bd8cc60c2f0ecf2e1"
server_key_iv: "4f0b7e6ffa768341ef68c3097b379446"
server_key_version: "encryptionkey@0"
I20260809 15:35:02.850076 2270 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 15:35:02.852329 2287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:35:02.853477 2270 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:35:02.853622 2270 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "3f1623f94429495ba957127b2fb70ff7"
format_stamp: "Formatted at 2026-08-09 15:35:02 on dist-test-slave-1jjb"
server_key: "431b342a05e5f94bd8cc60c2f0ecf2e1"
server_key_iv: "4f0b7e6ffa768341ef68c3097b379446"
server_key_version: "encryptionkey@0"
I20260809 15:35:02.853729 2270 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:35:02.864467 2270 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:35:02.867115 2270 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:35:02.867301 2270 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:35:02.874332 2270 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43225
I20260809 15:35:02.874358 2342 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43225 every 8 connection(s)
I20260809 15:35:02.875208 2270 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:35:02.877851 2343 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:35:02.882844 2343 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f1623f94429495ba957127b2fb70ff7: Bootstrap starting.
I20260809 15:35:02.883272 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 2270
I20260809 15:35:02.883409 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:35:02.883697 11848 external_mini_cluster.cc:1428] Setting key 69311e002fcfd361f2e64ae8dac6d8cb
I20260809 15:35:02.885514 2343 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f1623f94429495ba957127b2fb70ff7: Neither blocks nor log segments found. Creating new log.
I20260809 15:35:02.886202 2343 log.cc:824] T 00000000000000000000000000000000 P 3f1623f94429495ba957127b2fb70ff7: Log is configured to *not* fsync() on all Append() calls
I20260809 15:35:02.888233 2343 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f1623f94429495ba957127b2fb70ff7: No bootstrap required, opened a new log
Aug 09 15:35:02 dist-test-slave-1jjb krb5kdc[2256](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289702, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 15:35:02.892580 2343 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f1623f94429495ba957127b2fb70ff7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f1623f94429495ba957127b2fb70ff7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43225 } }
I20260809 15:35:02.892823 2343 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3f1623f94429495ba957127b2fb70ff7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:35:02.892911 2343 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f1623f94429495ba957127b2fb70ff7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1623f94429495ba957127b2fb70ff7, State: Initialized, Role: FOLLOWER
I20260809 15:35:02.893383 2343 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f1623f94429495ba957127b2fb70ff7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f1623f94429495ba957127b2fb70ff7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43225 } }
I20260809 15:35:02.893558 2343 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3f1623f94429495ba957127b2fb70ff7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:35:02.893646 2343 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3f1623f94429495ba957127b2fb70ff7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:35:02.893749 2343 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f1623f94429495ba957127b2fb70ff7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:35:02.894546 2343 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3f1623f94429495ba957127b2fb70ff7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f1623f94429495ba957127b2fb70ff7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43225 } }
I20260809 15:35:02.894882 2343 leader_election.cc:302] T 00000000000000000000000000000000 P 3f1623f94429495ba957127b2fb70ff7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f1623f94429495ba957127b2fb70ff7; no voters:
I20260809 15:35:02.895229 2343 leader_election.cc:288] T 00000000000000000000000000000000 P 3f1623f94429495ba957127b2fb70ff7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:35:02.895260 2348 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3f1623f94429495ba957127b2fb70ff7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:35:02.895481 2348 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3f1623f94429495ba957127b2fb70ff7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f1623f94429495ba957127b2fb70ff7, State: Running, Role: LEADER
I20260809 15:35:02.895752 2348 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f1623f94429495ba957127b2fb70ff7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f1623f94429495ba957127b2fb70ff7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43225 } }
I20260809 15:35:02.896420 2343 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f1623f94429495ba957127b2fb70ff7 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:35:02.897457 2350 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f1623f94429495ba957127b2fb70ff7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3f1623f94429495ba957127b2fb70ff7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f1623f94429495ba957127b2fb70ff7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43225 } } }
I20260809 15:35:02.897604 2350 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f1623f94429495ba957127b2fb70ff7 [sys.catalog]: This master's current role is: LEADER
I20260809 15:35:02.898003 2349 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f1623f94429495ba957127b2fb70ff7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f1623f94429495ba957127b2fb70ff7. Latest consensus state: current_term: 1 leader_uuid: "3f1623f94429495ba957127b2fb70ff7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f1623f94429495ba957127b2fb70ff7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43225 } } }
I20260809 15:35:02.898109 2349 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f1623f94429495ba957127b2fb70ff7 [sys.catalog]: This master's current role is: LEADER
I20260809 15:35:02.898885 2358 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:35:02.899137 2346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:02.884998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.174:59669 (local address 127.0.0.1:43225)
0809 15:35:02.885395 (+ 397us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:02.885408 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:02.885439 (+ 31us) server_negotiation.cc:407] Connection header received
0809 15:35:02.886094 (+ 655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:02.886109 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:02.886452 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:02.886806 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:02.887623 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:02.888686 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:02.889857 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:02.890284 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:02.890391 (+ 107us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:02.893183 (+ 2792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:02.893188 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:02.893203 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:02.893231 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:02.895169 (+ 1938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:02.895745 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:02.895750 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:02.895755 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:02.895894 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:02.896321 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:02.896324 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:02.896325 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:02.896783 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:02.897079 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:02.897944 (+ 865us) server_negotiation.cc:299] Negotiation successful
0809 15:35:02.898159 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":276,"thread_start_us":114,"threads_started":1}
I20260809 15:35:02.901682 2358 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:35:02.902272 11848 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:35:02.907387 2358 catalog_manager.cc:1347] Generated new cluster ID: 980a9ac1b08c49b4b6966171caf62da4
I20260809 15:35:02.907444 2358 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:35:02.911832 2346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:02.904233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.174:50787 (local address 127.0.0.1:43225)
0809 15:35:02.904323 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:02.904327 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:02.904592 (+ 265us) server_negotiation.cc:407] Connection header received
0809 15:35:02.904704 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:02.904707 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:02.904757 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:02.904839 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:02.905585 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:02.906166 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:02.906904 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:02.907172 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:02.907271 (+ 99us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:02.908657 (+ 1386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:02.908661 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:02.908664 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:02.908688 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:02.910096 (+ 1408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:02.910568 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:02.910571 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:02.910573 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:02.910647 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:02.910984 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:02.910987 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:02.910989 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:02.911145 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:02.911300 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:02.911578 (+ 278us) server_negotiation.cc:299] Negotiation successful
0809 15:35:02.911667 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 15:35:02.923300 2358 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:35:02.924454 2358 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:35:02.935340 2358 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3f1623f94429495ba957127b2fb70ff7: Generated new TSK 0
I20260809 15:35:02.936065 2358 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:35:02.947779 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 2270
W20260809 15:35:02.957615 2254 connection.cc:535] client connection to 127.0.0.1:43225 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43225): Connection reset by peer (error 104)
2026-08-09T15:35:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1411 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:35:03 dist-test-slave-1jjb krb5kdc[2375](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:35:03 dist-test-slave-1jjb krb5kdc[2375](info): set up 2 sockets
Aug 09 15:35:03 dist-test-slave-1jjb krb5kdc[2375](info): commencing operation
krb5kdc: starting...
W20260809 15:35:04.008016 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.036s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:35:04 dist-test-slave-1jjb krb5kdc[2375](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:35:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:35:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 15:35:04.127067 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32965
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32965
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:35:04.234040 2390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:35:04.234289 2390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:35:04.234377 2390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:35:04.237950 2390 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:35:04.238025 2390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:35:04.238065 2390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:35:04.238098 2390 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:35:04.238126 2390 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:35:04.242848 2390 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32965
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32965
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:35:04.243777 2390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:35:04.244746 2390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:35:04.253029 2395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:04.253023 2396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:04.253022 2398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:35:04.253337 2390 server_base.cc:1034] running on GCE node
I20260809 15:35:04.253922 2390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:35:04.254927 2390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:35:04.256140 2390 hybrid_clock.cc:648] HybridClock initialized: now 1786289704256111 us; error 37 us; skew 500 ppm
Aug 09 15:35:04 dist-test-slave-1jjb krb5kdc[2375](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289704, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:35:04.259019 2390 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 15:35:04.259788 2390 webserver.cc:460] Webserver started at http://127.0.0.1:33815/ using document root <none> and password file <none>
I20260809 15:35:04.260339 2390 fs_manager.cc:359] Metadata directory not provided
I20260809 15:35:04.260406 2390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:35:04.260588 2390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:35:04.262419 2390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "a27b732b1dc74b29a0d28cda16c02d8e"
format_stamp: "Formatted at 2026-08-09 15:35:04 on dist-test-slave-1jjb"
server_key: "cb21875f9be9658f18b75937a0637fe2"
server_key_iv: "48fd3875c0f784e62a9162c86ba6f6e5"
server_key_version: "encryptionkey@0"
I20260809 15:35:04.262950 2390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "a27b732b1dc74b29a0d28cda16c02d8e"
format_stamp: "Formatted at 2026-08-09 15:35:04 on dist-test-slave-1jjb"
server_key: "cb21875f9be9658f18b75937a0637fe2"
server_key_iv: "48fd3875c0f784e62a9162c86ba6f6e5"
server_key_version: "encryptionkey@0"
I20260809 15:35:04.266340 2390 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 15:35:04.268610 2405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:35:04.269785 2390 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:35:04.269933 2390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "a27b732b1dc74b29a0d28cda16c02d8e"
format_stamp: "Formatted at 2026-08-09 15:35:04 on dist-test-slave-1jjb"
server_key: "cb21875f9be9658f18b75937a0637fe2"
server_key_iv: "48fd3875c0f784e62a9162c86ba6f6e5"
server_key_version: "encryptionkey@0"
I20260809 15:35:04.270036 2390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:35:04.289597 2390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:35:04.292708 2390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:35:04.292901 2390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:35:04.299943 2390 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32965
I20260809 15:35:04.299966 2460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32965 every 8 connection(s)
I20260809 15:35:04.300907 2390 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:35:04.303113 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 2390
I20260809 15:35:04.303270 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:35:04.303582 11848 external_mini_cluster.cc:1428] Setting key e10bad75b1c34fa5329d731d8a4955c8
I20260809 15:35:04.304050 2461 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:35:04.309940 2461 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a27b732b1dc74b29a0d28cda16c02d8e: Bootstrap starting.
I20260809 15:35:04.312146 2461 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a27b732b1dc74b29a0d28cda16c02d8e: Neither blocks nor log segments found. Creating new log.
I20260809 15:35:04.312254 2464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:04.304994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.174:43247 (local address 127.0.0.1:32965)
0809 15:35:04.305447 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:04.305461 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:04.305505 (+ 44us) server_negotiation.cc:407] Connection header received
0809 15:35:04.306112 (+ 607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:04.306127 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:04.306422 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:04.306736 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:04.307128 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:04.308191 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:04.309075 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:04.309542 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:04.309723 (+ 181us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:04.310659 (+ 936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:04.310664 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:04.310675 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:35:04.311016 (+ 341us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:04.311066 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:35:04.311087 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:04.311234 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:04.311396 (+ 162us) server_negotiation.cc:299] Negotiation successful
0809 15:35:04.311531 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":164,"threads_started":1}
I20260809 15:35:04.312901 2461 log.cc:824] T 00000000000000000000000000000000 P a27b732b1dc74b29a0d28cda16c02d8e: Log is configured to *not* fsync() on all Append() calls
I20260809 15:35:04.314842 11848 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:35:04.314841 2461 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a27b732b1dc74b29a0d28cda16c02d8e: No bootstrap required, opened a new log
I20260809 15:35:04.318883 2461 raft_consensus.cc:348] T 00000000000000000000000000000000 P a27b732b1dc74b29a0d28cda16c02d8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a27b732b1dc74b29a0d28cda16c02d8e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32965 } }
I20260809 15:35:04.319136 2461 raft_consensus.cc:374] T 00000000000000000000000000000000 P a27b732b1dc74b29a0d28cda16c02d8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:35:04.319209 2461 raft_consensus.cc:729] T 00000000000000000000000000000000 P a27b732b1dc74b29a0d28cda16c02d8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a27b732b1dc74b29a0d28cda16c02d8e, State: Initialized, Role: FOLLOWER
I20260809 15:35:04.319650 2461 consensus_queue.cc:260] T 00000000000000000000000000000000 P a27b732b1dc74b29a0d28cda16c02d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a27b732b1dc74b29a0d28cda16c02d8e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32965 } }
I20260809 15:35:04.319820 2461 raft_consensus.cc:388] T 00000000000000000000000000000000 P a27b732b1dc74b29a0d28cda16c02d8e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:35:04.319916 2461 raft_consensus.cc:482] T 00000000000000000000000000000000 P a27b732b1dc74b29a0d28cda16c02d8e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:35:04.320013 2461 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a27b732b1dc74b29a0d28cda16c02d8e [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:35:04.320886 2464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:04.316685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.174:56115 (local address 127.0.0.1:32965)
0809 15:35:04.316824 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:04.316831 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:04.317020 (+ 189us) server_negotiation.cc:407] Connection header received
0809 15:35:04.317127 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:04.317129 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:04.317163 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:04.317223 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:04.317522 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:04.318077 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:04.319227 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:04.319455 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:04.319569 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:04.320434 (+ 865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:04.320437 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:04.320440 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:35:04.320451 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:04.320481 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:35:04.320492 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:04.320607 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:04.320727 (+ 120us) server_negotiation.cc:299] Negotiation successful
0809 15:35:04.320761 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 15:35:04.320920 2461 raft_consensus.cc:504] T 00000000000000000000000000000000 P a27b732b1dc74b29a0d28cda16c02d8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a27b732b1dc74b29a0d28cda16c02d8e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32965 } }
I20260809 15:35:04.321269 2461 leader_election.cc:302] T 00000000000000000000000000000000 P a27b732b1dc74b29a0d28cda16c02d8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a27b732b1dc74b29a0d28cda16c02d8e; no voters:
I20260809 15:35:04.321630 2461 leader_election.cc:288] T 00000000000000000000000000000000 P a27b732b1dc74b29a0d28cda16c02d8e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:35:04.321702 2471 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a27b732b1dc74b29a0d28cda16c02d8e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:35:04.321892 2471 raft_consensus.cc:686] T 00000000000000000000000000000000 P a27b732b1dc74b29a0d28cda16c02d8e [term 1 LEADER]: Becoming Leader. State: Replica: a27b732b1dc74b29a0d28cda16c02d8e, State: Running, Role: LEADER
I20260809 15:35:04.322170 2471 consensus_queue.cc:237] T 00000000000000000000000000000000 P a27b732b1dc74b29a0d28cda16c02d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a27b732b1dc74b29a0d28cda16c02d8e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32965 } }
I20260809 15:35:04.322806 2461 sys_catalog.cc:564] T 00000000000000000000000000000000 P a27b732b1dc74b29a0d28cda16c02d8e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:35:04.323761 2472 sys_catalog.cc:455] T 00000000000000000000000000000000 P a27b732b1dc74b29a0d28cda16c02d8e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a27b732b1dc74b29a0d28cda16c02d8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a27b732b1dc74b29a0d28cda16c02d8e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32965 } } }
I20260809 15:35:04.323905 2472 sys_catalog.cc:458] T 00000000000000000000000000000000 P a27b732b1dc74b29a0d28cda16c02d8e [sys.catalog]: This master's current role is: LEADER
I20260809 15:35:04.324225 2473 sys_catalog.cc:455] T 00000000000000000000000000000000 P a27b732b1dc74b29a0d28cda16c02d8e [sys.catalog]: SysCatalogTable state changed. Reason: New leader a27b732b1dc74b29a0d28cda16c02d8e. Latest consensus state: current_term: 1 leader_uuid: "a27b732b1dc74b29a0d28cda16c02d8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a27b732b1dc74b29a0d28cda16c02d8e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32965 } } }
I20260809 15:35:04.324316 2480 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:35:04.324331 2473 sys_catalog.cc:458] T 00000000000000000000000000000000 P a27b732b1dc74b29a0d28cda16c02d8e [sys.catalog]: This master's current role is: LEADER
I20260809 15:35:04.327275 2480 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:35:04.332998 2480 catalog_manager.cc:1347] Generated new cluster ID: 22ad7380f6a84c43b5d840d63f599a36
I20260809 15:35:04.333088 2480 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:35:04.340925 2480 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:35:04.341773 2480 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:35:04.348711 2480 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a27b732b1dc74b29a0d28cda16c02d8e: Generated new TSK 0
I20260809 15:35:04.349284 2480 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:35:04.357144 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 2390
W20260809 15:35:04.365296 2373 connection.cc:535] client connection to 127.0.0.1:32965 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:32965): Connection reset by peer (error 104)
2026-08-09T15:35:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1407 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:35:04 dist-test-slave-1jjb krb5kdc[2492](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:35:04 dist-test-slave-1jjb krb5kdc[2492](info): set up 2 sockets
Aug 09 15:35:04 dist-test-slave-1jjb krb5kdc[2492](info): commencing operation
krb5kdc: starting...
W20260809 15:35:05.429952 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.050s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:35:05 dist-test-slave-1jjb krb5kdc[2492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289705, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:35:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:35:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 15:35:05.551877 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32851
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32851
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:35:05.664059 2505 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:35:05.664436 2505 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:35:05.664563 2505 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:35:05.668443 2505 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:35:05.668511 2505 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:35:05.668558 2505 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:35:05.668601 2505 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:35:05.668653 2505 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:35:05.673640 2505 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32851
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32851
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2505
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:35:05.674510 2505 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:35:05.675422 2505 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:35:05.683602 2511 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:05.683600 2510 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:05.683631 2513 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:35:05.683911 2505 server_base.cc:1034] running on GCE node
I20260809 15:35:05.684512 2505 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:35:05.685513 2505 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:35:05.686713 2505 hybrid_clock.cc:648] HybridClock initialized: now 1786289705686697 us; error 31 us; skew 500 ppm
Aug 09 15:35:05 dist-test-slave-1jjb krb5kdc[2492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289705, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:35:05.693141 2505 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 15:35:05.693972 2505 webserver.cc:460] Webserver started at http://127.0.0.1:33969/ using document root <none> and password file <none>
I20260809 15:35:05.694458 2505 fs_manager.cc:359] Metadata directory not provided
I20260809 15:35:05.694514 2505 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:35:05.694666 2505 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:35:05.696557 2505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "afaae4d6c8004175aa9010ebce7129b4"
format_stamp: "Formatted at 2026-08-09 15:35:05 on dist-test-slave-1jjb"
server_key: "813c8d67020e3784959353ff450907a0"
server_key_iv: "e1de51a01e9d75774c6ccf3f42dc83fc"
server_key_version: "encryptionkey@0"
I20260809 15:35:05.697070 2505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "afaae4d6c8004175aa9010ebce7129b4"
format_stamp: "Formatted at 2026-08-09 15:35:05 on dist-test-slave-1jjb"
server_key: "813c8d67020e3784959353ff450907a0"
server_key_iv: "e1de51a01e9d75774c6ccf3f42dc83fc"
server_key_version: "encryptionkey@0"
I20260809 15:35:05.700512 2505 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 15:35:05.702684 2521 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:35:05.703819 2505 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:35:05.703914 2505 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "afaae4d6c8004175aa9010ebce7129b4"
format_stamp: "Formatted at 2026-08-09 15:35:05 on dist-test-slave-1jjb"
server_key: "813c8d67020e3784959353ff450907a0"
server_key_iv: "e1de51a01e9d75774c6ccf3f42dc83fc"
server_key_version: "encryptionkey@0"
I20260809 15:35:05.703989 2505 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:35:05.708369 2505 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:35:05.711326 2505 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:35:05.711465 2505 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:35:05.718302 2505 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32851
I20260809 15:35:05.718343 2577 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32851 every 8 connection(s)
I20260809 15:35:05.719142 2505 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:35:05.721871 2578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:35:05.727144 2578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afaae4d6c8004175aa9010ebce7129b4: Bootstrap starting.
I20260809 15:35:05.727586 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 2505
I20260809 15:35:05.727732 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:35:05.728030 11848 external_mini_cluster.cc:1428] Setting key ab16a74d28241daebfb979d56f232d8a
I20260809 15:35:05.729878 2578 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P afaae4d6c8004175aa9010ebce7129b4: Neither blocks nor log segments found. Creating new log.
I20260809 15:35:05.730579 2578 log.cc:824] T 00000000000000000000000000000000 P afaae4d6c8004175aa9010ebce7129b4: Log is configured to *not* fsync() on all Append() calls
I20260809 15:35:05.732805 2578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afaae4d6c8004175aa9010ebce7129b4: No bootstrap required, opened a new log
I20260809 15:35:05.733045 2581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:05.729339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.174:54095 (local address 127.0.0.1:32851)
0809 15:35:05.729782 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:05.729797 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:05.729830 (+ 33us) server_negotiation.cc:407] Connection header received
0809 15:35:05.730470 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:05.730486 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:05.730791 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:05.731128 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:05.731858 (+ 730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:05.731863 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:05.731874 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:35:05.731884 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:05.731936 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:35:05.731954 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:05.732072 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:05.732196 (+ 124us) server_negotiation.cc:299] Negotiation successful
0809 15:35:05.732353 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":136,"threads_started":1}
I20260809 15:35:05.735601 11848 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:35:05.736527 2578 raft_consensus.cc:348] T 00000000000000000000000000000000 P afaae4d6c8004175aa9010ebce7129b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afaae4d6c8004175aa9010ebce7129b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32851 } }
I20260809 15:35:05.736752 2578 raft_consensus.cc:374] T 00000000000000000000000000000000 P afaae4d6c8004175aa9010ebce7129b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:35:05.736863 2578 raft_consensus.cc:729] T 00000000000000000000000000000000 P afaae4d6c8004175aa9010ebce7129b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afaae4d6c8004175aa9010ebce7129b4, State: Initialized, Role: FOLLOWER
I20260809 15:35:05.737286 2578 consensus_queue.cc:260] T 00000000000000000000000000000000 P afaae4d6c8004175aa9010ebce7129b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afaae4d6c8004175aa9010ebce7129b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32851 } }
I20260809 15:35:05.737453 2578 raft_consensus.cc:388] T 00000000000000000000000000000000 P afaae4d6c8004175aa9010ebce7129b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:35:05.737550 2578 raft_consensus.cc:482] T 00000000000000000000000000000000 P afaae4d6c8004175aa9010ebce7129b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:35:05.737706 2578 raft_consensus.cc:3037] T 00000000000000000000000000000000 P afaae4d6c8004175aa9010ebce7129b4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:35:05.738595 2578 raft_consensus.cc:504] T 00000000000000000000000000000000 P afaae4d6c8004175aa9010ebce7129b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afaae4d6c8004175aa9010ebce7129b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32851 } }
I20260809 15:35:05.738938 2578 leader_election.cc:302] T 00000000000000000000000000000000 P afaae4d6c8004175aa9010ebce7129b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: afaae4d6c8004175aa9010ebce7129b4; no voters:
I20260809 15:35:05.739269 2578 leader_election.cc:288] T 00000000000000000000000000000000 P afaae4d6c8004175aa9010ebce7129b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:35:05.739315 2581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:05.737644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.174:48147 (local address 127.0.0.1:32851)
0809 15:35:05.737732 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:05.737736 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:05.737989 (+ 253us) server_negotiation.cc:407] Connection header received
0809 15:35:05.738103 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:05.738106 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:05.738135 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:05.738225 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:05.738937 (+ 712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:05.738940 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:05.738943 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:35:05.738954 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:05.738978 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:35:05.738997 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:05.739085 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:05.739158 (+ 73us) server_negotiation.cc:299] Negotiation successful
0809 15:35:05.739200 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 15:35:05.739498 2588 raft_consensus.cc:2781] T 00000000000000000000000000000000 P afaae4d6c8004175aa9010ebce7129b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:35:05.739713 2588 raft_consensus.cc:686] T 00000000000000000000000000000000 P afaae4d6c8004175aa9010ebce7129b4 [term 1 LEADER]: Becoming Leader. State: Replica: afaae4d6c8004175aa9010ebce7129b4, State: Running, Role: LEADER
I20260809 15:35:05.740072 2588 consensus_queue.cc:237] T 00000000000000000000000000000000 P afaae4d6c8004175aa9010ebce7129b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afaae4d6c8004175aa9010ebce7129b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32851 } }
I20260809 15:35:05.740628 2578 sys_catalog.cc:564] T 00000000000000000000000000000000 P afaae4d6c8004175aa9010ebce7129b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:35:05.741753 2590 sys_catalog.cc:455] T 00000000000000000000000000000000 P afaae4d6c8004175aa9010ebce7129b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader afaae4d6c8004175aa9010ebce7129b4. Latest consensus state: current_term: 1 leader_uuid: "afaae4d6c8004175aa9010ebce7129b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afaae4d6c8004175aa9010ebce7129b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32851 } } }
I20260809 15:35:05.741885 2590 sys_catalog.cc:458] T 00000000000000000000000000000000 P afaae4d6c8004175aa9010ebce7129b4 [sys.catalog]: This master's current role is: LEADER
I20260809 15:35:05.742193 2589 sys_catalog.cc:455] T 00000000000000000000000000000000 P afaae4d6c8004175aa9010ebce7129b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "afaae4d6c8004175aa9010ebce7129b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afaae4d6c8004175aa9010ebce7129b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32851 } } }
I20260809 15:35:05.742288 2589 sys_catalog.cc:458] T 00000000000000000000000000000000 P afaae4d6c8004175aa9010ebce7129b4 [sys.catalog]: This master's current role is: LEADER
I20260809 15:35:05.742301 2597 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:35:05.745169 2597 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:35:05.749801 2597 catalog_manager.cc:1347] Generated new cluster ID: b6a151d7449546aeb79d56175e607e97
I20260809 15:35:05.749861 2597 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:35:05.766163 2597 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:35:05.766444 2597 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:35:05.778707 2597 catalog_manager.cc:5868] T 00000000000000000000000000000000 P afaae4d6c8004175aa9010ebce7129b4: Generated new TSK 0
I20260809 15:35:05.779378 2597 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:35:05.783807 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 2505
2026-08-09T15:35:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1427 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:35:05 dist-test-slave-1jjb krb5kdc[2609](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:35:05 dist-test-slave-1jjb krb5kdc[2609](info): set up 2 sockets
Aug 09 15:35:05 dist-test-slave-1jjb krb5kdc[2609](info): commencing operation
krb5kdc: starting...
W20260809 15:35:06.837441 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.031s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:35:06 dist-test-slave-1jjb krb5kdc[2609](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:35:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:35:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 15:35:06.955055 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33481
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33481
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:35:07.061504 2622 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:35:07.061753 2622 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:35:07.061820 2622 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:35:07.065547 2622 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:35:07.065615 2622 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:35:07.065649 2622 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:35:07.065721 2622 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:35:07.065757 2622 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:35:07.070704 2622 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33481
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33481
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2622
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:35:07.071583 2622 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:35:07.072577 2622 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:35:07.080425 2630 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:07.080444 2628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:07.080444 2627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:35:07.080790 2622 server_base.cc:1034] running on GCE node
I20260809 15:35:07.081436 2622 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:35:07.082342 2622 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:35:07.083518 2622 hybrid_clock.cc:648] HybridClock initialized: now 1786289707083503 us; error 38 us; skew 500 ppm
Aug 09 15:35:07 dist-test-slave-1jjb krb5kdc[2609](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289707, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:35:07.086064 2622 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 15:35:07.086791 2622 webserver.cc:460] Webserver started at http://127.0.0.1:46743/ using document root <none> and password file <none>
I20260809 15:35:07.087275 2622 fs_manager.cc:359] Metadata directory not provided
I20260809 15:35:07.087357 2622 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:35:07.087564 2622 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:35:07.089486 2622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "fc41422e9ff24fceba068e12bf6a0a1f"
format_stamp: "Formatted at 2026-08-09 15:35:07 on dist-test-slave-1jjb"
server_key: "34114a5e3fbf3857728302982814a833"
server_key_iv: "7c9bad1a30b7b8d8e582f2208fafedbe"
server_key_version: "encryptionkey@0"
I20260809 15:35:07.090099 2622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "fc41422e9ff24fceba068e12bf6a0a1f"
format_stamp: "Formatted at 2026-08-09 15:35:07 on dist-test-slave-1jjb"
server_key: "34114a5e3fbf3857728302982814a833"
server_key_iv: "7c9bad1a30b7b8d8e582f2208fafedbe"
server_key_version: "encryptionkey@0"
I20260809 15:35:07.093487 2622 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 15:35:07.095721 2637 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:35:07.096853 2622 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:35:07.097007 2622 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "fc41422e9ff24fceba068e12bf6a0a1f"
format_stamp: "Formatted at 2026-08-09 15:35:07 on dist-test-slave-1jjb"
server_key: "34114a5e3fbf3857728302982814a833"
server_key_iv: "7c9bad1a30b7b8d8e582f2208fafedbe"
server_key_version: "encryptionkey@0"
I20260809 15:35:07.097110 2622 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:35:07.114804 2622 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:35:07.117560 2622 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:35:07.117746 2622 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:35:07.124639 2622 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33481
I20260809 15:35:07.124670 2693 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33481 every 8 connection(s)
I20260809 15:35:07.125690 2622 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:35:07.128252 2694 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:35:07.130709 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 2622
I20260809 15:35:07.130846 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:35:07.131119 11848 external_mini_cluster.cc:1428] Setting key 1e3b60741595127d58a928b2023e8219
I20260809 15:35:07.134243 2694 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc41422e9ff24fceba068e12bf6a0a1f: Bootstrap starting.
I20260809 15:35:07.136790 2694 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc41422e9ff24fceba068e12bf6a0a1f: Neither blocks nor log segments found. Creating new log.
I20260809 15:35:07.137533 2694 log.cc:824] T 00000000000000000000000000000000 P fc41422e9ff24fceba068e12bf6a0a1f: Log is configured to *not* fsync() on all Append() calls
I20260809 15:35:07.139353 2694 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc41422e9ff24fceba068e12bf6a0a1f: No bootstrap required, opened a new log
Aug 09 15:35:07 dist-test-slave-1jjb krb5kdc[2609](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 15:35:07.143335 2694 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc41422e9ff24fceba068e12bf6a0a1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc41422e9ff24fceba068e12bf6a0a1f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33481 } }
I20260809 15:35:07.143581 2694 raft_consensus.cc:374] T 00000000000000000000000000000000 P fc41422e9ff24fceba068e12bf6a0a1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:35:07.143639 2694 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc41422e9ff24fceba068e12bf6a0a1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc41422e9ff24fceba068e12bf6a0a1f, State: Initialized, Role: FOLLOWER
I20260809 15:35:07.144060 2694 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc41422e9ff24fceba068e12bf6a0a1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc41422e9ff24fceba068e12bf6a0a1f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33481 } }
I20260809 15:35:07.144287 2694 raft_consensus.cc:388] T 00000000000000000000000000000000 P fc41422e9ff24fceba068e12bf6a0a1f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:35:07.144371 2694 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc41422e9ff24fceba068e12bf6a0a1f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:35:07.144476 2694 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc41422e9ff24fceba068e12bf6a0a1f [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:35:07.145267 2694 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc41422e9ff24fceba068e12bf6a0a1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc41422e9ff24fceba068e12bf6a0a1f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33481 } }
I20260809 15:35:07.145629 2694 leader_election.cc:302] T 00000000000000000000000000000000 P fc41422e9ff24fceba068e12bf6a0a1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc41422e9ff24fceba068e12bf6a0a1f; no voters:
I20260809 15:35:07.146013 2694 leader_election.cc:288] T 00000000000000000000000000000000 P fc41422e9ff24fceba068e12bf6a0a1f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:35:07.146093 2699 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc41422e9ff24fceba068e12bf6a0a1f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:35:07.146320 2699 raft_consensus.cc:686] T 00000000000000000000000000000000 P fc41422e9ff24fceba068e12bf6a0a1f [term 1 LEADER]: Becoming Leader. State: Replica: fc41422e9ff24fceba068e12bf6a0a1f, State: Running, Role: LEADER
I20260809 15:35:07.146521 2697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:07.132486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.174:45587 (local address 127.0.0.1:33481)
0809 15:35:07.132907 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:07.132926 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:07.132968 (+ 42us) server_negotiation.cc:407] Connection header received
0809 15:35:07.133757 (+ 789us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:07.133778 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:07.134160 (+ 382us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:07.134523 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:07.135181 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:07.136670 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:07.137515 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:07.138134 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:07.138296 (+ 162us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:07.140830 (+ 2534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:07.140836 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:07.140851 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:07.140882 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:07.143427 (+ 2545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:07.143976 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:07.143981 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:07.143985 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:07.144160 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:07.144558 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:07.144561 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:07.144563 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:07.144938 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:07.145174 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:07.145430 (+ 256us) server_negotiation.cc:299] Negotiation successful
0809 15:35:07.145647 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":105,"threads_started":1}
I20260809 15:35:07.146673 2699 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc41422e9ff24fceba068e12bf6a0a1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc41422e9ff24fceba068e12bf6a0a1f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33481 } }
I20260809 15:35:07.147265 2694 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc41422e9ff24fceba068e12bf6a0a1f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:35:07.148447 2700 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc41422e9ff24fceba068e12bf6a0a1f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fc41422e9ff24fceba068e12bf6a0a1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc41422e9ff24fceba068e12bf6a0a1f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33481 } } }
I20260809 15:35:07.148566 2700 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc41422e9ff24fceba068e12bf6a0a1f [sys.catalog]: This master's current role is: LEADER
I20260809 15:35:07.148890 2701 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc41422e9ff24fceba068e12bf6a0a1f [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc41422e9ff24fceba068e12bf6a0a1f. Latest consensus state: current_term: 1 leader_uuid: "fc41422e9ff24fceba068e12bf6a0a1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc41422e9ff24fceba068e12bf6a0a1f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33481 } } }
I20260809 15:35:07.149077 2701 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc41422e9ff24fceba068e12bf6a0a1f [sys.catalog]: This master's current role is: LEADER
I20260809 15:35:07.150121 11848 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260809 15:35:07.153055 2717 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fc41422e9ff24fceba068e12bf6a0a1f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:35:07.153137 2717 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:35:07.153218 2711 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:35:07.153959 2711 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:35:07.160483 2711 catalog_manager.cc:1347] Generated new cluster ID: 39991eba734d492bb551602ce38c0c49
I20260809 15:35:07.160547 2711 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:35:07.162016 2697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:07.152313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.174:40019 (local address 127.0.0.1:33481)
0809 15:35:07.153284 (+ 971us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:07.153288 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:07.153302 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:35:07.153334 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:07.153336 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:07.153375 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:07.153458 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:07.154397 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:07.155128 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:07.156339 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:07.156675 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:07.156780 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:07.158510 (+ 1730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:07.158513 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:07.158516 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:07.158541 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:07.160203 (+ 1662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:07.160756 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:07.160759 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:07.160761 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:07.160841 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:07.161161 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:07.161164 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:07.161166 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:07.161319 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:07.161484 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:07.161747 (+ 263us) server_negotiation.cc:299] Negotiation successful
0809 15:35:07.161838 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":903}
I20260809 15:35:07.173280 2711 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:35:07.174108 2711 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:35:07.180452 2711 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fc41422e9ff24fceba068e12bf6a0a1f: Generated new TSK 0
I20260809 15:35:07.181089 2711 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:35:07.190663 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 2622
W20260809 15:35:07.201102 2607 connection.cc:535] client connection to 127.0.0.1:33481 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33481): Connection reset by peer (error 104)
2026-08-09T15:35:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1408 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:35:07 dist-test-slave-1jjb krb5kdc[2729](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:35:07 dist-test-slave-1jjb krb5kdc[2729](info): set up 2 sockets
Aug 09 15:35:07 dist-test-slave-1jjb krb5kdc[2729](info): commencing operation
krb5kdc: starting...
W20260809 15:35:08.249396 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.034s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:35:08 dist-test-slave-1jjb krb5kdc[2729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289708, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:35:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:35:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 15:35:08.368485 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33135
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33135
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:35:08.476214 2746 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:35:08.476457 2746 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:35:08.476542 2746 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:35:08.480518 2746 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:35:08.480590 2746 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:35:08.480633 2746 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:35:08.480686 2746 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:35:08.480724 2746 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:35:08.485671 2746 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33135
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33135
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2746
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:35:08.486586 2746 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:35:08.487527 2746 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:35:08.495450 2752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:08.495431 2754 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:08.495515 2751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:35:08.495590 2746 server_base.cc:1034] running on GCE node
I20260809 15:35:08.496275 2746 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:35:08.497262 2746 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:35:08.498440 2746 hybrid_clock.cc:648] HybridClock initialized: now 1786289708498413 us; error 38 us; skew 500 ppm
Aug 09 15:35:08 dist-test-slave-1jjb krb5kdc[2729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289708, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:35:08.501168 2746 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 15:35:08.501979 2746 webserver.cc:460] Webserver started at http://127.0.0.1:35677/ using document root <none> and password file <none>
I20260809 15:35:08.502480 2746 fs_manager.cc:359] Metadata directory not provided
I20260809 15:35:08.502583 2746 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:35:08.502856 2746 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:35:08.504794 2746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "e726144a16be4b2796768ba2e5fe250d"
format_stamp: "Formatted at 2026-08-09 15:35:08 on dist-test-slave-1jjb"
server_key: "97b5f183a6deb88b74abf2c8b9f3f2dd"
server_key_iv: "dd7c9e6b31923828a7bfb6df9382e6b2"
server_key_version: "encryptionkey@0"
I20260809 15:35:08.505355 2746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "e726144a16be4b2796768ba2e5fe250d"
format_stamp: "Formatted at 2026-08-09 15:35:08 on dist-test-slave-1jjb"
server_key: "97b5f183a6deb88b74abf2c8b9f3f2dd"
server_key_iv: "dd7c9e6b31923828a7bfb6df9382e6b2"
server_key_version: "encryptionkey@0"
I20260809 15:35:08.508853 2746 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 15:35:08.511068 2761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:35:08.512234 2746 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:35:08.512360 2746 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "e726144a16be4b2796768ba2e5fe250d"
format_stamp: "Formatted at 2026-08-09 15:35:08 on dist-test-slave-1jjb"
server_key: "97b5f183a6deb88b74abf2c8b9f3f2dd"
server_key_iv: "dd7c9e6b31923828a7bfb6df9382e6b2"
server_key_version: "encryptionkey@0"
I20260809 15:35:08.512462 2746 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:35:08.524348 2746 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:35:08.527278 2746 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:35:08.527453 2746 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:35:08.534291 2746 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33135
I20260809 15:35:08.534313 2820 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33135 every 8 connection(s)
I20260809 15:35:08.535182 2746 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:35:08.537956 2821 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:35:08.543532 2821 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e726144a16be4b2796768ba2e5fe250d: Bootstrap starting.
I20260809 15:35:08.543996 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 2746
I20260809 15:35:08.544179 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:35:08.544519 11848 external_mini_cluster.cc:1428] Setting key bd9fdba98cf492a15e81d8e293d9d8f7
I20260809 15:35:08.546438 2821 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e726144a16be4b2796768ba2e5fe250d: Neither blocks nor log segments found. Creating new log.
I20260809 15:35:08.547142 2821 log.cc:824] T 00000000000000000000000000000000 P e726144a16be4b2796768ba2e5fe250d: Log is configured to *not* fsync() on all Append() calls
I20260809 15:35:08.549197 2821 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e726144a16be4b2796768ba2e5fe250d: No bootstrap required, opened a new log
I20260809 15:35:08.553428 2824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:08.545888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.174:36977 (local address 127.0.0.1:33135)
0809 15:35:08.546329 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:08.546343 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:08.546375 (+ 32us) server_negotiation.cc:407] Connection header received
0809 15:35:08.546993 (+ 618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:08.547016 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:08.547387 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:08.547793 (+ 406us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:08.548241 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:08.549169 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:08.550366 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:08.550800 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:08.550920 (+ 120us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:08.551764 (+ 844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:08.551769 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:08.551780 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:35:08.552203 (+ 423us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:08.552255 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:35:08.552277 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:08.552377 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:08.552572 (+ 195us) server_negotiation.cc:299] Negotiation successful
0809 15:35:08.552722 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":136,"threads_started":1}
I20260809 15:35:08.553431 2821 raft_consensus.cc:348] T 00000000000000000000000000000000 P e726144a16be4b2796768ba2e5fe250d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e726144a16be4b2796768ba2e5fe250d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33135 } }
I20260809 15:35:08.553774 2821 raft_consensus.cc:374] T 00000000000000000000000000000000 P e726144a16be4b2796768ba2e5fe250d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:35:08.553856 2821 raft_consensus.cc:729] T 00000000000000000000000000000000 P e726144a16be4b2796768ba2e5fe250d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e726144a16be4b2796768ba2e5fe250d, State: Initialized, Role: FOLLOWER
I20260809 15:35:08.554270 2821 consensus_queue.cc:260] T 00000000000000000000000000000000 P e726144a16be4b2796768ba2e5fe250d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e726144a16be4b2796768ba2e5fe250d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33135 } }
I20260809 15:35:08.554456 2821 raft_consensus.cc:388] T 00000000000000000000000000000000 P e726144a16be4b2796768ba2e5fe250d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:35:08.554536 2821 raft_consensus.cc:482] T 00000000000000000000000000000000 P e726144a16be4b2796768ba2e5fe250d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:35:08.554634 2821 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e726144a16be4b2796768ba2e5fe250d [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:35:08.555546 2821 raft_consensus.cc:504] T 00000000000000000000000000000000 P e726144a16be4b2796768ba2e5fe250d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e726144a16be4b2796768ba2e5fe250d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33135 } }
I20260809 15:35:08.555893 2821 leader_election.cc:302] T 00000000000000000000000000000000 P e726144a16be4b2796768ba2e5fe250d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e726144a16be4b2796768ba2e5fe250d; no voters:
I20260809 15:35:08.556264 2821 leader_election.cc:288] T 00000000000000000000000000000000 P e726144a16be4b2796768ba2e5fe250d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:35:08.556319 11848 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:35:08.556341 2827 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e726144a16be4b2796768ba2e5fe250d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:35:08.556571 2827 raft_consensus.cc:686] T 00000000000000000000000000000000 P e726144a16be4b2796768ba2e5fe250d [term 1 LEADER]: Becoming Leader. State: Replica: e726144a16be4b2796768ba2e5fe250d, State: Running, Role: LEADER
I20260809 15:35:08.556914 2827 consensus_queue.cc:237] T 00000000000000000000000000000000 P e726144a16be4b2796768ba2e5fe250d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e726144a16be4b2796768ba2e5fe250d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33135 } }
I20260809 15:35:08.557585 2821 sys_catalog.cc:564] T 00000000000000000000000000000000 P e726144a16be4b2796768ba2e5fe250d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:35:08.558683 2831 sys_catalog.cc:455] T 00000000000000000000000000000000 P e726144a16be4b2796768ba2e5fe250d [sys.catalog]: SysCatalogTable state changed. Reason: New leader e726144a16be4b2796768ba2e5fe250d. Latest consensus state: current_term: 1 leader_uuid: "e726144a16be4b2796768ba2e5fe250d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e726144a16be4b2796768ba2e5fe250d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33135 } } }
I20260809 15:35:08.558827 2831 sys_catalog.cc:458] T 00000000000000000000000000000000 P e726144a16be4b2796768ba2e5fe250d [sys.catalog]: This master's current role is: LEADER
I20260809 15:35:08.559154 2829 sys_catalog.cc:455] T 00000000000000000000000000000000 P e726144a16be4b2796768ba2e5fe250d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e726144a16be4b2796768ba2e5fe250d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e726144a16be4b2796768ba2e5fe250d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33135 } } }
I20260809 15:35:08.559262 2829 sys_catalog.cc:458] T 00000000000000000000000000000000 P e726144a16be4b2796768ba2e5fe250d [sys.catalog]: This master's current role is: LEADER
W20260809 15:35:08.562340 2852 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e726144a16be4b2796768ba2e5fe250d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:35:08.562441 2852 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:35:08.562582 2845 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:35:08.563449 2845 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:35:08.563953 2824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:08.558679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.174:55547 (local address 127.0.0.1:33135)
0809 15:35:08.559177 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:08.559182 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:08.559197 (+ 15us) server_negotiation.cc:407] Connection header received
0809 15:35:08.559353 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:08.559360 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:08.559415 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:08.559472 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:08.559959 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:08.560677 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:08.561955 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:08.562319 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:08.562405 (+ 86us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:08.563476 (+ 1071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:08.563480 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:08.563483 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:35:08.563495 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:08.563527 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:35:08.563537 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:08.563637 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:08.563763 (+ 126us) server_negotiation.cc:299] Negotiation successful
0809 15:35:08.563795 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409}
I20260809 15:35:08.569245 2845 catalog_manager.cc:1347] Generated new cluster ID: d8820b33ca77470d975fabc3ba4519c8
I20260809 15:35:08.569353 2845 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:35:08.584841 2845 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:35:08.585700 2845 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:35:08.595243 2845 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e726144a16be4b2796768ba2e5fe250d: Generated new TSK 0
I20260809 15:35:08.595916 2845 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:35:08.608796 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 2746
W20260809 15:35:08.618350 2727 connection.cc:535] client connection to 127.0.0.1:33135 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33135): Connection reset by peer (error 104)
2026-08-09T15:35:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1417 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:35:08 dist-test-slave-1jjb krb5kdc[2858](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:35:08 dist-test-slave-1jjb krb5kdc[2858](info): set up 2 sockets
Aug 09 15:35:08 dist-test-slave-1jjb krb5kdc[2858](info): commencing operation
krb5kdc: starting...
W20260809 15:35:09.685367 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.053s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:35:09 dist-test-slave-1jjb krb5kdc[2858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289709, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:35:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:35:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 15:35:09.803272 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35761
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35761
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:35:09.910096 2872 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:35:09.910363 2872 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:35:09.910439 2872 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:35:09.914455 2872 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:35:09.914527 2872 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:35:09.914563 2872 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:35:09.914615 2872 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:35:09.914655 2872 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:35:09.919735 2872 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35761
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786289437399694-11848-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35761
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2872
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:35:09.920689 2872 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:35:09.921604 2872 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:35:09.929859 2879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:09.929865 2878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:35:09.930002 2872 server_base.cc:1034] running on GCE node
W20260809 15:35:09.929874 2881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:35:09.930647 2872 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:35:09.931694 2872 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:35:09.932871 2872 hybrid_clock.cc:648] HybridClock initialized: now 1786289709932849 us; error 42 us; skew 500 ppm
Aug 09 15:35:09 dist-test-slave-1jjb krb5kdc[2858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289709, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:35:09.935508 2872 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 15:35:09.936399 2872 webserver.cc:460] Webserver started at http://127.0.0.1:35249/ using document root <none> and password file <none>
I20260809 15:35:09.936939 2872 fs_manager.cc:359] Metadata directory not provided
I20260809 15:35:09.937033 2872 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:35:09.937253 2872 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:35:09.939119 2872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "dff89b598d4d4ece924ecbca8852de0e"
format_stamp: "Formatted at 2026-08-09 15:35:09 on dist-test-slave-1jjb"
server_key: "321956151f3bc71f2a1b88d5d8c7a7f1"
server_key_iv: "2d9a7caa5d0efb65c7c22b3ac62e0436"
server_key_version: "encryptionkey@0"
I20260809 15:35:09.939657 2872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "dff89b598d4d4ece924ecbca8852de0e"
format_stamp: "Formatted at 2026-08-09 15:35:09 on dist-test-slave-1jjb"
server_key: "321956151f3bc71f2a1b88d5d8c7a7f1"
server_key_iv: "2d9a7caa5d0efb65c7c22b3ac62e0436"
server_key_version: "encryptionkey@0"
I20260809 15:35:09.943109 2872 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 15:35:09.945355 2889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:35:09.946501 2872 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 15:35:09.946631 2872 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "dff89b598d4d4ece924ecbca8852de0e"
format_stamp: "Formatted at 2026-08-09 15:35:09 on dist-test-slave-1jjb"
server_key: "321956151f3bc71f2a1b88d5d8c7a7f1"
server_key_iv: "2d9a7caa5d0efb65c7c22b3ac62e0436"
server_key_version: "encryptionkey@0"
I20260809 15:35:09.946730 2872 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:35:09.951025 2872 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:35:09.954097 2872 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:35:09.954279 2872 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:35:09.961333 2872 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35761
I20260809 15:35:09.961359 2947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35761 every 8 connection(s)
I20260809 15:35:09.962215 2872 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:35:09.965631 2948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:35:09.968806 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 2872
I20260809 15:35:09.968945 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:35:09.969249 11848 external_mini_cluster.cc:1428] Setting key 18337c3f3511ed350031a2fff2ed8ddb
I20260809 15:35:09.974349 2948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dff89b598d4d4ece924ecbca8852de0e: Bootstrap starting.
I20260809 15:35:09.975005 2951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:09.970948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.174:48963 (local address 127.0.0.1:35761)
0809 15:35:09.971350 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:09.971368 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:09.971410 (+ 42us) server_negotiation.cc:407] Connection header received
0809 15:35:09.972248 (+ 838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:09.972271 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:09.972606 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:09.973004 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:09.973712 (+ 708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:09.973718 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:09.973731 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:35:09.973742 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:09.973803 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:35:09.973828 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:09.973970 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:09.974034 (+ 64us) server_negotiation.cc:299] Negotiation successful
0809 15:35:09.974168 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248,"thread_start_us":100,"threads_started":1}
I20260809 15:35:09.976775 2948 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dff89b598d4d4ece924ecbca8852de0e: Neither blocks nor log segments found. Creating new log.
I20260809 15:35:09.977586 2948 log.cc:824] T 00000000000000000000000000000000 P dff89b598d4d4ece924ecbca8852de0e: Log is configured to *not* fsync() on all Append() calls
I20260809 15:35:09.977625 11848 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:35:09.979496 2948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dff89b598d4d4ece924ecbca8852de0e: No bootstrap required, opened a new log
I20260809 15:35:09.981438 2951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:09.979715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.174:38219 (local address 127.0.0.1:35761)
0809 15:35:09.979836 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:09.979839 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:09.980127 (+ 288us) server_negotiation.cc:407] Connection header received
0809 15:35:09.980288 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:09.980290 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:09.980319 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:09.980405 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:09.981076 (+ 671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:09.981079 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:09.981081 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:35:09.981093 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:09.981118 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:35:09.981136 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:09.981223 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:09.981297 (+ 74us) server_negotiation.cc:299] Negotiation successful
0809 15:35:09.981336 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 15:35:09.983182 2948 raft_consensus.cc:348] T 00000000000000000000000000000000 P dff89b598d4d4ece924ecbca8852de0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dff89b598d4d4ece924ecbca8852de0e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35761 } }
I20260809 15:35:09.983373 2948 raft_consensus.cc:374] T 00000000000000000000000000000000 P dff89b598d4d4ece924ecbca8852de0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:35:09.983451 2948 raft_consensus.cc:729] T 00000000000000000000000000000000 P dff89b598d4d4ece924ecbca8852de0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dff89b598d4d4ece924ecbca8852de0e, State: Initialized, Role: FOLLOWER
I20260809 15:35:09.983848 2948 consensus_queue.cc:260] T 00000000000000000000000000000000 P dff89b598d4d4ece924ecbca8852de0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dff89b598d4d4ece924ecbca8852de0e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35761 } }
I20260809 15:35:09.983982 2948 raft_consensus.cc:388] T 00000000000000000000000000000000 P dff89b598d4d4ece924ecbca8852de0e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:35:09.984104 2948 raft_consensus.cc:482] T 00000000000000000000000000000000 P dff89b598d4d4ece924ecbca8852de0e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:35:09.984201 2948 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dff89b598d4d4ece924ecbca8852de0e [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:35:09.984962 2948 raft_consensus.cc:504] T 00000000000000000000000000000000 P dff89b598d4d4ece924ecbca8852de0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dff89b598d4d4ece924ecbca8852de0e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35761 } }
I20260809 15:35:09.985262 2948 leader_election.cc:302] T 00000000000000000000000000000000 P dff89b598d4d4ece924ecbca8852de0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dff89b598d4d4ece924ecbca8852de0e; no voters:
I20260809 15:35:09.985503 2948 leader_election.cc:288] T 00000000000000000000000000000000 P dff89b598d4d4ece924ecbca8852de0e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:35:09.985610 2958 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dff89b598d4d4ece924ecbca8852de0e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:35:09.985828 2958 raft_consensus.cc:686] T 00000000000000000000000000000000 P dff89b598d4d4ece924ecbca8852de0e [term 1 LEADER]: Becoming Leader. State: Replica: dff89b598d4d4ece924ecbca8852de0e, State: Running, Role: LEADER
I20260809 15:35:09.986188 2958 consensus_queue.cc:237] T 00000000000000000000000000000000 P dff89b598d4d4ece924ecbca8852de0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dff89b598d4d4ece924ecbca8852de0e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35761 } }
I20260809 15:35:09.986652 2948 sys_catalog.cc:564] T 00000000000000000000000000000000 P dff89b598d4d4ece924ecbca8852de0e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:35:09.987908 2960 sys_catalog.cc:455] T 00000000000000000000000000000000 P dff89b598d4d4ece924ecbca8852de0e [sys.catalog]: SysCatalogTable state changed. Reason: New leader dff89b598d4d4ece924ecbca8852de0e. Latest consensus state: current_term: 1 leader_uuid: "dff89b598d4d4ece924ecbca8852de0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dff89b598d4d4ece924ecbca8852de0e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35761 } } }
I20260809 15:35:09.988020 2960 sys_catalog.cc:458] T 00000000000000000000000000000000 P dff89b598d4d4ece924ecbca8852de0e [sys.catalog]: This master's current role is: LEADER
I20260809 15:35:09.988268 2959 sys_catalog.cc:455] T 00000000000000000000000000000000 P dff89b598d4d4ece924ecbca8852de0e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dff89b598d4d4ece924ecbca8852de0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dff89b598d4d4ece924ecbca8852de0e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35761 } } }
I20260809 15:35:09.988361 2959 sys_catalog.cc:458] T 00000000000000000000000000000000 P dff89b598d4d4ece924ecbca8852de0e [sys.catalog]: This master's current role is: LEADER
W20260809 15:35:09.991237 2976 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dff89b598d4d4ece924ecbca8852de0e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:35:09.991302 2976 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:35:09.991382 2970 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:35:09.992166 2970 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:35:09.996917 2970 catalog_manager.cc:1347] Generated new cluster ID: ac40b0e1ccee4943a1402fcb5166910c
I20260809 15:35:09.996978 2970 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:35:10.021746 2970 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:35:10.022061 2970 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:35:10.036240 2970 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dff89b598d4d4ece924ecbca8852de0e: Generated new TSK 0
I20260809 15:35:10.036828 2970 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:35:10.049747 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 2872
2026-08-09T15:35:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1440 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:35:10 dist-test-slave-1jjb krb5kdc[2982](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:35:10 dist-test-slave-1jjb krb5kdc[2982](info): set up 2 sockets
Aug 09 15:35:10 dist-test-slave-1jjb krb5kdc[2982](info): commencing operation
krb5kdc: starting...
W20260809 15:35:11.167133 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:35:11 dist-test-slave-1jjb krb5kdc[2982](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289711, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:35:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:35:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.146.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
I20260809 15:35:11.286917 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:44791
--webserver_interface=127.11.146.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:42479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:44791
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:35:11.394400 2996 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:35:11.394698 2996 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:35:11.394767 2996 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:35:11.398705 2996 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:35:11.398798 2996 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:35:11.398837 2996 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:35:11.398910 2996 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:35:11.398952 2996 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:35:11.403975 2996 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:42479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:44791
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:44791
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2996
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:35:11.404987 2996 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:35:11.405961 2996 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:35:11.414283 3001 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:11.414294 3004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:11.414304 3002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:35:11.414449 2996 server_base.cc:1034] running on GCE node
I20260809 15:35:11.415158 2996 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:35:11.416251 2996 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:35:11.417434 2996 hybrid_clock.cc:648] HybridClock initialized: now 1786289711417397 us; error 48 us; skew 500 ppm
Aug 09 15:35:11 dist-test-slave-1jjb krb5kdc[2982](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289711, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:35:11.424194 2996 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:35:11.425055 2996 webserver.cc:460] Webserver started at http://127.11.146.62:40243/ using document root <none> and password file <none>
I20260809 15:35:11.425573 2996 fs_manager.cc:359] Metadata directory not provided
I20260809 15:35:11.425630 2996 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:35:11.425783 2996 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:35:11.427660 2996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "07a51c3010094544a59a5d8b59c1cf6c"
format_stamp: "Formatted at 2026-08-09 15:35:11 on dist-test-slave-1jjb"
server_key: "5f3dc63616a184e2f42096eaedd60231"
server_key_iv: "44261c6f8e1d7945a06e7ac427002247"
server_key_version: "encryptionkey@0"
I20260809 15:35:11.428238 2996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "07a51c3010094544a59a5d8b59c1cf6c"
format_stamp: "Formatted at 2026-08-09 15:35:11 on dist-test-slave-1jjb"
server_key: "5f3dc63616a184e2f42096eaedd60231"
server_key_iv: "44261c6f8e1d7945a06e7ac427002247"
server_key_version: "encryptionkey@0"
I20260809 15:35:11.431952 2996 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 15:35:11.434244 3011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:35:11.435500 2996 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:35:11.435596 2996 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "07a51c3010094544a59a5d8b59c1cf6c"
format_stamp: "Formatted at 2026-08-09 15:35:11 on dist-test-slave-1jjb"
server_key: "5f3dc63616a184e2f42096eaedd60231"
server_key_iv: "44261c6f8e1d7945a06e7ac427002247"
server_key_version: "encryptionkey@0"
I20260809 15:35:11.435671 2996 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:35:11.460052 2996 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:35:11.462630 2996 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:35:11.462772 2996 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:35:11.469856 2996 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:44791
I20260809 15:35:11.469884 3068 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:44791 every 8 connection(s)
I20260809 15:35:11.471047 2996 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:35:11.473127 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 2996
I20260809 15:35:11.473263 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:35:11.473551 11848 external_mini_cluster.cc:1428] Setting key 7517ec1c3c8baec8de0abcc0c7fc281b
I20260809 15:35:11.474628 3069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:35:11.481132 3069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07a51c3010094544a59a5d8b59c1cf6c: Bootstrap starting.
Aug 09 15:35:11 dist-test-slave-1jjb krb5kdc[2982](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289711, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:35:11.483300 3069 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 07a51c3010094544a59a5d8b59c1cf6c: Neither blocks nor log segments found. Creating new log.
I20260809 15:35:11.484274 3069 log.cc:824] T 00000000000000000000000000000000 P 07a51c3010094544a59a5d8b59c1cf6c: Log is configured to *not* fsync() on all Append() calls
I20260809 15:35:11.486248 3069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07a51c3010094544a59a5d8b59c1cf6c: No bootstrap required, opened a new log
I20260809 15:35:11.487701 3072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:11.474874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58871 (local address 127.11.146.62:44791)
0809 15:35:11.475308 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:11.475325 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:11.475363 (+ 38us) server_negotiation.cc:407] Connection header received
0809 15:35:11.476162 (+ 799us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:11.476182 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:11.476548 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:11.476907 (+ 359us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:11.477606 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:11.479036 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:11.479852 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:11.480586 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:11.480750 (+ 164us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:11.483081 (+ 2331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:11.483087 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:11.483102 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:11.483133 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:11.484846 (+ 1713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:11.485305 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:11.485311 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:11.485316 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:11.485436 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:11.485741 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:11.485744 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:11.485745 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:11.486213 (+ 468us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:11.486394 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:11.486695 (+ 301us) server_negotiation.cc:299] Negotiation successful
0809 15:35:11.486909 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":152,"threads_started":1}
I20260809 15:35:11.490330 3069 raft_consensus.cc:348] T 00000000000000000000000000000000 P 07a51c3010094544a59a5d8b59c1cf6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07a51c3010094544a59a5d8b59c1cf6c" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44791 } }
I20260809 15:35:11.490604 3069 raft_consensus.cc:374] T 00000000000000000000000000000000 P 07a51c3010094544a59a5d8b59c1cf6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:35:11.490648 11848 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:35:11.490665 3069 raft_consensus.cc:729] T 00000000000000000000000000000000 P 07a51c3010094544a59a5d8b59c1cf6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07a51c3010094544a59a5d8b59c1cf6c, State: Initialized, Role: FOLLOWER
I20260809 15:35:11.491070 3069 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07a51c3010094544a59a5d8b59c1cf6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07a51c3010094544a59a5d8b59c1cf6c" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44791 } }
I20260809 15:35:11.491222 3069 raft_consensus.cc:388] T 00000000000000000000000000000000 P 07a51c3010094544a59a5d8b59c1cf6c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:35:11.491281 3069 raft_consensus.cc:482] T 00000000000000000000000000000000 P 07a51c3010094544a59a5d8b59c1cf6c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:35:11.491367 3069 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 07a51c3010094544a59a5d8b59c1cf6c [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:35:11.492491 3069 raft_consensus.cc:504] T 00000000000000000000000000000000 P 07a51c3010094544a59a5d8b59c1cf6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07a51c3010094544a59a5d8b59c1cf6c" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44791 } }
I20260809 15:35:11.492877 3069 leader_election.cc:302] T 00000000000000000000000000000000 P 07a51c3010094544a59a5d8b59c1cf6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 07a51c3010094544a59a5d8b59c1cf6c; no voters:
I20260809 15:35:11.493201 3069 leader_election.cc:288] T 00000000000000000000000000000000 P 07a51c3010094544a59a5d8b59c1cf6c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:35:11.493281 3080 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 07a51c3010094544a59a5d8b59c1cf6c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:35:11.493541 3080 raft_consensus.cc:686] T 00000000000000000000000000000000 P 07a51c3010094544a59a5d8b59c1cf6c [term 1 LEADER]: Becoming Leader. State: Replica: 07a51c3010094544a59a5d8b59c1cf6c, State: Running, Role: LEADER
I20260809 15:35:11.493906 3080 consensus_queue.cc:237] T 00000000000000000000000000000000 P 07a51c3010094544a59a5d8b59c1cf6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07a51c3010094544a59a5d8b59c1cf6c" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44791 } }
I20260809 15:35:11.494511 3069 sys_catalog.cc:564] T 00000000000000000000000000000000 P 07a51c3010094544a59a5d8b59c1cf6c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:35:11.495028 3080 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07a51c3010094544a59a5d8b59c1cf6c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "07a51c3010094544a59a5d8b59c1cf6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07a51c3010094544a59a5d8b59c1cf6c" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44791 } } }
I20260809 15:35:11.495193 3080 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07a51c3010094544a59a5d8b59c1cf6c [sys.catalog]: This master's current role is: LEADER
I20260809 15:35:11.495436 3080 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07a51c3010094544a59a5d8b59c1cf6c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07a51c3010094544a59a5d8b59c1cf6c. Latest consensus state: current_term: 1 leader_uuid: "07a51c3010094544a59a5d8b59c1cf6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07a51c3010094544a59a5d8b59c1cf6c" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 44791 } } }
I20260809 15:35:11.495589 3080 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07a51c3010094544a59a5d8b59c1cf6c [sys.catalog]: This master's current role is: LEADER
I20260809 15:35:11.495865 3087 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:35:11.499236 3087 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:35:11.502290 3072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:11.492768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42163 (local address 127.11.146.62:44791)
0809 15:35:11.492888 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:11.492892 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:11.493072 (+ 180us) server_negotiation.cc:407] Connection header received
0809 15:35:11.493203 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:11.493207 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:11.493250 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:11.493350 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:11.494232 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:11.496032 (+ 1800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:11.497114 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:11.497435 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:11.497538 (+ 103us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:11.498841 (+ 1303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:11.498845 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:11.498847 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:11.498871 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:11.500616 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:11.501075 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:11.501079 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:11.501081 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:11.501163 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:11.501483 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:11.501486 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:11.501488 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:11.501656 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:11.501801 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:11.502061 (+ 260us) server_negotiation.cc:299] Negotiation successful
0809 15:35:11.502155 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 15:35:11.505280 3087 catalog_manager.cc:1347] Generated new cluster ID: 2513018b9e1b4f83aa278028a4218422
I20260809 15:35:11.505340 3087 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:35:11.516767 3087 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:35:11.517577 3087 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:35:11.536492 3087 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 07a51c3010094544a59a5d8b59c1cf6c: Generated new TSK 0
I20260809 15:35:11.537153 3087 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:35:11.541036 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 2996
W20260809 15:35:11.549829 2980 connection.cc:535] client connection to 127.11.146.62:44791 recv error: Network error: failed to read from TLS socket (remote: 127.11.146.62:44791): Connection reset by peer (error 104)
2026-08-09T15:35:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1491 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:35:11 dist-test-slave-1jjb krb5kdc[3103](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:35:11 dist-test-slave-1jjb krb5kdc[3103](info): set up 2 sockets
Aug 09 15:35:11 dist-test-slave-1jjb krb5kdc[3103](info): commencing operation
krb5kdc: starting...
W20260809 15:35:12.595952 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.032s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:35:12 dist-test-slave-1jjb krb5kdc[3103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289712, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:35:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:35:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.146.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
I20260809 15:35:12.717155 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:36047
--webserver_interface=127.11.146.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:34667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:36047
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:35:12.824231 3117 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:35:12.824450 3117 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:35:12.824489 3117 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:35:12.828220 3117 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:35:12.828261 3117 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:35:12.828279 3117 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:35:12.828295 3117 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:35:12.828310 3117 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:35:12.833297 3117 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:34667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:36047
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:36047
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3117
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:35:12.834121 3117 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:35:12.834975 3117 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:35:12.842948 3122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:35:12.843016 3117 server_base.cc:1034] running on GCE node
W20260809 15:35:12.843003 3125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:12.843159 3123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:35:12.843747 3117 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:35:12.844763 3117 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:35:12.845925 3117 hybrid_clock.cc:648] HybridClock initialized: now 1786289712845899 us; error 37 us; skew 500 ppm
Aug 09 15:35:12 dist-test-slave-1jjb krb5kdc[3103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289712, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:35:12.848580 3117 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:35:12.849431 3117 webserver.cc:460] Webserver started at http://127.11.146.62:43119/ using document root <none> and password file <none>
I20260809 15:35:12.849900 3117 fs_manager.cc:359] Metadata directory not provided
I20260809 15:35:12.849956 3117 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:35:12.850111 3117 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:35:12.851856 3117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "05463dc0d9d74b8ab61dd89a596a7652"
format_stamp: "Formatted at 2026-08-09 15:35:12 on dist-test-slave-1jjb"
server_key: "9345447e0e4c810c1ffbac26b9bf8cf1"
server_key_iv: "505c64698d3c379c6d061a3881005baf"
server_key_version: "encryptionkey@0"
I20260809 15:35:12.852439 3117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "05463dc0d9d74b8ab61dd89a596a7652"
format_stamp: "Formatted at 2026-08-09 15:35:12 on dist-test-slave-1jjb"
server_key: "9345447e0e4c810c1ffbac26b9bf8cf1"
server_key_iv: "505c64698d3c379c6d061a3881005baf"
server_key_version: "encryptionkey@0"
I20260809 15:35:12.855719 3117 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.002s
I20260809 15:35:12.857939 3134 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:35:12.858994 3117 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:35:12.859117 3117 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "05463dc0d9d74b8ab61dd89a596a7652"
format_stamp: "Formatted at 2026-08-09 15:35:12 on dist-test-slave-1jjb"
server_key: "9345447e0e4c810c1ffbac26b9bf8cf1"
server_key_iv: "505c64698d3c379c6d061a3881005baf"
server_key_version: "encryptionkey@0"
I20260809 15:35:12.859220 3117 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:35:12.875183 3117 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:35:12.877724 3117 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:35:12.877928 3117 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:35:12.884438 3117 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:36047
I20260809 15:35:12.884470 3188 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:36047 every 8 connection(s)
I20260809 15:35:12.885295 3117 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:35:12.887686 3189 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:35:12.892752 3189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05463dc0d9d74b8ab61dd89a596a7652: Bootstrap starting.
I20260809 15:35:12.892838 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 3117
I20260809 15:35:12.893016 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:35:12.893288 11848 external_mini_cluster.cc:1428] Setting key b96f6e542466ab2635d1860c9395a6db
I20260809 15:35:12.895360 3189 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 05463dc0d9d74b8ab61dd89a596a7652: Neither blocks nor log segments found. Creating new log.
I20260809 15:35:12.896195 3189 log.cc:824] T 00000000000000000000000000000000 P 05463dc0d9d74b8ab61dd89a596a7652: Log is configured to *not* fsync() on all Append() calls
I20260809 15:35:12.898236 3189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05463dc0d9d74b8ab61dd89a596a7652: No bootstrap required, opened a new log
I20260809 15:35:12.902582 3189 raft_consensus.cc:348] T 00000000000000000000000000000000 P 05463dc0d9d74b8ab61dd89a596a7652 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05463dc0d9d74b8ab61dd89a596a7652" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 36047 } }
I20260809 15:35:12.902776 3192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:12.894548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55329 (local address 127.11.146.62:36047)
0809 15:35:12.894948 (+ 400us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:12.894965 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:12.895004 (+ 39us) server_negotiation.cc:407] Connection header received
0809 15:35:12.895807 (+ 803us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:12.895826 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:12.896246 (+ 420us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:12.896597 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:12.896887 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:12.898255 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:12.899170 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:12.899872 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:12.900032 (+ 160us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:12.900917 (+ 885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:12.900924 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:12.900942 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:35:12.901476 (+ 534us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:12.901537 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:35:12.901567 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:12.901696 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:12.901815 (+ 119us) server_negotiation.cc:299] Negotiation successful
0809 15:35:12.901939 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":102,"threads_started":1}
I20260809 15:35:12.902830 3189 raft_consensus.cc:374] T 00000000000000000000000000000000 P 05463dc0d9d74b8ab61dd89a596a7652 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:35:12.902874 3189 raft_consensus.cc:729] T 00000000000000000000000000000000 P 05463dc0d9d74b8ab61dd89a596a7652 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05463dc0d9d74b8ab61dd89a596a7652, State: Initialized, Role: FOLLOWER
I20260809 15:35:12.903311 3189 consensus_queue.cc:260] T 00000000000000000000000000000000 P 05463dc0d9d74b8ab61dd89a596a7652 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05463dc0d9d74b8ab61dd89a596a7652" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 36047 } }
I20260809 15:35:12.903452 3189 raft_consensus.cc:388] T 00000000000000000000000000000000 P 05463dc0d9d74b8ab61dd89a596a7652 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:35:12.903513 3189 raft_consensus.cc:482] T 00000000000000000000000000000000 P 05463dc0d9d74b8ab61dd89a596a7652 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:35:12.903640 3189 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 05463dc0d9d74b8ab61dd89a596a7652 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:35:12.904562 3189 raft_consensus.cc:504] T 00000000000000000000000000000000 P 05463dc0d9d74b8ab61dd89a596a7652 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05463dc0d9d74b8ab61dd89a596a7652" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 36047 } }
I20260809 15:35:12.904904 3189 leader_election.cc:302] T 00000000000000000000000000000000 P 05463dc0d9d74b8ab61dd89a596a7652 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 05463dc0d9d74b8ab61dd89a596a7652; no voters:
I20260809 15:35:12.905272 3189 leader_election.cc:288] T 00000000000000000000000000000000 P 05463dc0d9d74b8ab61dd89a596a7652 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:35:12.905313 3194 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 05463dc0d9d74b8ab61dd89a596a7652 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:35:12.905417 11848 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:35:12.905609 3194 raft_consensus.cc:686] T 00000000000000000000000000000000 P 05463dc0d9d74b8ab61dd89a596a7652 [term 1 LEADER]: Becoming Leader. State: Replica: 05463dc0d9d74b8ab61dd89a596a7652, State: Running, Role: LEADER
I20260809 15:35:12.905936 3194 consensus_queue.cc:237] T 00000000000000000000000000000000 P 05463dc0d9d74b8ab61dd89a596a7652 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05463dc0d9d74b8ab61dd89a596a7652" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 36047 } }
I20260809 15:35:12.906522 3189 sys_catalog.cc:564] T 00000000000000000000000000000000 P 05463dc0d9d74b8ab61dd89a596a7652 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:35:12.907060 3194 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05463dc0d9d74b8ab61dd89a596a7652 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "05463dc0d9d74b8ab61dd89a596a7652" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05463dc0d9d74b8ab61dd89a596a7652" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 36047 } } }
I20260809 15:35:12.907173 3194 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05463dc0d9d74b8ab61dd89a596a7652 [sys.catalog]: This master's current role is: LEADER
I20260809 15:35:12.907449 3195 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05463dc0d9d74b8ab61dd89a596a7652 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 05463dc0d9d74b8ab61dd89a596a7652. Latest consensus state: current_term: 1 leader_uuid: "05463dc0d9d74b8ab61dd89a596a7652" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05463dc0d9d74b8ab61dd89a596a7652" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 36047 } } }
I20260809 15:35:12.907557 3195 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05463dc0d9d74b8ab61dd89a596a7652 [sys.catalog]: This master's current role is: LEADER
I20260809 15:35:12.908032 3203 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:35:12.911082 3203 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:35:12.912537 3192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:12.907794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45437 (local address 127.11.146.62:36047)
0809 15:35:12.907884 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:12.907890 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:12.907905 (+ 15us) server_negotiation.cc:407] Connection header received
0809 15:35:12.907939 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:12.907941 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:12.907978 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:12.908090 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:12.908430 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:12.909281 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:12.910484 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:12.910812 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:12.910907 (+ 95us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:12.911884 (+ 977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:12.911887 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:12.911890 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:35:12.911903 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:12.911929 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:35:12.911941 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:12.912022 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:12.912378 (+ 356us) server_negotiation.cc:299] Negotiation successful
0809 15:35:12.912418 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":24}
I20260809 15:35:12.916889 3203 catalog_manager.cc:1347] Generated new cluster ID: 2748ec6ce6d04fc6ae836044f71a0d22
I20260809 15:35:12.916949 3203 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:35:12.929700 3203 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:35:12.930789 3203 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:35:12.945434 3203 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 05463dc0d9d74b8ab61dd89a596a7652: Generated new TSK 0
I20260809 15:35:12.946027 3203 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:35:12.957134 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 3117
W20260809 15:35:12.965139 3100 connection.cc:535] client connection to 127.11.146.62:36047 recv error: Network error: failed to read from TLS socket (remote: 127.11.146.62:36047): Connection reset by peer (error 104)
2026-08-09T15:35:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1415 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:35:13 dist-test-slave-1jjb krb5kdc[3222](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:35:13 dist-test-slave-1jjb krb5kdc[3222](info): set up 2 sockets
Aug 09 15:35:13 dist-test-slave-1jjb krb5kdc[3222](info): commencing operation
krb5kdc: starting...
W20260809 15:35:14.003502 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.024s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:35:14 dist-test-slave-1jjb krb5kdc[3222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289714, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:35:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:35:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.146.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
I20260809 15:35:14.118973 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:35823
--webserver_interface=127.11.146.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:35029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:35823
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:35:14.224627 3236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:35:14.224833 3236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:35:14.224869 3236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:35:14.228631 3236 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:35:14.228678 3236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:35:14.228698 3236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:35:14.228740 3236 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:35:14.228772 3236 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:35:14.233543 3236 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:35029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:35823
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:35823
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3236
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:35:14.234442 3236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:35:14.235334 3236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:35:14.243289 3242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:14.243353 3241 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:14.243295 3244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:35:14.243652 3236 server_base.cc:1034] running on GCE node
I20260809 15:35:14.244334 3236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:35:14.245283 3236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:35:14.246465 3236 hybrid_clock.cc:648] HybridClock initialized: now 1786289714246437 us; error 39 us; skew 500 ppm
Aug 09 15:35:14 dist-test-slave-1jjb krb5kdc[3222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289714, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:35:14.249082 3236 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:35:14.249857 3236 webserver.cc:460] Webserver started at http://127.11.146.62:39333/ using document root <none> and password file <none>
I20260809 15:35:14.250383 3236 fs_manager.cc:359] Metadata directory not provided
I20260809 15:35:14.250466 3236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:35:14.250669 3236 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:35:14.252590 3236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "cb49a575ecb442dabe71bfbcf1f41002"
format_stamp: "Formatted at 2026-08-09 15:35:14 on dist-test-slave-1jjb"
server_key: "f4944936fd803912fe0bc5580699eeae"
server_key_iv: "afdccefb3facc1e29a5d211fb659b804"
server_key_version: "encryptionkey@0"
I20260809 15:35:14.253137 3236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "cb49a575ecb442dabe71bfbcf1f41002"
format_stamp: "Formatted at 2026-08-09 15:35:14 on dist-test-slave-1jjb"
server_key: "f4944936fd803912fe0bc5580699eeae"
server_key_iv: "afdccefb3facc1e29a5d211fb659b804"
server_key_version: "encryptionkey@0"
I20260809 15:35:14.256476 3236 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:35:14.258677 3251 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:35:14.259763 3236 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:35:14.259907 3236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "cb49a575ecb442dabe71bfbcf1f41002"
format_stamp: "Formatted at 2026-08-09 15:35:14 on dist-test-slave-1jjb"
server_key: "f4944936fd803912fe0bc5580699eeae"
server_key_iv: "afdccefb3facc1e29a5d211fb659b804"
server_key_version: "encryptionkey@0"
I20260809 15:35:14.260011 3236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:35:14.264338 3236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:35:14.266960 3236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:35:14.267160 3236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:35:14.273974 3236 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:35823
I20260809 15:35:14.273999 3305 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:35823 every 8 connection(s)
I20260809 15:35:14.274765 3236 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:35:14.277240 3306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:35:14.282258 3306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb49a575ecb442dabe71bfbcf1f41002: Bootstrap starting.
I20260809 15:35:14.284358 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 3236
I20260809 15:35:14.284493 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:35:14.284538 3306 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb49a575ecb442dabe71bfbcf1f41002: Neither blocks nor log segments found. Creating new log.
I20260809 15:35:14.284802 11848 external_mini_cluster.cc:1428] Setting key debe631cd7aa1338d421ef722cb3c484
I20260809 15:35:14.285359 3306 log.cc:824] T 00000000000000000000000000000000 P cb49a575ecb442dabe71bfbcf1f41002: Log is configured to *not* fsync() on all Append() calls
I20260809 15:35:14.287205 3306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb49a575ecb442dabe71bfbcf1f41002: No bootstrap required, opened a new log
I20260809 15:35:14.289198 3310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:14.285853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40577 (local address 127.11.146.62:35823)
0809 15:35:14.286217 (+ 364us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:14.286232 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:14.286263 (+ 31us) server_negotiation.cc:407] Connection header received
0809 15:35:14.286852 (+ 589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:14.286866 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:14.287103 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:14.287420 (+ 317us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:14.288113 (+ 693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:14.288122 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:14.288135 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:35:14.288146 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:14.288205 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:35:14.288223 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:14.288332 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:14.288440 (+ 108us) server_negotiation.cc:299] Negotiation successful
0809 15:35:14.288572 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":79,"threads_started":1}
I20260809 15:35:14.290803 3306 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb49a575ecb442dabe71bfbcf1f41002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb49a575ecb442dabe71bfbcf1f41002" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 35823 } }
I20260809 15:35:14.291023 3306 raft_consensus.cc:374] T 00000000000000000000000000000000 P cb49a575ecb442dabe71bfbcf1f41002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:35:14.291087 3306 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb49a575ecb442dabe71bfbcf1f41002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb49a575ecb442dabe71bfbcf1f41002, State: Initialized, Role: FOLLOWER
I20260809 15:35:14.291505 3306 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb49a575ecb442dabe71bfbcf1f41002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb49a575ecb442dabe71bfbcf1f41002" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 35823 } }
I20260809 15:35:14.291700 11848 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:35:14.291710 3306 raft_consensus.cc:388] T 00000000000000000000000000000000 P cb49a575ecb442dabe71bfbcf1f41002 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:35:14.291790 3306 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb49a575ecb442dabe71bfbcf1f41002 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:35:14.291900 3306 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb49a575ecb442dabe71bfbcf1f41002 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:35:14.292732 3306 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb49a575ecb442dabe71bfbcf1f41002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb49a575ecb442dabe71bfbcf1f41002" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 35823 } }
I20260809 15:35:14.293077 3306 leader_election.cc:302] T 00000000000000000000000000000000 P cb49a575ecb442dabe71bfbcf1f41002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cb49a575ecb442dabe71bfbcf1f41002; no voters:
I20260809 15:35:14.293385 3306 leader_election.cc:288] T 00000000000000000000000000000000 P cb49a575ecb442dabe71bfbcf1f41002 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:35:14.293447 3315 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cb49a575ecb442dabe71bfbcf1f41002 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:35:14.293664 3315 raft_consensus.cc:686] T 00000000000000000000000000000000 P cb49a575ecb442dabe71bfbcf1f41002 [term 1 LEADER]: Becoming Leader. State: Replica: cb49a575ecb442dabe71bfbcf1f41002, State: Running, Role: LEADER
I20260809 15:35:14.293951 3315 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb49a575ecb442dabe71bfbcf1f41002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb49a575ecb442dabe71bfbcf1f41002" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 35823 } }
I20260809 15:35:14.294579 3306 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb49a575ecb442dabe71bfbcf1f41002 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:35:14.295075 3315 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb49a575ecb442dabe71bfbcf1f41002 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb49a575ecb442dabe71bfbcf1f41002. Latest consensus state: current_term: 1 leader_uuid: "cb49a575ecb442dabe71bfbcf1f41002" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb49a575ecb442dabe71bfbcf1f41002" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 35823 } } }
I20260809 15:35:14.295236 3315 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb49a575ecb442dabe71bfbcf1f41002 [sys.catalog]: This master's current role is: LEADER
I20260809 15:35:14.295657 3310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:14.293761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51317 (local address 127.11.146.62:35823)
0809 15:35:14.293865 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:14.293868 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:14.294264 (+ 396us) server_negotiation.cc:407] Connection header received
0809 15:35:14.294296 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:14.294298 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:14.294323 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:14.294404 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:14.295140 (+ 736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:14.295143 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:14.295146 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:35:14.295157 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:14.295181 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:35:14.295192 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:14.295250 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:14.295452 (+ 202us) server_negotiation.cc:299] Negotiation successful
0809 15:35:14.295488 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 15:35:14.295486 3315 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb49a575ecb442dabe71bfbcf1f41002 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cb49a575ecb442dabe71bfbcf1f41002" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb49a575ecb442dabe71bfbcf1f41002" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 35823 } } }
I20260809 15:35:14.296017 3315 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb49a575ecb442dabe71bfbcf1f41002 [sys.catalog]: This master's current role is: LEADER
I20260809 15:35:14.296775 3324 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:35:14.299911 3324 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:35:14.304872 3324 catalog_manager.cc:1347] Generated new cluster ID: eeb1b0faa0b6455bb2701236cbd92a7d
I20260809 15:35:14.304934 3324 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:35:14.329105 3324 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:35:14.329437 3324 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:35:14.335848 3324 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cb49a575ecb442dabe71bfbcf1f41002: Generated new TSK 0
I20260809 15:35:14.336591 3324 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:35:14.347638 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 3236
2026-08-09T15:35:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1391 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:35:14 dist-test-slave-1jjb krb5kdc[3339](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:35:14 dist-test-slave-1jjb krb5kdc[3339](info): set up 2 sockets
Aug 09 15:35:14 dist-test-slave-1jjb krb5kdc[3339](info): commencing operation
krb5kdc: starting...
W20260809 15:35:15.400390 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.030s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:35:15 dist-test-slave-1jjb krb5kdc[3339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289715, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:35:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:35:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.146.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
I20260809 15:35:15.519448 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:33943
--webserver_interface=127.11.146.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:39519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:33943
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:35:15.628762 3352 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:35:15.629011 3352 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:35:15.629066 3352 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:35:15.632918 3352 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:35:15.632967 3352 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:35:15.632985 3352 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:35:15.633001 3352 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:35:15.633016 3352 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:35:15.637943 3352 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:39519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:33943
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:33943
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3352
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:35:15.638784 3352 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:35:15.639675 3352 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:35:15.647764 3359 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:15.647796 3360 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:15.647815 3363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:35:15.648181 3352 server_base.cc:1034] running on GCE node
I20260809 15:35:15.648638 3352 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:35:15.649607 3352 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:35:15.650796 3352 hybrid_clock.cc:648] HybridClock initialized: now 1786289715650775 us; error 40 us; skew 500 ppm
Aug 09 15:35:15 dist-test-slave-1jjb krb5kdc[3339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289715, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:35:15.653512 3352 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:35:15.654289 3352 webserver.cc:460] Webserver started at http://127.11.146.62:37517/ using document root <none> and password file <none>
I20260809 15:35:15.654793 3352 fs_manager.cc:359] Metadata directory not provided
I20260809 15:35:15.654906 3352 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:35:15.655117 3352 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:35:15.657049 3352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "29e727bb9c53481faa837e95d25f8848"
format_stamp: "Formatted at 2026-08-09 15:35:15 on dist-test-slave-1jjb"
server_key: "787919c6d13ff6b9deef00f4e24357b2"
server_key_iv: "2ff4fe0b80783e07c1eb08e6718fb6fd"
server_key_version: "encryptionkey@0"
I20260809 15:35:15.657578 3352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "29e727bb9c53481faa837e95d25f8848"
format_stamp: "Formatted at 2026-08-09 15:35:15 on dist-test-slave-1jjb"
server_key: "787919c6d13ff6b9deef00f4e24357b2"
server_key_iv: "2ff4fe0b80783e07c1eb08e6718fb6fd"
server_key_version: "encryptionkey@0"
I20260809 15:35:15.661079 3352 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 15:35:15.663969 3371 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:35:15.665328 3352 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 15:35:15.665422 3352 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "29e727bb9c53481faa837e95d25f8848"
format_stamp: "Formatted at 2026-08-09 15:35:15 on dist-test-slave-1jjb"
server_key: "787919c6d13ff6b9deef00f4e24357b2"
server_key_iv: "2ff4fe0b80783e07c1eb08e6718fb6fd"
server_key_version: "encryptionkey@0"
I20260809 15:35:15.665498 3352 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:35:15.684953 3352 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:35:15.687760 3352 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:35:15.687903 3352 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:35:15.694420 3352 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:33943
I20260809 15:35:15.694456 3426 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:33943 every 8 connection(s)
I20260809 15:35:15.695263 3352 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:35:15.697788 3428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:35:15.702814 3428 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29e727bb9c53481faa837e95d25f8848: Bootstrap starting.
I20260809 15:35:15.705039 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 3352
I20260809 15:35:15.705171 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:35:15.705389 3428 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 29e727bb9c53481faa837e95d25f8848: Neither blocks nor log segments found. Creating new log.
I20260809 15:35:15.705484 11848 external_mini_cluster.cc:1428] Setting key 525333ecfb15dc93f4c52adec8697d98
I20260809 15:35:15.706168 3428 log.cc:824] T 00000000000000000000000000000000 P 29e727bb9c53481faa837e95d25f8848: Log is configured to *not* fsync() on all Append() calls
I20260809 15:35:15.708032 3428 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29e727bb9c53481faa837e95d25f8848: No bootstrap required, opened a new log
I20260809 15:35:15.712152 3428 raft_consensus.cc:348] T 00000000000000000000000000000000 P 29e727bb9c53481faa837e95d25f8848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29e727bb9c53481faa837e95d25f8848" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 33943 } }
I20260809 15:35:15.712417 3428 raft_consensus.cc:374] T 00000000000000000000000000000000 P 29e727bb9c53481faa837e95d25f8848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:35:15.712496 3428 raft_consensus.cc:729] T 00000000000000000000000000000000 P 29e727bb9c53481faa837e95d25f8848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29e727bb9c53481faa837e95d25f8848, State: Initialized, Role: FOLLOWER
I20260809 15:35:15.712906 3428 consensus_queue.cc:260] T 00000000000000000000000000000000 P 29e727bb9c53481faa837e95d25f8848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29e727bb9c53481faa837e95d25f8848" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 33943 } }
I20260809 15:35:15.713049 3428 raft_consensus.cc:388] T 00000000000000000000000000000000 P 29e727bb9c53481faa837e95d25f8848 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:35:15.713131 3428 raft_consensus.cc:482] T 00000000000000000000000000000000 P 29e727bb9c53481faa837e95d25f8848 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:35:15.713253 3428 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 29e727bb9c53481faa837e95d25f8848 [term 0 FOLLOWER]: Advancing to term 1
Aug 09 15:35:15 dist-test-slave-1jjb krb5kdc[3339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289715, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:35:15.714293 3428 raft_consensus.cc:504] T 00000000000000000000000000000000 P 29e727bb9c53481faa837e95d25f8848 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29e727bb9c53481faa837e95d25f8848" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 33943 } }
I20260809 15:35:15.714663 3428 leader_election.cc:302] T 00000000000000000000000000000000 P 29e727bb9c53481faa837e95d25f8848 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 29e727bb9c53481faa837e95d25f8848; no voters:
I20260809 15:35:15.714998 3428 leader_election.cc:288] T 00000000000000000000000000000000 P 29e727bb9c53481faa837e95d25f8848 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:35:15.715129 3433 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 29e727bb9c53481faa837e95d25f8848 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:35:15.715360 3433 raft_consensus.cc:686] T 00000000000000000000000000000000 P 29e727bb9c53481faa837e95d25f8848 [term 1 LEADER]: Becoming Leader. State: Replica: 29e727bb9c53481faa837e95d25f8848, State: Running, Role: LEADER
I20260809 15:35:15.715695 3433 consensus_queue.cc:237] T 00000000000000000000000000000000 P 29e727bb9c53481faa837e95d25f8848 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29e727bb9c53481faa837e95d25f8848" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 33943 } }
I20260809 15:35:15.716322 3428 sys_catalog.cc:564] T 00000000000000000000000000000000 P 29e727bb9c53481faa837e95d25f8848 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:35:15.716930 3433 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29e727bb9c53481faa837e95d25f8848 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29e727bb9c53481faa837e95d25f8848. Latest consensus state: current_term: 1 leader_uuid: "29e727bb9c53481faa837e95d25f8848" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29e727bb9c53481faa837e95d25f8848" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 33943 } } }
I20260809 15:35:15.717101 3433 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29e727bb9c53481faa837e95d25f8848 [sys.catalog]: This master's current role is: LEADER
I20260809 15:35:15.717374 3434 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29e727bb9c53481faa837e95d25f8848 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "29e727bb9c53481faa837e95d25f8848" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29e727bb9c53481faa837e95d25f8848" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 33943 } } }
I20260809 15:35:15.717468 3434 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29e727bb9c53481faa837e95d25f8848 [sys.catalog]: This master's current role is: LEADER
I20260809 15:35:15.717686 3442 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:35:15.720016 3432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:15.706550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51305 (local address 127.11.146.62:33943)
0809 15:35:15.706908 (+ 358us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:15.706921 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:15.706954 (+ 33us) server_negotiation.cc:407] Connection header received
0809 15:35:15.707563 (+ 609us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:15.707578 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:15.707872 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:15.708213 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:15.709071 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:15.710046 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:15.711295 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:15.711720 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:15.711827 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:15.714853 (+ 3026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:15.714858 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:15.714869 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:15.714893 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:15.716972 (+ 2079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:15.717467 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:15.717474 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:15.717482 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:15.717622 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:15.717940 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:15.717943 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:15.717945 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:15.718422 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:15.718617 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:15.718881 (+ 264us) server_negotiation.cc:299] Negotiation successful
0809 15:35:15.719158 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215,"thread_start_us":104,"threads_started":1}
I20260809 15:35:15.720885 3442 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:35:15.723026 11848 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:35:15.727038 3442 catalog_manager.cc:1347] Generated new cluster ID: ad4e3ed0827542c4a9ef2afe594a4e5f
I20260809 15:35:15.727092 3442 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:35:15.733219 3432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:15.725103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33683 (local address 127.11.146.62:33943)
0809 15:35:15.725199 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:15.725203 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:15.725468 (+ 265us) server_negotiation.cc:407] Connection header received
0809 15:35:15.725554 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:15.725556 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:15.725596 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:15.725717 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:15.726499 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:15.727256 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:15.728323 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:15.728648 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:15.728748 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:15.730181 (+ 1433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:15.730184 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:15.730187 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:15.730214 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:15.731697 (+ 1483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:15.732142 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:15.732145 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:15.732147 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:15.732225 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:15.732478 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:15.732481 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:15.732482 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:15.732659 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:15.732771 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:15.732970 (+ 199us) server_negotiation.cc:299] Negotiation successful
0809 15:35:15.733069 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 15:35:15.738703 3442 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:35:15.739660 3442 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:35:15.743494 3442 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 29e727bb9c53481faa837e95d25f8848: Generated new TSK 0
I20260809 15:35:15.744678 3442 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:35:15.753213 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 3352
2026-08-09T15:35:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1406 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:35:15 dist-test-slave-1jjb krb5kdc[3462](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:35:15 dist-test-slave-1jjb krb5kdc[3462](info): set up 2 sockets
Aug 09 15:35:15 dist-test-slave-1jjb krb5kdc[3462](info): commencing operation
krb5kdc: starting...
W20260809 15:35:16.804747 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.028s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:35:16 dist-test-slave-1jjb krb5kdc[3462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289716, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:35:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:35:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.146.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
I20260809 15:35:16.923357 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:38921
--webserver_interface=127.11.146.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:34157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:38921
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:35:17.028985 3477 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:35:17.029230 3477 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:35:17.029269 3477 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:35:17.033080 3477 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:35:17.033128 3477 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:35:17.033147 3477 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:35:17.033164 3477 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:35:17.033177 3477 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:35:17.037858 3477 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:34157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:38921
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:38921
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3477
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:35:17.038766 3477 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:35:17.039657 3477 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:35:17.047629 3483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:17.047629 3482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:35:17.047688 3477 server_base.cc:1034] running on GCE node
W20260809 15:35:17.047616 3485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:35:17.048516 3477 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:35:17.049459 3477 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:35:17.050634 3477 hybrid_clock.cc:648] HybridClock initialized: now 1786289717050610 us; error 36 us; skew 500 ppm
Aug 09 15:35:17 dist-test-slave-1jjb krb5kdc[3462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289717, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:35:17.058871 3477 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:35:17.059726 3477 webserver.cc:460] Webserver started at http://127.11.146.62:35977/ using document root <none> and password file <none>
I20260809 15:35:17.060313 3477 fs_manager.cc:359] Metadata directory not provided
I20260809 15:35:17.060375 3477 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:35:17.060644 3477 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:35:17.062510 3477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "3cbc198ade974f6db25cafcbc390bc61"
format_stamp: "Formatted at 2026-08-09 15:35:17 on dist-test-slave-1jjb"
server_key: "5edc9eec629737ea4c135b74cd41339b"
server_key_iv: "d489e3a48d04b5513e163f01b680758a"
server_key_version: "encryptionkey@0"
I20260809 15:35:17.063052 3477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "3cbc198ade974f6db25cafcbc390bc61"
format_stamp: "Formatted at 2026-08-09 15:35:17 on dist-test-slave-1jjb"
server_key: "5edc9eec629737ea4c135b74cd41339b"
server_key_iv: "d489e3a48d04b5513e163f01b680758a"
server_key_version: "encryptionkey@0"
I20260809 15:35:17.066434 3477 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260809 15:35:17.068926 3493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:35:17.070061 3477 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 15:35:17.070166 3477 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "3cbc198ade974f6db25cafcbc390bc61"
format_stamp: "Formatted at 2026-08-09 15:35:17 on dist-test-slave-1jjb"
server_key: "5edc9eec629737ea4c135b74cd41339b"
server_key_iv: "d489e3a48d04b5513e163f01b680758a"
server_key_version: "encryptionkey@0"
I20260809 15:35:17.070245 3477 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:35:17.094298 3477 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:35:17.096877 3477 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:35:17.097040 3477 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:35:17.103734 3477 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:38921
I20260809 15:35:17.103749 3553 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:38921 every 8 connection(s)
I20260809 15:35:17.104638 3477 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:35:17.107131 3554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:35:17.109334 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 3477
I20260809 15:35:17.109463 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:35:17.109782 11848 external_mini_cluster.cc:1428] Setting key 74f6b4c648bd1dc06639715ee76b19b1
I20260809 15:35:17.113075 3554 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3cbc198ade974f6db25cafcbc390bc61: Bootstrap starting.
I20260809 15:35:17.115062 3554 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3cbc198ade974f6db25cafcbc390bc61: Neither blocks nor log segments found. Creating new log.
I20260809 15:35:17.115752 3554 log.cc:824] T 00000000000000000000000000000000 P 3cbc198ade974f6db25cafcbc390bc61: Log is configured to *not* fsync() on all Append() calls
I20260809 15:35:17.117475 3554 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3cbc198ade974f6db25cafcbc390bc61: No bootstrap required, opened a new log
I20260809 15:35:17.118261 3557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:17.111094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40741 (local address 127.11.146.62:38921)
0809 15:35:17.111517 (+ 423us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:17.111531 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:17.111564 (+ 33us) server_negotiation.cc:407] Connection header received
0809 15:35:17.112315 (+ 751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:17.112334 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:17.112652 (+ 318us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:17.113012 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:17.113403 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:17.114260 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:17.115175 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:17.115642 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:17.115827 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:17.116700 (+ 873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:17.116705 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:17.116716 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:35:17.117070 (+ 354us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:17.117123 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:35:17.117147 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:17.117259 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:17.117436 (+ 177us) server_negotiation.cc:299] Negotiation successful
0809 15:35:17.117635 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":109,"threads_started":1}
I20260809 15:35:17.121031 11848 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:35:17.121160 3554 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3cbc198ade974f6db25cafcbc390bc61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cbc198ade974f6db25cafcbc390bc61" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 38921 } }
I20260809 15:35:17.121383 3554 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3cbc198ade974f6db25cafcbc390bc61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:35:17.121456 3554 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3cbc198ade974f6db25cafcbc390bc61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cbc198ade974f6db25cafcbc390bc61, State: Initialized, Role: FOLLOWER
I20260809 15:35:17.121834 3554 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3cbc198ade974f6db25cafcbc390bc61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cbc198ade974f6db25cafcbc390bc61" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 38921 } }
I20260809 15:35:17.121984 3554 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3cbc198ade974f6db25cafcbc390bc61 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:35:17.122067 3554 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3cbc198ade974f6db25cafcbc390bc61 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:35:17.122155 3554 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3cbc198ade974f6db25cafcbc390bc61 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:35:17.123021 3554 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3cbc198ade974f6db25cafcbc390bc61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cbc198ade974f6db25cafcbc390bc61" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 38921 } }
I20260809 15:35:17.123356 3554 leader_election.cc:302] T 00000000000000000000000000000000 P 3cbc198ade974f6db25cafcbc390bc61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3cbc198ade974f6db25cafcbc390bc61; no voters:
I20260809 15:35:17.123658 3554 leader_election.cc:288] T 00000000000000000000000000000000 P 3cbc198ade974f6db25cafcbc390bc61 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:35:17.123715 3564 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3cbc198ade974f6db25cafcbc390bc61 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:35:17.123919 3564 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3cbc198ade974f6db25cafcbc390bc61 [term 1 LEADER]: Becoming Leader. State: Replica: 3cbc198ade974f6db25cafcbc390bc61, State: Running, Role: LEADER
I20260809 15:35:17.124229 3564 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3cbc198ade974f6db25cafcbc390bc61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cbc198ade974f6db25cafcbc390bc61" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 38921 } }
I20260809 15:35:17.124814 3554 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3cbc198ade974f6db25cafcbc390bc61 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:35:17.125836 3565 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3cbc198ade974f6db25cafcbc390bc61 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3cbc198ade974f6db25cafcbc390bc61. Latest consensus state: current_term: 1 leader_uuid: "3cbc198ade974f6db25cafcbc390bc61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cbc198ade974f6db25cafcbc390bc61" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 38921 } } }
I20260809 15:35:17.125983 3565 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3cbc198ade974f6db25cafcbc390bc61 [sys.catalog]: This master's current role is: LEADER
I20260809 15:35:17.126185 3566 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3cbc198ade974f6db25cafcbc390bc61 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3cbc198ade974f6db25cafcbc390bc61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cbc198ade974f6db25cafcbc390bc61" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 38921 } } }
I20260809 15:35:17.126389 3566 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3cbc198ade974f6db25cafcbc390bc61 [sys.catalog]: This master's current role is: LEADER
I20260809 15:35:17.127826 3557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:17.123220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33447 (local address 127.11.146.62:38921)
0809 15:35:17.123327 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:17.123331 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:17.123531 (+ 200us) server_negotiation.cc:407] Connection header received
0809 15:35:17.123623 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:17.123626 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:17.123668 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:17.123743 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:17.124047 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:17.124661 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:17.125769 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:17.126130 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:17.126224 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:17.127396 (+ 1172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:17.127399 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:17.127402 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:35:17.127413 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:17.127438 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:35:17.127449 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:17.127525 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:17.127664 (+ 139us) server_negotiation.cc:299] Negotiation successful
0809 15:35:17.127724 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
W20260809 15:35:17.129575 3579 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3cbc198ade974f6db25cafcbc390bc61: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:35:17.129664 3579 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:35:17.129748 3575 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:35:17.130488 3575 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:35:17.135355 3575 catalog_manager.cc:1347] Generated new cluster ID: c46b744b3e7d4770b5f178a8eedd2167
I20260809 15:35:17.135412 3575 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:35:17.168445 3575 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:35:17.169296 3575 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:35:17.182168 3575 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3cbc198ade974f6db25cafcbc390bc61: Generated new TSK 0
I20260809 15:35:17.182862 3575 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:35:17.186188 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 3477
2026-08-09T15:35:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1432 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:35:17 dist-test-slave-1jjb krb5kdc[3585](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:35:17 dist-test-slave-1jjb krb5kdc[3585](info): set up 2 sockets
Aug 09 15:35:17 dist-test-slave-1jjb krb5kdc[3585](info): commencing operation
krb5kdc: starting...
W20260809 15:35:18.252954 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.043s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:35:18 dist-test-slave-1jjb krb5kdc[3585](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289718, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:35:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:35:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.146.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
I20260809 15:35:18.371224 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:41145
--webserver_interface=127.11.146.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:37171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:41145
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:35:18.483336 3598 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:35:18.483613 3598 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:35:18.483687 3598 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:35:18.487703 3598 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:35:18.487788 3598 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:35:18.487823 3598 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:35:18.487860 3598 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:35:18.487892 3598 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:35:18.492985 3598 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:37171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:41145
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:41145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3598
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:35:18.493963 3598 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:35:18.494936 3598 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:35:18.503458 3606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:35:18.503731 3598 server_base.cc:1034] running on GCE node
W20260809 15:35:18.503458 3605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:18.503562 3609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:35:18.504456 3598 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:35:18.505450 3598 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:35:18.506654 3598 hybrid_clock.cc:648] HybridClock initialized: now 1786289718506617 us; error 44 us; skew 500 ppm
Aug 09 15:35:18 dist-test-slave-1jjb krb5kdc[3585](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289718, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:35:18.509678 3598 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:35:18.510620 3598 webserver.cc:460] Webserver started at http://127.11.146.62:44885/ using document root <none> and password file <none>
I20260809 15:35:18.511226 3598 fs_manager.cc:359] Metadata directory not provided
I20260809 15:35:18.511291 3598 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:35:18.511531 3598 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:35:18.513691 3598 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "9027df6ca9104e1c9e022891d8684c8f"
format_stamp: "Formatted at 2026-08-09 15:35:18 on dist-test-slave-1jjb"
server_key: "771f49e0c2c960e5f8014d33496116ac"
server_key_iv: "ee492cb18e0cffe40dec5b1f6ba7ea19"
server_key_version: "encryptionkey@0"
I20260809 15:35:18.514315 3598 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "9027df6ca9104e1c9e022891d8684c8f"
format_stamp: "Formatted at 2026-08-09 15:35:18 on dist-test-slave-1jjb"
server_key: "771f49e0c2c960e5f8014d33496116ac"
server_key_iv: "ee492cb18e0cffe40dec5b1f6ba7ea19"
server_key_version: "encryptionkey@0"
I20260809 15:35:18.518201 3598 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 15:35:18.520686 3616 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:35:18.521948 3598 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:35:18.522109 3598 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "9027df6ca9104e1c9e022891d8684c8f"
format_stamp: "Formatted at 2026-08-09 15:35:18 on dist-test-slave-1jjb"
server_key: "771f49e0c2c960e5f8014d33496116ac"
server_key_iv: "ee492cb18e0cffe40dec5b1f6ba7ea19"
server_key_version: "encryptionkey@0"
I20260809 15:35:18.522234 3598 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:35:18.527205 3598 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:35:18.530076 3598 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:35:18.530264 3598 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:35:18.537052 3598 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:41145
I20260809 15:35:18.537165 3670 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:41145 every 8 connection(s)
I20260809 15:35:18.537973 3598 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:35:18.540643 3671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:35:18.545821 3671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9027df6ca9104e1c9e022891d8684c8f: Bootstrap starting.
I20260809 15:35:18.547533 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 3598
I20260809 15:35:18.547672 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:35:18.547958 11848 external_mini_cluster.cc:1428] Setting key 5d3563cae8e34acfd22b6719634b3c86
I20260809 15:35:18.548444 3671 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9027df6ca9104e1c9e022891d8684c8f: Neither blocks nor log segments found. Creating new log.
I20260809 15:35:18.549357 3671 log.cc:824] T 00000000000000000000000000000000 P 9027df6ca9104e1c9e022891d8684c8f: Log is configured to *not* fsync() on all Append() calls
I20260809 15:35:18.551419 3671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9027df6ca9104e1c9e022891d8684c8f: No bootstrap required, opened a new log
I20260809 15:35:18.552943 3675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:18.549077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41853 (local address 127.11.146.62:41145)
0809 15:35:18.549498 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:18.549518 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:18.549562 (+ 44us) server_negotiation.cc:407] Connection header received
0809 15:35:18.550343 (+ 781us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:18.550371 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:18.550716 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:18.550973 (+ 257us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:18.551770 (+ 797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:18.551774 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:18.551785 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:35:18.551794 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:18.551840 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:35:18.551857 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:18.551942 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:18.552131 (+ 189us) server_negotiation.cc:299] Negotiation successful
0809 15:35:18.552300 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247,"thread_start_us":125,"threads_started":1}
I20260809 15:35:18.555568 11848 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:35:18.555425 3671 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9027df6ca9104e1c9e022891d8684c8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9027df6ca9104e1c9e022891d8684c8f" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 41145 } }
I20260809 15:35:18.555665 3671 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9027df6ca9104e1c9e022891d8684c8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 15:35:18.555753 3671 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9027df6ca9104e1c9e022891d8684c8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9027df6ca9104e1c9e022891d8684c8f, State: Initialized, Role: FOLLOWER
I20260809 15:35:18.556241 3671 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9027df6ca9104e1c9e022891d8684c8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9027df6ca9104e1c9e022891d8684c8f" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 41145 } }
I20260809 15:35:18.556385 3671 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9027df6ca9104e1c9e022891d8684c8f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 15:35:18.556452 3671 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9027df6ca9104e1c9e022891d8684c8f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 15:35:18.556550 3671 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9027df6ca9104e1c9e022891d8684c8f [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:35:18.557533 3671 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9027df6ca9104e1c9e022891d8684c8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9027df6ca9104e1c9e022891d8684c8f" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 41145 } }
I20260809 15:35:18.557917 3671 leader_election.cc:302] T 00000000000000000000000000000000 P 9027df6ca9104e1c9e022891d8684c8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9027df6ca9104e1c9e022891d8684c8f; no voters:
I20260809 15:35:18.558286 3671 leader_election.cc:288] T 00000000000000000000000000000000 P 9027df6ca9104e1c9e022891d8684c8f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 15:35:18.558378 3682 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9027df6ca9104e1c9e022891d8684c8f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:35:18.558601 3682 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9027df6ca9104e1c9e022891d8684c8f [term 1 LEADER]: Becoming Leader. State: Replica: 9027df6ca9104e1c9e022891d8684c8f, State: Running, Role: LEADER
I20260809 15:35:18.558965 3682 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9027df6ca9104e1c9e022891d8684c8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9027df6ca9104e1c9e022891d8684c8f" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 41145 } }
I20260809 15:35:18.559449 3675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:18.557761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48523 (local address 127.11.146.62:41145)
0809 15:35:18.557887 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:18.557891 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:18.558087 (+ 196us) server_negotiation.cc:407] Connection header received
0809 15:35:18.558204 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:18.558206 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:18.558232 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:18.558326 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:18.559032 (+ 706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:18.559035 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:18.559038 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 15:35:18.559052 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:18.559078 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 15:35:18.559094 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:18.559171 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:18.559267 (+ 96us) server_negotiation.cc:299] Negotiation successful
0809 15:35:18.559307 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 15:35:18.559630 3671 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9027df6ca9104e1c9e022891d8684c8f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:35:18.561153 3684 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9027df6ca9104e1c9e022891d8684c8f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9027df6ca9104e1c9e022891d8684c8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9027df6ca9104e1c9e022891d8684c8f" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 41145 } } }
I20260809 15:35:18.561154 3683 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9027df6ca9104e1c9e022891d8684c8f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9027df6ca9104e1c9e022891d8684c8f. Latest consensus state: current_term: 1 leader_uuid: "9027df6ca9104e1c9e022891d8684c8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9027df6ca9104e1c9e022891d8684c8f" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 41145 } } }
I20260809 15:35:18.561295 3684 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9027df6ca9104e1c9e022891d8684c8f [sys.catalog]: This master's current role is: LEADER
I20260809 15:35:18.561301 3683 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9027df6ca9104e1c9e022891d8684c8f [sys.catalog]: This master's current role is: LEADER
I20260809 15:35:18.561753 3695 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:35:18.564776 3695 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:35:18.569657 3695 catalog_manager.cc:1347] Generated new cluster ID: 1ae2fb5de24e4513be3223b7c9216b35
I20260809 15:35:18.569718 3695 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:35:18.593938 3695 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:35:18.594249 3695 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:35:18.602108 3695 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9027df6ca9104e1c9e022891d8684c8f: Generated new TSK 0
I20260809 15:35:18.602782 3695 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 15:35:18.609939 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 3598
2026-08-09T15:35:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1424 ms)
[----------] 18 tests from AuthTokenIssuingTest (25623 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:35:18 dist-test-slave-1jjb krb5kdc[3705](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:35:18 dist-test-slave-1jjb krb5kdc[3705](info): set up 2 sockets
Aug 09 15:35:18 dist-test-slave-1jjb krb5kdc[3705](info): commencing operation
krb5kdc: starting...
W20260809 15:35:19.697266 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.063s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:35:19 dist-test-slave-1jjb krb5kdc[3705](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289719, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:35:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:35:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.146.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
I20260809 15:35:19.821151 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:37705
--webserver_interface=127.11.146.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:41495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:37705,127.11.146.61:42415,127.11.146.60:35561
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:35:19.930625 3718 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 15:35:19.930949 3718 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:35:19.931022 3718 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:35:19.931098 3718 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:35:19.934998 3718 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:35:19.935073 3718 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:35:19.935119 3718 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:35:19.935156 3718 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:35:19.935189 3718 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:35:19.940289 3718 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:41495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:37705,127.11.146.61:42415,127.11.146.60:35561
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:37705
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3718
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:35:19.941246 3718 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:35:19.942176 3718 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 15:35:19.950614 3718 server_base.cc:1034] running on GCE node
W20260809 15:35:19.950560 3726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:19.950590 3724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:19.950577 3723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:35:19.951422 3718 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:35:19.952514 3718 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:35:19.953697 3718 hybrid_clock.cc:648] HybridClock initialized: now 1786289719953662 us; error 57 us; skew 500 ppm
Aug 09 15:35:19 dist-test-slave-1jjb krb5kdc[3705](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289719, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:35:19.956664 3718 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:35:19.957667 3718 webserver.cc:460] Webserver started at http://127.11.146.62:40301/ using document root <none> and password file <none>
I20260809 15:35:19.958292 3718 fs_manager.cc:359] Metadata directory not provided
I20260809 15:35:19.958357 3718 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:35:19.958617 3718 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:35:19.960873 3718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "0151a0b5a03b4d48865b420de9ae510e"
format_stamp: "Formatted at 2026-08-09 15:35:19 on dist-test-slave-1jjb"
server_key: "e147d3e7e9f66b4452b5b06229fa47b9"
server_key_iv: "f68f61ef123447d380e32aba4bb72a43"
server_key_version: "encryptionkey@0"
I20260809 15:35:19.961658 3718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "0151a0b5a03b4d48865b420de9ae510e"
format_stamp: "Formatted at 2026-08-09 15:35:19 on dist-test-slave-1jjb"
server_key: "e147d3e7e9f66b4452b5b06229fa47b9"
server_key_iv: "f68f61ef123447d380e32aba4bb72a43"
server_key_version: "encryptionkey@0"
I20260809 15:35:19.965487 3718 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 15:35:19.968128 3733 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:35:19.969323 3718 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:35:19.969475 3718 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "0151a0b5a03b4d48865b420de9ae510e"
format_stamp: "Formatted at 2026-08-09 15:35:19 on dist-test-slave-1jjb"
server_key: "e147d3e7e9f66b4452b5b06229fa47b9"
server_key_iv: "f68f61ef123447d380e32aba4bb72a43"
server_key_version: "encryptionkey@0"
I20260809 15:35:19.969594 3718 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:35:19.999697 3718 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:35:20.003072 3718 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:35:20.003276 3718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:35:20.010495 3718 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:37705
I20260809 15:35:20.010773 3789 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:37705 every 8 connection(s)
I20260809 15:35:20.011478 3718 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:35:20.014264 3790 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:35:20.017839 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 3718
I20260809 15:35:20.017968 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:35:20.018298 11848 external_mini_cluster.cc:1428] Setting key cb6df9cdc3dc416e789f9a4803d06d93
I20260809 15:35:20.018126 3790 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37705 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.146.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.61@KRBTEST.COM" created.
Aug 09 15:35:20 dist-test-slave-1jjb krb5kdc[3705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289719, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:35:20.037096 3793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.020735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44782 (local address 127.11.146.62:37705)
0809 15:35:20.021211 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:20.021232 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:20.021489 (+ 257us) server_negotiation.cc:407] Connection header received
0809 15:35:20.022726 (+ 1237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:20.022730 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:20.022895 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:20.023053 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:20.024307 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.025776 (+ 1469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.026725 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.027329 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.027509 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:20.032154 (+ 4645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:20.032160 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:20.032170 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:20.032190 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:20.033893 (+ 1703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:20.034465 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:20.034476 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:20.034477 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:20.034577 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:20.034894 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:20.034897 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:20.034899 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:20.035258 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:20.035410 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:20.035821 (+ 411us) server_negotiation.cc:299] Negotiation successful
0809 15:35:20.036072 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":6,"server-negotiator.queue_time_us":305,"thread_start_us":126,"threads_started":1}
I20260809 15:35:20.037096 3794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.020735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:37705 (local address 127.0.0.1:44782)
0809 15:35:20.021321 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:20.021369 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 15:35:20.022431 (+ 1062us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:35:20.023110 (+ 679us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:35:20.023136 (+ 26us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:35:20.023696 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:35:20.024136 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:20.024159 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.025918 (+ 1759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.025921 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:20.026598 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:20.026607 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.027477 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.027480 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:20.027637 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:20.028252 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:35:20.028268 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:35:20.031988 (+ 3720us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:35:20.034047 (+ 2059us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:20.034057 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:20.034067 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:20.034347 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:20.034681 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:20.034684 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:20.034686 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:20.034799 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:20.035393 (+ 594us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:35:20.035399 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:35:20.035539 (+ 140us) client_negotiation.cc:769] Sending connection context
0809 15:35:20.035727 (+ 188us) client_negotiation.cc:240] Negotiation successful
0809 15:35:20.036152 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":409,"mutex_wait_us":173,"spinlock_wait_cycles":66816,"thread_start_us":171,"threads_started":1}
I20260809 15:35:20.039530 3790 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.61" port: 42415 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:35:20.040282 3794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.039978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:42415 (local address 127.0.0.1:52914)
0809 15:35:20.040157 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:20.040224 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.61:42415: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260809 15:35:20.040524 3734 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.146.61:42415: connect: Connection refused (error 111)
I20260809 15:35:20.041431 3794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.041129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:42415 (local address 127.0.0.1:52916)
0809 15:35:20.041258 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:20.041319 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.61:42415: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 15:35:20.041597 3790 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.146.61:42415: Network error: Client connection negotiation failed: client connection to 127.11.146.61:42415: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.61.keytab.
Entry for principal kudu/127.11.146.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.61.keytab.
I20260809 15:35:20.046872 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.61:42415
--webserver_interface=127.11.146.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.61.keytab
--principal=kudu/127.11.146.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:41495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:37705,127.11.146.61:42415,127.11.146.60:35561
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:35:20.090834 3790 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.61" port: 42415 } attempt: 1
I20260809 15:35:20.091812 3794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.091518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:42415 (local address 127.0.0.1:52922)
0809 15:35:20.091679 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:20.091738 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.61:42415: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260809 15:35:20.092609 3794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.092417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:42415 (local address 127.0.0.1:52934)
0809 15:35:20.092517 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:20.092559 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.61:42415: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 15:35:20.092772 3790 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.146.61:42415: Network error: Client connection negotiation failed: client connection to 127.11.146.61:42415: connect: Connection refused (error 111)
W20260809 15:35:20.158834 3797 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 15:35:20.159078 3797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:35:20.159145 3797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:35:20.159217 3797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260809 15:35:20.160934 3790 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.61" port: 42415 } attempt: 2
I20260809 15:35:20.161757 3794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.161474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:42415 (local address 127.0.0.1:52944)
0809 15:35:20.161624 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:20.161683 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.61:42415: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 15:35:20.162547 3794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.162357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:42415 (local address 127.0.0.1:52948)
0809 15:35:20.162454 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:20.162498 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.61:42415: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260809 15:35:20.162685 3790 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.146.61:42415: Network error: Client connection negotiation failed: client connection to 127.11.146.61:42415: connect: Connection refused (error 111)
W20260809 15:35:20.163744 3797 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:35:20.163796 3797 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:35:20.163836 3797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:35:20.163868 3797 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:35:20.163889 3797 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:35:20.169266 3797 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:41495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:37705,127.11.146.61:42415,127.11.146.60:35561
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.61.keytab
--principal=kudu/127.11.146.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.61:42415
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.146.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3797
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:35:20.170250 3797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:35:20.171231 3797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:35:20.179397 3805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:20.179404 3802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:20.179385 3803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:35:20.179663 3797 server_base.cc:1034] running on GCE node
I20260809 15:35:20.180286 3797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:35:20.181327 3797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:35:20.182509 3797 hybrid_clock.cc:648] HybridClock initialized: now 1786289720182471 us; error 42 us; skew 500 ppm
Aug 09 15:35:20 dist-test-slave-1jjb krb5kdc[3705](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289720, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:35:20.185174 3797 init.cc:377] Logged in from keytab as kudu/127.11.146.61@KRBTEST.COM (short username kudu)
I20260809 15:35:20.186023 3797 webserver.cc:460] Webserver started at http://127.11.146.61:40541/ using document root <none> and password file <none>
I20260809 15:35:20.186594 3797 fs_manager.cc:359] Metadata directory not provided
I20260809 15:35:20.186655 3797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:35:20.186893 3797 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:35:20.189200 3797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-1/data/instance:
uuid: "50d67cf517ce4023893b9dc3f6376f97"
format_stamp: "Formatted at 2026-08-09 15:35:20 on dist-test-slave-1jjb"
server_key: "451b19daa0d0c50d743f263472e34cfd"
server_key_iv: "ba938f582fae78c36ad41a9fb7de18f4"
server_key_version: "encryptionkey@0"
I20260809 15:35:20.189846 3797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-1/wal/instance:
uuid: "50d67cf517ce4023893b9dc3f6376f97"
format_stamp: "Formatted at 2026-08-09 15:35:20 on dist-test-slave-1jjb"
server_key: "451b19daa0d0c50d743f263472e34cfd"
server_key_iv: "ba938f582fae78c36ad41a9fb7de18f4"
server_key_version: "encryptionkey@0"
I20260809 15:35:20.193831 3797 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 15:35:20.196399 3812 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:35:20.197836 3797 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 15:35:20.197981 3797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-1/wal
uuid: "50d67cf517ce4023893b9dc3f6376f97"
format_stamp: "Formatted at 2026-08-09 15:35:20 on dist-test-slave-1jjb"
server_key: "451b19daa0d0c50d743f263472e34cfd"
server_key_iv: "ba938f582fae78c36ad41a9fb7de18f4"
server_key_version: "encryptionkey@0"
I20260809 15:35:20.198097 3797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:35:20.219020 3797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:35:20.221953 3797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:35:20.222158 3797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:35:20.229455 3797 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.61:42415
I20260809 15:35:20.229732 3870 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.61:42415 every 8 connection(s)
I20260809 15:35:20.230409 3797 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-1/data/info.pb
I20260809 15:35:20.233150 3871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:35:20.233191 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 3797
I20260809 15:35:20.233318 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-1/wal/instance
I20260809 15:35:20.233633 11848 external_mini_cluster.cc:1428] Setting key 6f3133f08afaef275e150c1e58c966d7
I20260809 15:35:20.237159 3871 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37705 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.146.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.60@KRBTEST.COM" created.
Aug 09 15:35:20 dist-test-slave-1jjb krb5kdc[3705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289720, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.61@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:35:20.250756 3793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.239145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44794 (local address 127.11.146.62:37705)
0809 15:35:20.239299 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:20.239304 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:20.240097 (+ 793us) server_negotiation.cc:407] Connection header received
0809 15:35:20.240997 (+ 900us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:20.241003 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:20.241072 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:20.241179 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:20.242226 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.243015 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.244225 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.244511 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.244614 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:20.247094 (+ 2480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:20.247098 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:20.247100 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:20.247126 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:20.248614 (+ 1488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:20.249144 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:20.249148 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:20.249152 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:20.249235 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:20.249584 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:20.249589 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:20.249590 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:20.249781 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:20.249891 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:20.250437 (+ 546us) server_negotiation.cc:299] Negotiation successful
0809 15:35:20.250582 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 15:35:20.251474 3874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.239461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:37705 (local address 127.0.0.1:44794)
0809 15:35:20.239906 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:20.239954 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 15:35:20.240779 (+ 825us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:35:20.241314 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:35:20.241320 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:35:20.241627 (+ 307us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:35:20.242071 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:20.242084 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.243135 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.243138 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:20.244036 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:20.244047 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.244654 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.244657 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:20.244842 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:20.245431 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:35:20.245448 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:35:20.246907 (+ 1459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:35:20.248739 (+ 1832us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:20.248745 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:20.248760 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:20.249021 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:20.249340 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:20.249343 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:20.249345 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:20.249486 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:20.249892 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:35:20.249900 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:35:20.250174 (+ 274us) client_negotiation.cc:769] Sending connection context
0809 15:35:20.250380 (+ 206us) client_negotiation.cc:240] Negotiation successful
0809 15:35:20.250696 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":136,"threads_started":1}
I20260809 15:35:20.253051 3871 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.61" port: 42415 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:35:20.253870 3790 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.61" port: 42415 } attempt: 3
Aug 09 15:35:20 dist-test-slave-1jjb krb5kdc[3705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289720, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.61@KRBTEST.COM for kudu/127.11.146.61@KRBTEST.COM
Aug 09 15:35:20 dist-test-slave-1jjb krb5kdc[3705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289719, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for kudu/127.11.146.61@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.60.keytab.
Entry for principal kudu/127.11.146.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.60.keytab.
I20260809 15:35:20.262540 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.60:35561
--webserver_interface=127.11.146.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.60.keytab
--principal=kudu/127.11.146.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:41495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:37705,127.11.146.61:42415,127.11.146.60:35561
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:35:20.265437 3794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.254422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:42415 (local address 127.0.0.1:52962)
0809 15:35:20.254558 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:20.254576 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 15:35:20.254802 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:35:20.255074 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:35:20.255077 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:35:20.255246 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:35:20.255379 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:20.255385 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.256743 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.256747 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:20.258009 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:20.258019 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.258629 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.258635 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:20.258756 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:20.259296 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:35:20.259309 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:35:20.260861 (+ 1552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:35:20.263773 (+ 2912us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:20.263776 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:20.263778 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:20.264044 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:20.264372 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:20.264375 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:20.264377 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:20.264467 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:20.264943 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:35:20.264946 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:35:20.265060 (+ 114us) client_negotiation.cc:769] Sending connection context
0809 15:35:20.265129 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 15:35:20.265280 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 15:35:20.265553 3874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.253552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:42415 (local address 127.0.0.1:52954)
0809 15:35:20.253664 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:20.253679 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 15:35:20.253753 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:35:20.254814 (+ 1061us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:35:20.254817 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:35:20.254985 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:35:20.255203 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:20.255210 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.256743 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.256747 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:20.257654 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:20.257665 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.258385 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.258388 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:20.258464 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:20.259061 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:35:20.259072 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:35:20.260857 (+ 1785us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:35:20.263608 (+ 2751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:20.263614 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:20.263620 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:20.263908 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:20.264279 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:20.264282 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:20.264283 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:20.264369 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:20.264947 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:35:20.264952 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:35:20.265068 (+ 116us) client_negotiation.cc:769] Sending connection context
0809 15:35:20.265192 (+ 124us) client_negotiation.cc:240] Negotiation successful
0809 15:35:20.265340 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":49}
I20260809 15:35:20.265838 3877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.253680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52954 (local address 127.11.146.61:42415)
0809 15:35:20.254372 (+ 692us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:20.254390 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:20.254412 (+ 22us) server_negotiation.cc:407] Connection header received
0809 15:35:20.254468 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:20.254473 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:20.254671 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:20.254816 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:20.255318 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.256608 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.257804 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.258281 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.258385 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:20.260995 (+ 2610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:20.261008 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:20.261025 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:20.261053 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:20.263487 (+ 2434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:20.264053 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:20.264060 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:20.264064 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:20.264182 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:20.264465 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:20.264468 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:20.264470 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:20.264812 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:20.264950 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:20.265298 (+ 348us) server_negotiation.cc:299] Negotiation successful
0809 15:35:20.265435 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":571,"thread_start_us":149,"threads_started":1}
I20260809 15:35:20.266283 3878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.254486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52962 (local address 127.11.146.61:42415)
0809 15:35:20.254795 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:20.254804 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:20.254816 (+ 12us) server_negotiation.cc:407] Connection header received
0809 15:35:20.254895 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:20.254898 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:20.254953 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:20.255022 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:20.255501 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.256608 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.258129 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.258501 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.258759 (+ 258us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:20.261057 (+ 2298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:20.261061 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:20.261063 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:20.261091 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:20.263677 (+ 2586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:20.264190 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:20.264193 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:20.264195 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:20.264273 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:20.264580 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:20.264583 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:20.264585 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:20.264812 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:20.265932 (+ 1120us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:20.266028 (+ 96us) server_negotiation.cc:299] Negotiation successful
0809 15:35:20.266135 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":342,"server-negotiator.queue_time_us":240,"spinlock_wait_cycles":32000,"thread_start_us":101,"threads_started":1}
I20260809 15:35:20.267868 3790 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.60" port: 35561 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:35:20.268652 3794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.268384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:35561 (local address 127.0.0.1:60776)
0809 15:35:20.268526 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:20.268581 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:35561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 15:35:20.269393 3794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.269122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:35561 (local address 127.0.0.1:60788)
0809 15:35:20.269275 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:20.269326 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:35561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
W20260809 15:35:20.269541 3790 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.146.60:35561: Network error: Client connection negotiation failed: client connection to 127.11.146.60:35561: connect: Connection refused (error 111)
I20260809 15:35:20.269479 3871 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.60" port: 35561 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:35:20.270241 3874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.269921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:35561 (local address 127.0.0.1:60792)
0809 15:35:20.270065 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:20.270159 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:35561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260809 15:35:20.270488 3817 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.146.60:35561: connect: Connection refused (error 111)
I20260809 15:35:20.271384 3874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.271106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:35561 (local address 127.0.0.1:60806)
0809 15:35:20.271244 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:20.271308 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:35561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 15:35:20.271552 3871 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.146.60:35561: Network error: Client connection negotiation failed: client connection to 127.11.146.60:35561: connect: Connection refused (error 111)
I20260809 15:35:20.300688 3790 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.60" port: 35561 } attempt: 1
I20260809 15:35:20.301509 3794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.301217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:35561 (local address 127.0.0.1:60820)
0809 15:35:20.301363 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:20.301424 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:35561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260809 15:35:20.302291 3794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.302086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:35561 (local address 127.0.0.1:60824)
0809 15:35:20.302194 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:20.302245 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:35561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 15:35:20.302448 3790 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.146.60:35561: Network error: Client connection negotiation failed: client connection to 127.11.146.60:35561: connect: Connection refused (error 111)
I20260809 15:35:20.320817 3871 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.60" port: 35561 } attempt: 1
I20260809 15:35:20.321609 3874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.321313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:35561 (local address 127.0.0.1:60826)
0809 15:35:20.321461 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:20.321526 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:35561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260809 15:35:20.322330 3874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.322106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:35561 (local address 127.0.0.1:60840)
0809 15:35:20.322218 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:20.322269 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:35561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 15:35:20.322460 3871 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.146.60:35561: Network error: Client connection negotiation failed: client connection to 127.11.146.60:35561: connect: Connection refused (error 111)
W20260809 15:35:20.376977 3880 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 15:35:20.377220 3880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:35:20.377242 3880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:35:20.377279 3880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260809 15:35:20.377604 3790 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.60" port: 35561 } attempt: 2
I20260809 15:35:20.378386 3794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.378087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:35561 (local address 127.0.0.1:60848)
0809 15:35:20.378239 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:20.378307 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:35561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260809 15:35:20.379194 3794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.378973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:35561 (local address 127.0.0.1:60850)
0809 15:35:20.379088 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:20.379139 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:35561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 15:35:20.379314 3790 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.146.60:35561: Network error: Client connection negotiation failed: client connection to 127.11.146.60:35561: connect: Connection refused (error 111)
W20260809 15:35:20.381608 3880 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:35:20.381681 3880 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:35:20.381726 3880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:35:20.381781 3880 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:35:20.381820 3880 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:35:20.386904 3880 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:41495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:37705,127.11.146.61:42415,127.11.146.60:35561
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.60.keytab
--principal=kudu/127.11.146.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.60:35561
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.146.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3880
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:35:20.387908 3880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:35:20.388957 3880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 15:35:20.390641 3871 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.60" port: 35561 } attempt: 2
I20260809 15:35:20.391384 3874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.391076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:35561 (local address 127.0.0.1:60858)
0809 15:35:20.391221 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:20.391284 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:35561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260809 15:35:20.392109 3874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.391858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:35561 (local address 127.0.0.1:60866)
0809 15:35:20.391980 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:20.392030 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:35561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 15:35:20.392251 3871 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.146.60:35561: Network error: Client connection negotiation failed: client connection to 127.11.146.60:35561: connect: Connection refused (error 111)
W20260809 15:35:20.397333 3887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:20.397351 3889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:20.397392 3886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:35:20.397550 3880 server_base.cc:1034] running on GCE node
I20260809 15:35:20.398118 3880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:35:20.399159 3880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:35:20.400337 3880 hybrid_clock.cc:648] HybridClock initialized: now 1786289720400301 us; error 49 us; skew 500 ppm
Aug 09 15:35:20 dist-test-slave-1jjb krb5kdc[3705](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289720, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:35:20.403026 3880 init.cc:377] Logged in from keytab as kudu/127.11.146.60@KRBTEST.COM (short username kudu)
I20260809 15:35:20.403761 3880 webserver.cc:460] Webserver started at http://127.11.146.60:35855/ using document root <none> and password file <none>
I20260809 15:35:20.404313 3880 fs_manager.cc:359] Metadata directory not provided
I20260809 15:35:20.404373 3880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:35:20.404527 3880 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:35:20.406334 3880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-2/data/instance:
uuid: "627af65822ec448495414d073f8a7562"
format_stamp: "Formatted at 2026-08-09 15:35:20 on dist-test-slave-1jjb"
server_key: "a6366824a92f6e5724b7c8d0c1c89915"
server_key_iv: "90e33bb449c81011a16a75459adb6b6f"
server_key_version: "encryptionkey@0"
I20260809 15:35:20.406781 3880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-2/wal/instance:
uuid: "627af65822ec448495414d073f8a7562"
format_stamp: "Formatted at 2026-08-09 15:35:20 on dist-test-slave-1jjb"
server_key: "a6366824a92f6e5724b7c8d0c1c89915"
server_key_iv: "90e33bb449c81011a16a75459adb6b6f"
server_key_version: "encryptionkey@0"
I20260809 15:35:20.410306 3880 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260809 15:35:20.412493 3896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:35:20.413580 3880 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:35:20.413694 3880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-2/wal
uuid: "627af65822ec448495414d073f8a7562"
format_stamp: "Formatted at 2026-08-09 15:35:20 on dist-test-slave-1jjb"
server_key: "a6366824a92f6e5724b7c8d0c1c89915"
server_key_iv: "90e33bb449c81011a16a75459adb6b6f"
server_key_version: "encryptionkey@0"
I20260809 15:35:20.413784 3880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:35:20.430435 3880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:35:20.433118 3880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:35:20.433341 3880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:35:20.439754 3880 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.60:35561
I20260809 15:35:20.439987 3953 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.60:35561 every 8 connection(s)
I20260809 15:35:20.440716 3880 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-2/data/info.pb
I20260809 15:35:20.443252 3954 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:35:20.446632 3954 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37705 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:35:20.450091 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 3880
I20260809 15:35:20.450225 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786289437399694-11848-0/minicluster-data/master-2/wal/instance
I20260809 15:35:20.450528 11848 external_mini_cluster.cc:1428] Setting key 8c1c420e8305447d0e9de2faebe2b33f
Aug 09 15:35:20 dist-test-slave-1jjb krb5kdc[3705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289720, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.60@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
Aug 09 15:35:20 dist-test-slave-1jjb krb5kdc[3705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289719, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.60@KRBTEST.COM
I20260809 15:35:20.461357 3793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.448341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44810 (local address 127.11.146.62:37705)
0809 15:35:20.448465 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:20.448469 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:20.449178 (+ 709us) server_negotiation.cc:407] Connection header received
0809 15:35:20.450205 (+ 1027us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:20.450211 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:20.450302 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:20.450409 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:20.451870 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.452687 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.454293 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.454631 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.454750 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:20.457103 (+ 2353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:20.457110 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:20.457115 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:20.457172 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:20.458829 (+ 1657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:20.459587 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:20.459591 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:20.459593 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:20.459745 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:20.460185 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:20.460191 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:20.460196 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:20.460466 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:20.460582 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:20.461061 (+ 479us) server_negotiation.cc:299] Negotiation successful
0809 15:35:20.461183 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 15:35:20.462258 3956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.448615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:37705 (local address 127.0.0.1:44810)
0809 15:35:20.449009 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:20.449046 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 15:35:20.449935 (+ 889us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:35:20.450578 (+ 643us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:35:20.450584 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:35:20.451054 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:35:20.451712 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:20.451728 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.452832 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.452835 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:20.454142 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:20.454154 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.454787 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.454790 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:20.454934 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:20.455473 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:35:20.455493 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:35:20.456954 (+ 1461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:35:20.458965 (+ 2011us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:20.458974 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:20.458984 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:20.459382 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:20.459869 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:20.459874 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:20.459879 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:20.460062 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:20.460579 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:35:20.460586 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:35:20.460822 (+ 236us) client_negotiation.cc:769] Sending connection context
0809 15:35:20.461006 (+ 184us) client_negotiation.cc:240] Negotiation successful
0809 15:35:20.461297 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":41,"thread_start_us":103,"threads_started":1}
I20260809 15:35:20.462265 3958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.451257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60874 (local address 127.11.146.60:35561)
0809 15:35:20.451628 (+ 371us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:20.451639 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:20.451663 (+ 24us) server_negotiation.cc:407] Connection header received
0809 15:35:20.451728 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:20.451734 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:20.451918 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:20.452038 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:20.452948 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.454185 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.455188 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.455645 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.455755 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:20.458499 (+ 2744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:20.458505 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:20.458515 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:20.458535 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:20.460412 (+ 1877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:20.460825 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:20.460830 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:20.460832 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:20.460924 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:20.461222 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:20.461225 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:20.461227 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:20.461508 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:20.461681 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:20.461868 (+ 187us) server_negotiation.cc:299] Negotiation successful
0809 15:35:20.461997 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":281,"thread_start_us":151,"threads_started":1}
I20260809 15:35:20.463459 3954 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.61" port: 42415 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 15:35:20 dist-test-slave-1jjb krb5kdc[3705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289720, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.60@KRBTEST.COM for kudu/127.11.146.61@KRBTEST.COM
Aug 09 15:35:20 dist-test-slave-1jjb krb5kdc[3705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289719, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:35:20.471853 3956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.463874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:42415 (local address 127.0.0.1:52972)
0809 15:35:20.463996 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:20.464014 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 15:35:20.464110 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:35:20.464469 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:35:20.464472 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:35:20.464633 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:35:20.464752 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:20.464758 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.465493 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.465497 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:20.465985 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:20.465992 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.466446 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.466450 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:20.466542 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:20.466965 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:35:20.466978 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:35:20.468475 (+ 1497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:35:20.470330 (+ 1855us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:20.470333 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:20.470335 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:20.470585 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:20.470913 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:20.470915 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:20.470917 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:20.471025 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:20.471378 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:35:20.471381 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:35:20.471508 (+ 127us) client_negotiation.cc:769] Sending connection context
0809 15:35:20.471626 (+ 118us) client_negotiation.cc:240] Negotiation successful
0809 15:35:20.471753 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260809 15:35:20.471997 3877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.464117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52972 (local address 127.11.146.61:42415)
0809 15:35:20.464270 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:20.464274 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:20.464284 (+ 10us) server_negotiation.cc:407] Connection header received
0809 15:35:20.464321 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:20.464323 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:20.464360 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:20.464456 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:20.464870 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.465362 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.466103 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.466335 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.466447 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:20.468631 (+ 2184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:20.468634 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:20.468637 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:20.468668 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:20.470169 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:20.470703 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:20.470708 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:20.470711 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:20.470801 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:20.471119 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:20.471121 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:20.471122 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:20.471274 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:20.471351 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:20.471712 (+ 361us) server_negotiation.cc:299] Negotiation successful
0809 15:35:20.471835 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 15:35:20.472831 3954 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.60" port: 35561 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:35:20.473506 3793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.464626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44826 (local address 127.11.146.62:37705)
0809 15:35:20.464734 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:20.464738 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:20.464753 (+ 15us) server_negotiation.cc:407] Connection header received
0809 15:35:20.464801 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:20.464804 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:20.464840 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:20.464929 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:20.465522 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.465964 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.466673 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.466893 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.466996 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:20.469844 (+ 2848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:20.469848 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:20.469850 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:20.469882 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:20.471575 (+ 1693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:20.472206 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:20.472210 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:20.472212 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:20.472295 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:20.472611 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:20.472614 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:20.472615 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:20.472825 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:20.473033 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:20.473236 (+ 203us) server_negotiation.cc:299] Negotiation successful
0809 15:35:20.473345 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
Aug 09 15:35:20 dist-test-slave-1jjb krb5kdc[3705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289720, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.60@KRBTEST.COM for kudu/127.11.146.60@KRBTEST.COM
I20260809 15:35:20.478468 3790 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.60" port: 35561 } attempt: 3
Aug 09 15:35:20 dist-test-slave-1jjb krb5kdc[3705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289719, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.61@KRBTEST.COM
I20260809 15:35:20.481292 3956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.473318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:35561 (local address 127.0.0.1:60890)
0809 15:35:20.473403 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:20.473416 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:35:20.473499 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:35:20.473898 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:35:20.473901 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:35:20.474065 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:35:20.474154 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:20.474160 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.475106 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.475108 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:20.475579 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:20.475588 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.476001 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.476004 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:20.476076 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:20.476558 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:35:20.476570 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:35:20.477825 (+ 1255us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:35:20.479597 (+ 1772us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:20.479601 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:20.479602 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:20.479854 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:20.480178 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:20.480183 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:20.480185 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:20.480266 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:20.480840 (+ 574us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:35:20.480844 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:35:20.480951 (+ 107us) client_negotiation.cc:769] Sending connection context
0809 15:35:20.481066 (+ 115us) client_negotiation.cc:240] Negotiation successful
0809 15:35:20.481197 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260809 15:35:20.481720 3958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.473585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60890 (local address 127.11.146.60:35561)
0809 15:35:20.473681 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:20.473684 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:20.473693 (+ 9us) server_negotiation.cc:407] Connection header received
0809 15:35:20.473718 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:20.473720 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:20.473786 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:20.473872 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:20.474303 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.475002 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.475687 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.475890 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.475975 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:20.477947 (+ 1972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:20.477950 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:20.477952 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:20.477973 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:20.479516 (+ 1543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:20.479962 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:20.479967 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:20.479969 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:20.480055 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:20.480569 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:20.480572 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:20.480573 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:20.480737 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:20.480839 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:20.481514 (+ 675us) server_negotiation.cc:299] Negotiation successful
0809 15:35:20.481616 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 15:35:20.483422 3871 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.60" port: 35561 } attempt: 3
I20260809 15:35:20.484541 3877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.474658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52976 (local address 127.11.146.61:42415)
0809 15:35:20.474758 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:20.474762 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:20.474781 (+ 19us) server_negotiation.cc:407] Connection header received
0809 15:35:20.474874 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:20.474876 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:20.474931 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:20.474986 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:20.475534 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.476065 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.476758 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.477113 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.477192 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:20.480062 (+ 2870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:20.480069 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:20.480092 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:20.480123 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:20.482177 (+ 2054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:20.482628 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:20.482632 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:20.482633 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:20.482719 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:20.483040 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:20.483043 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:20.483045 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:20.483261 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:20.484178 (+ 917us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:20.484237 (+ 59us) server_negotiation.cc:299] Negotiation successful
0809 15:35:20.484316 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
Aug 09 15:35:20 dist-test-slave-1jjb krb5kdc[3705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289719, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for kudu/127.11.146.60@KRBTEST.COM
I20260809 15:35:20.485280 3954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 627af65822ec448495414d073f8a7562: Bootstrap starting.
I20260809 15:35:20.488476 11848 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:35:20.488637 3954 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 627af65822ec448495414d073f8a7562: Neither blocks nor log segments found. Creating new log.
I20260809 15:35:20.488819 3794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.478843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:35561 (local address 127.0.0.1:60902)
0809 15:35:20.478964 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:20.478977 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:35:20.479070 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:35:20.479918 (+ 848us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:35:20.479921 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:35:20.480177 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:35:20.480293 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:20.480304 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.481936 (+ 1632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.481940 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:20.482661 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:20.482670 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.483136 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.483140 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:20.483229 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:20.483645 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:35:20.483664 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:35:20.485249 (+ 1585us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:35:20.487214 (+ 1965us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:20.487217 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:20.487219 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:20.487463 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:20.487780 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:20.487784 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:20.487785 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:20.487881 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:20.488392 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:35:20.488395 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:35:20.488494 (+ 99us) client_negotiation.cc:769] Sending connection context
0809 15:35:20.488580 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 15:35:20.488691 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
Aug 09 15:35:20 dist-test-slave-1jjb krb5kdc[3705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289720, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.61@KRBTEST.COM for kudu/127.11.146.60@KRBTEST.COM
I20260809 15:35:20.489506 3959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.479354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60902 (local address 127.11.146.60:35561)
0809 15:35:20.479657 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:20.479669 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:20.479683 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:35:20.479713 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:20.479716 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:20.479756 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:20.480413 (+ 657us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:20.480512 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.481834 (+ 1322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.482768 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.483032 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.483143 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:20.485439 (+ 2296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:20.485444 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:20.485450 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:20.485478 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:20.487099 (+ 1621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:20.487577 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:20.487583 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:20.487586 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:20.487673 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:20.488014 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:20.488018 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:20.488020 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:20.488273 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:20.489115 (+ 842us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:20.489206 (+ 91us) server_negotiation.cc:299] Negotiation successful
0809 15:35:20.489318 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":236,"thread_start_us":104,"threads_started":1}
I20260809 15:35:20.489569 3954 log.cc:824] T 00000000000000000000000000000000 P 627af65822ec448495414d073f8a7562: Log is configured to *not* fsync() on all Append() calls
I20260809 15:35:20.490295 3763 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "0151a0b5a03b4d48865b420de9ae510e"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44826
I20260809 15:35:20.491887 3954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 627af65822ec448495414d073f8a7562: No bootstrap required, opened a new log
I20260809 15:35:20.492517 3790 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0151a0b5a03b4d48865b420de9ae510e: Bootstrap starting.
I20260809 15:35:20.493132 3874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.483761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:35561 (local address 127.0.0.1:60908)
0809 15:35:20.483912 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:20.483926 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 15:35:20.483993 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:35:20.484829 (+ 836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:35:20.484832 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:35:20.485006 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:35:20.485089 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:20.485095 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.486284 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.486287 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:20.487008 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:20.487019 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.487573 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.487577 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:20.487651 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:20.488111 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:35:20.488124 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:35:20.489470 (+ 1346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:35:20.491446 (+ 1976us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:20.491449 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:20.491451 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:20.491716 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:20.492112 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:20.492115 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:20.492117 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:20.492214 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:20.492675 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:35:20.492678 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:35:20.492768 (+ 90us) client_negotiation.cc:769] Sending connection context
0809 15:35:20.492880 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 15:35:20.493003 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93}
I20260809 15:35:20.493192 3958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.484214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60908 (local address 127.11.146.60:35561)
0809 15:35:20.484418 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:20.484422 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:20.484435 (+ 13us) server_negotiation.cc:407] Connection header received
0809 15:35:20.484465 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:20.484468 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:20.484509 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:20.485459 (+ 950us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:20.485541 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.486156 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.487156 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.487448 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.487842 (+ 394us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:20.489618 (+ 1776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:20.489621 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:20.489624 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:20.489648 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:20.491322 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:20.491839 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:20.491842 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:20.491844 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:20.491926 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:20.492328 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:20.492331 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:20.492333 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:20.492521 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:20.492615 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:20.492952 (+ 337us) server_negotiation.cc:299] Negotiation successful
0809 15:35:20.493062 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143}
I20260809 15:35:20.495059 3790 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0151a0b5a03b4d48865b420de9ae510e: Neither blocks nor log segments found. Creating new log.
I20260809 15:35:20.495826 3871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50d67cf517ce4023893b9dc3f6376f97: Bootstrap starting.
I20260809 15:35:20.495862 3790 log.cc:824] T 00000000000000000000000000000000 P 0151a0b5a03b4d48865b420de9ae510e: Log is configured to *not* fsync() on all Append() calls
I20260809 15:35:20.495910 3954 raft_consensus.cc:348] T 00000000000000000000000000000000 P 627af65822ec448495414d073f8a7562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0151a0b5a03b4d48865b420de9ae510e" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37705 } } peers { permanent_uuid: "50d67cf517ce4023893b9dc3f6376f97" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 42415 } } peers { permanent_uuid: "627af65822ec448495414d073f8a7562" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 35561 } }
I20260809 15:35:20.496207 3954 raft_consensus.cc:729] T 00000000000000000000000000000000 P 627af65822ec448495414d073f8a7562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 627af65822ec448495414d073f8a7562, State: Initialized, Role: FOLLOWER
I20260809 15:35:20.496541 3954 consensus_queue.cc:260] T 00000000000000000000000000000000 P 627af65822ec448495414d073f8a7562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0151a0b5a03b4d48865b420de9ae510e" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37705 } } peers { permanent_uuid: "50d67cf517ce4023893b9dc3f6376f97" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 42415 } } peers { permanent_uuid: "627af65822ec448495414d073f8a7562" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 35561 } }
I20260809 15:35:20.497076 3962 sys_catalog.cc:455] T 00000000000000000000000000000000 P 627af65822ec448495414d073f8a7562 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0151a0b5a03b4d48865b420de9ae510e" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37705 } } peers { permanent_uuid: "50d67cf517ce4023893b9dc3f6376f97" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 42415 } } peers { permanent_uuid: "627af65822ec448495414d073f8a7562" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 35561 } } }
I20260809 15:35:20.497294 3962 sys_catalog.cc:458] T 00000000000000000000000000000000 P 627af65822ec448495414d073f8a7562 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:35:20.497822 3954 sys_catalog.cc:564] T 00000000000000000000000000000000 P 627af65822ec448495414d073f8a7562 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:35:20.497875 3790 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0151a0b5a03b4d48865b420de9ae510e: No bootstrap required, opened a new log
I20260809 15:35:20.498180 3871 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 50d67cf517ce4023893b9dc3f6376f97: Neither blocks nor log segments found. Creating new log.
I20260809 15:35:20.498973 3871 log.cc:824] T 00000000000000000000000000000000 P 50d67cf517ce4023893b9dc3f6376f97: Log is configured to *not* fsync() on all Append() calls
I20260809 15:35:20.500897 3790 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0151a0b5a03b4d48865b420de9ae510e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0151a0b5a03b4d48865b420de9ae510e" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37705 } } peers { permanent_uuid: "50d67cf517ce4023893b9dc3f6376f97" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 42415 } } peers { permanent_uuid: "627af65822ec448495414d073f8a7562" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 35561 } }
I20260809 15:35:20.501039 3790 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0151a0b5a03b4d48865b420de9ae510e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0151a0b5a03b4d48865b420de9ae510e, State: Initialized, Role: FOLLOWER
I20260809 15:35:20.501101 3871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50d67cf517ce4023893b9dc3f6376f97: No bootstrap required, opened a new log
I20260809 15:35:20.501296 3790 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0151a0b5a03b4d48865b420de9ae510e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0151a0b5a03b4d48865b420de9ae510e" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37705 } } peers { permanent_uuid: "50d67cf517ce4023893b9dc3f6376f97" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 42415 } } peers { permanent_uuid: "627af65822ec448495414d073f8a7562" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 35561 } }
I20260809 15:35:20.502957 3790 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0151a0b5a03b4d48865b420de9ae510e [sys.catalog]: configured and running, proceeding with master startup.
W20260809 15:35:20.503324 3976 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 627af65822ec448495414d073f8a7562: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:35:20.503401 3976 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:35:20.504758 3871 raft_consensus.cc:348] T 00000000000000000000000000000000 P 50d67cf517ce4023893b9dc3f6376f97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0151a0b5a03b4d48865b420de9ae510e" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37705 } } peers { permanent_uuid: "50d67cf517ce4023893b9dc3f6376f97" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 42415 } } peers { permanent_uuid: "627af65822ec448495414d073f8a7562" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 35561 } }
W20260809 15:35:20.504904 3741 tablet.cc:2369] T 00000000000000000000000000000000 P 0151a0b5a03b4d48865b420de9ae510e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:35:20.504961 3871 raft_consensus.cc:729] T 00000000000000000000000000000000 P 50d67cf517ce4023893b9dc3f6376f97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50d67cf517ce4023893b9dc3f6376f97, State: Initialized, Role: FOLLOWER
I20260809 15:35:20.501471 3880 master_runner.cc:186] Error getting master registration for 127.11.146.62:37705: OK, instance_id { permanent_uuid: "0151a0b5a03b4d48865b420de9ae510e" instance_seqno: 1786289720008618 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 15:35:20.505265 3871 consensus_queue.cc:260] T 00000000000000000000000000000000 P 50d67cf517ce4023893b9dc3f6376f97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0151a0b5a03b4d48865b420de9ae510e" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37705 } } peers { permanent_uuid: "50d67cf517ce4023893b9dc3f6376f97" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 42415 } } peers { permanent_uuid: "627af65822ec448495414d073f8a7562" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 35561 } }
I20260809 15:35:20.505435 3880 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 15:35:20.506383 3871 sys_catalog.cc:564] T 00000000000000000000000000000000 P 50d67cf517ce4023893b9dc3f6376f97 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:35:20.508210 3763 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0151a0b5a03b4d48865b420de9ae510e [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 15:35:20.508340 3763 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0151a0b5a03b4d48865b420de9ae510e [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:35:20.509730 3763 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0151a0b5a03b4d48865b420de9ae510e [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0151a0b5a03b4d48865b420de9ae510e" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37705 } } peers { permanent_uuid: "50d67cf517ce4023893b9dc3f6376f97" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 42415 } } peers { permanent_uuid: "627af65822ec448495414d073f8a7562" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 35561 } }
I20260809 15:35:20.510638 3763 leader_election.cc:288] T 00000000000000000000000000000000 P 0151a0b5a03b4d48865b420de9ae510e [CANDIDATE]: Term 1 election: Requested vote from peers 50d67cf517ce4023893b9dc3f6376f97 (127.11.146.61:42415), 627af65822ec448495414d073f8a7562 (127.11.146.60:35561)
I20260809 15:35:20.507701 3718 master_runner.cc:186] Error getting master registration for 127.11.146.61:42415: OK, instance_id { permanent_uuid: "50d67cf517ce4023893b9dc3f6376f97" instance_seqno: 1786289720227454 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 15:35:20.511014 3718 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 15:35:20.511073 3843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0151a0b5a03b4d48865b420de9ae510e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "50d67cf517ce4023893b9dc3f6376f97"
I20260809 15:35:20.511264 3843 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 50d67cf517ce4023893b9dc3f6376f97 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:35:20.511308 3925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0151a0b5a03b4d48865b420de9ae510e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "627af65822ec448495414d073f8a7562"
I20260809 15:35:20.511499 3925 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 627af65822ec448495414d073f8a7562 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:35:20.512252 3843 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 50d67cf517ce4023893b9dc3f6376f97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0151a0b5a03b4d48865b420de9ae510e in term 1.
I20260809 15:35:20.512239 3978 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0151a0b5a03b4d48865b420de9ae510e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0151a0b5a03b4d48865b420de9ae510e" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37705 } } peers { permanent_uuid: "50d67cf517ce4023893b9dc3f6376f97" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 42415 } } peers { permanent_uuid: "627af65822ec448495414d073f8a7562" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 35561 } } }
I20260809 15:35:20.512341 3978 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0151a0b5a03b4d48865b420de9ae510e [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:35:20.512570 3990 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50d67cf517ce4023893b9dc3f6376f97 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0151a0b5a03b4d48865b420de9ae510e" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37705 } } peers { permanent_uuid: "50d67cf517ce4023893b9dc3f6376f97" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 42415 } } peers { permanent_uuid: "627af65822ec448495414d073f8a7562" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 35561 } } }
I20260809 15:35:20.512717 3990 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50d67cf517ce4023893b9dc3f6376f97 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:35:20.512776 3925 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 627af65822ec448495414d073f8a7562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0151a0b5a03b4d48865b420de9ae510e in term 1.
I20260809 15:35:20.513226 3736 leader_election.cc:302] T 00000000000000000000000000000000 P 0151a0b5a03b4d48865b420de9ae510e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0151a0b5a03b4d48865b420de9ae510e, 627af65822ec448495414d073f8a7562; no voters:
I20260809 15:35:20.513510 3978 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0151a0b5a03b4d48865b420de9ae510e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:35:20.513720 3978 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0151a0b5a03b4d48865b420de9ae510e [term 1 LEADER]: Becoming Leader. State: Replica: 0151a0b5a03b4d48865b420de9ae510e, State: Running, Role: LEADER
I20260809 15:35:20.514038 3978 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0151a0b5a03b4d48865b420de9ae510e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0151a0b5a03b4d48865b420de9ae510e" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37705 } } peers { permanent_uuid: "50d67cf517ce4023893b9dc3f6376f97" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 42415 } } peers { permanent_uuid: "627af65822ec448495414d073f8a7562" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 35561 } }
I20260809 15:35:20.517948 4000 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0151a0b5a03b4d48865b420de9ae510e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0151a0b5a03b4d48865b420de9ae510e. Latest consensus state: current_term: 1 leader_uuid: "0151a0b5a03b4d48865b420de9ae510e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0151a0b5a03b4d48865b420de9ae510e" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37705 } } peers { permanent_uuid: "50d67cf517ce4023893b9dc3f6376f97" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 42415 } } peers { permanent_uuid: "627af65822ec448495414d073f8a7562" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 35561 } } }
I20260809 15:35:20.518106 4000 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0151a0b5a03b4d48865b420de9ae510e [sys.catalog]: This master's current role is: LEADER
W20260809 15:35:20.521458 4009 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 50d67cf517ce4023893b9dc3f6376f97: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:35:20.521544 4009 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260809 15:35:20.521723 3989 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0151a0b5a03b4d48865b420de9ae510e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:35:20.521785 3989 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:35:20.528337 4011 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:35:20.529268 3793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.514994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44838 (local address 127.11.146.62:37705)
0809 15:35:20.515106 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:20.515111 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:20.515699 (+ 588us) server_negotiation.cc:407] Connection header received
0809 15:35:20.515834 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:20.515837 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:20.515894 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:20.515981 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:20.521432 (+ 5451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.522088 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.523018 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.523324 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.523419 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:20.525263 (+ 1844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:20.525266 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:20.525269 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:20.525293 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:20.527142 (+ 1849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:20.527634 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:20.527638 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:20.527639 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:20.527724 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:20.528057 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:20.528060 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:20.528062 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:20.528327 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:20.528450 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:20.528907 (+ 457us) server_negotiation.cc:299] Negotiation successful
0809 15:35:20.529035 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 15:35:20.533516 3877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.515050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52988 (local address 127.11.146.61:42415)
0809 15:35:20.515459 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:20.515463 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:20.516001 (+ 538us) server_negotiation.cc:407] Connection header received
0809 15:35:20.516179 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:20.516182 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:20.516219 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:20.516265 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:20.519557 (+ 3292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.520267 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.525065 (+ 4798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.525388 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.525472 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:20.529651 (+ 4179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:20.529655 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:20.529658 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:20.529687 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:20.531507 (+ 1820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:20.532030 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:20.532035 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:20.532038 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:20.532156 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:20.532530 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:20.532537 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:20.532539 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:20.532766 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:20.532899 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:20.533226 (+ 327us) server_negotiation.cc:299] Negotiation successful
0809 15:35:20.533342 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340}
I20260809 15:35:20.534159 3959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:20.515312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60922 (local address 127.11.146.60:35561)
0809 15:35:20.515433 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:20.515437 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:20.518250 (+ 2813us) server_negotiation.cc:407] Connection header received
0809 15:35:20.518488 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:20.518493 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:20.518537 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:20.518585 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:20.523065 (+ 4480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.523782 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.527384 (+ 3602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:20.527812 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:20.527884 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:20.530131 (+ 2247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:20.530140 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:20.530145 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:20.530177 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:20.532179 (+ 2002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:20.532681 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:20.532684 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:20.532685 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:20.532762 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:20.533066 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:20.533069 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:20.533071 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:20.533280 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:20.533414 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:20.533885 (+ 471us) server_negotiation.cc:299] Negotiation successful
0809 15:35:20.534001 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 15:35:20.529278 4011 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:35:20.545611 3843 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 50d67cf517ce4023893b9dc3f6376f97 [term 1 FOLLOWER]: Refusing update from remote peer 0151a0b5a03b4d48865b420de9ae510e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:35:20.545667 3925 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 627af65822ec448495414d073f8a7562 [term 1 FOLLOWER]: Refusing update from remote peer 0151a0b5a03b4d48865b420de9ae510e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:35:20.546277 4000 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0151a0b5a03b4d48865b420de9ae510e [LEADER]: Connected to new peer: Peer: permanent_uuid: "627af65822ec448495414d073f8a7562" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 35561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:35:20.546679 4000 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0151a0b5a03b4d48865b420de9ae510e [LEADER]: Connected to new peer: Peer: permanent_uuid: "50d67cf517ce4023893b9dc3f6376f97" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 42415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:35:20.553184 3962 sys_catalog.cc:455] T 00000000000000000000000000000000 P 627af65822ec448495414d073f8a7562 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0151a0b5a03b4d48865b420de9ae510e. Latest consensus state: current_term: 1 leader_uuid: "0151a0b5a03b4d48865b420de9ae510e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0151a0b5a03b4d48865b420de9ae510e" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37705 } } peers { permanent_uuid: "50d67cf517ce4023893b9dc3f6376f97" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 42415 } } peers { permanent_uuid: "627af65822ec448495414d073f8a7562" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 35561 } } }
I20260809 15:35:20.553289 3962 sys_catalog.cc:458] T 00000000000000000000000000000000 P 627af65822ec448495414d073f8a7562 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:35:20.555827 3990 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50d67cf517ce4023893b9dc3f6376f97 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0151a0b5a03b4d48865b420de9ae510e. Latest consensus state: current_term: 1 leader_uuid: "0151a0b5a03b4d48865b420de9ae510e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0151a0b5a03b4d48865b420de9ae510e" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37705 } } peers { permanent_uuid: "50d67cf517ce4023893b9dc3f6376f97" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 42415 } } peers { permanent_uuid: "627af65822ec448495414d073f8a7562" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 35561 } } }
I20260809 15:35:20.555929 3990 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50d67cf517ce4023893b9dc3f6376f97 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:35:20.559176 3978 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0151a0b5a03b4d48865b420de9ae510e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0151a0b5a03b4d48865b420de9ae510e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0151a0b5a03b4d48865b420de9ae510e" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37705 } } peers { permanent_uuid: "50d67cf517ce4023893b9dc3f6376f97" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 42415 } } peers { permanent_uuid: "627af65822ec448495414d073f8a7562" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 35561 } } }
I20260809 15:35:20.559293 3978 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0151a0b5a03b4d48865b420de9ae510e [sys.catalog]: This master's current role is: LEADER
I20260809 15:35:20.560407 3990 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50d67cf517ce4023893b9dc3f6376f97 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0151a0b5a03b4d48865b420de9ae510e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0151a0b5a03b4d48865b420de9ae510e" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37705 } } peers { permanent_uuid: "50d67cf517ce4023893b9dc3f6376f97" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 42415 } } peers { permanent_uuid: "627af65822ec448495414d073f8a7562" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 35561 } } }
I20260809 15:35:20.560513 3990 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50d67cf517ce4023893b9dc3f6376f97 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:35:20.561003 4014 mvcc.cc:205] Tried to move back new op lower bound from 7316642695346712576 to 7316642695233253376. Current Snapshot: MvccSnapshot[applied={T|T < 7316642695346712576}]
I20260809 15:35:20.564690 4018 mvcc.cc:205] Tried to move back new op lower bound from 7316642695346712576 to 7316642695233253376. Current Snapshot: MvccSnapshot[applied={T|T < 7316642695346712576}]
I20260809 15:35:20.564644 4000 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0151a0b5a03b4d48865b420de9ae510e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0151a0b5a03b4d48865b420de9ae510e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0151a0b5a03b4d48865b420de9ae510e" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37705 } } peers { permanent_uuid: "50d67cf517ce4023893b9dc3f6376f97" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 42415 } } peers { permanent_uuid: "627af65822ec448495414d073f8a7562" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 35561 } } }
I20260809 15:35:20.564749 4000 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0151a0b5a03b4d48865b420de9ae510e [sys.catalog]: This master's current role is: LEADER
I20260809 15:35:20.565618 3962 sys_catalog.cc:455] T 00000000000000000000000000000000 P 627af65822ec448495414d073f8a7562 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0151a0b5a03b4d48865b420de9ae510e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0151a0b5a03b4d48865b420de9ae510e" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 37705 } } peers { permanent_uuid: "50d67cf517ce4023893b9dc3f6376f97" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 42415 } } peers { permanent_uuid: "627af65822ec448495414d073f8a7562" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 35561 } } }
I20260809 15:35:20.565727 3962 sys_catalog.cc:458] T 00000000000000000000000000000000 P 627af65822ec448495414d073f8a7562 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:35:20.566016 4016 mvcc.cc:205] Tried to move back new op lower bound from 7316642695346712576 to 7316642695233253376. Current Snapshot: MvccSnapshot[applied={T|T < 7316642695346712576}]
I20260809 15:35:20.567579 4011 catalog_manager.cc:1347] Generated new cluster ID: ca68d2780f514aed97e5d867ac4661b9
I20260809 15:35:20.567636 4011 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:35:20.596520 4011 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:35:20.597733 4011 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:35:20.612021 4011 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0151a0b5a03b4d48865b420de9ae510e: Generated new TSK 0
I20260809 15:35:20.612846 4011 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 15:35:20.644790 3959 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:35:20.641912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60930 (local address 127.11.146.60:35561)
0809 15:35:20.642062 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:20.642068 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:20.643751 (+ 1683us) server_negotiation.cc:407] Connection header received
0809 15:35:20.643936 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:20.643940 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:20.643999 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:20.644051 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:20.644676 (+ 625us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60930: BlockingRecv error: recv got EOF from 127.0.0.1:60930 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260809 15:35:20.646272 3793 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:35:20.642612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44854 (local address 127.11.146.62:37705)
0809 15:35:20.642721 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:20.642727 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:20.645442 (+ 2715us) server_negotiation.cc:407] Connection header received
0809 15:35:20.645604 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:20.645607 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:20.645650 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:20.645697 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:20.646166 (+ 469us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44854: BlockingRecv error: recv got EOF from 127.0.0.1:44854 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260809 15:35:20.647689 3877 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:35:20.643190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52992 (local address 127.11.146.61:42415)
0809 15:35:20.643295 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:20.643299 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:20.646884 (+ 3585us) server_negotiation.cc:407] Connection header received
0809 15:35:20.647054 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:20.647057 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:20.647101 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:20.647145 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:20.647575 (+ 430us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52992: BlockingRecv error: recv got EOF from 127.0.0.1:52992 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260809 15:35:20.651892 3877 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:35:20.650473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52998 (local address 127.11.146.61:42415)
0809 15:35:20.650570 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:20.650574 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:20.650975 (+ 401us) server_negotiation.cc:407] Connection header received
0809 15:35:20.651213 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:20.651216 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:20.651289 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:20.651341 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:20.651804 (+ 463us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52998: BlockingRecv error: recv got EOF from 127.0.0.1:52998 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260809 15:35:20.656911 3877 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:35:20.655554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53004 (local address 127.11.146.61:42415)
0809 15:35:20.655643 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:20.655646 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:20.656164 (+ 518us) server_negotiation.cc:407] Connection header received
0809 15:35:20.656331 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:20.656333 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:20.656375 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:20.656417 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:20.656834 (+ 417us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53004: BlockingRecv error: recv got EOF from 127.0.0.1:53004 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
W20260809 15:35:20.662256 3877 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:35:20.660990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53016 (local address 127.11.146.61:42415)
0809 15:35:20.661072 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:20.661076 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:20.661485 (+ 409us) server_negotiation.cc:407] Connection header received
0809 15:35:20.661640 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:20.661643 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:20.661683 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:20.661727 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:20.662178 (+ 451us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53016: BlockingRecv error: recv got EOF from 127.0.0.1:53016 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
W20260809 15:35:20.670130 3877 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:35:20.668367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53018 (local address 127.11.146.61:42415)
0809 15:35:20.668484 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:20.668488 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:20.669019 (+ 531us) server_negotiation.cc:407] Connection header received
0809 15:35:20.669331 (+ 312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:20.669334 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:20.669440 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:20.669523 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:20.670050 (+ 527us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53018: BlockingRecv error: recv got EOF from 127.0.0.1:53018 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260809 15:35:20.683729 3877 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:35:20.681823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53020 (local address 127.11.146.61:42415)
0809 15:35:20.681935 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:20.681940 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:20.682669 (+ 729us) server_negotiation.cc:407] Connection header received
0809 15:35:20.682904 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:20.682909 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:20.682992 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:20.683050 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:20.683591 (+ 541us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53020: BlockingRecv error: recv got EOF from 127.0.0.1:53020 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260809 15:35:20.704794 3877 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:35:20.702756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53022 (local address 127.11.146.61:42415)
0809 15:35:20.702890 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:20.702897 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:20.703525 (+ 628us) server_negotiation.cc:407] Connection header received
0809 15:35:20.703818 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:20.703825 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:20.703902 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:20.703985 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:20.704670 (+ 685us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53022: BlockingRecv error: recv got EOF from 127.0.0.1:53022 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260809 15:35:20.741029 3877 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:35:20.739665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53030 (local address 127.11.146.61:42415)
0809 15:35:20.739820 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:20.739825 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:20.740014 (+ 189us) server_negotiation.cc:407] Connection header received
0809 15:35:20.740191 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:20.740194 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:20.740246 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:20.740334 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:20.740899 (+ 565us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53030: BlockingRecv error: recv got EOF from 127.0.0.1:53030 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260809 15:35:20.808517 3877 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:35:20.807129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53044 (local address 127.11.146.61:42415)
0809 15:35:20.807444 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:20.807447 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:20.807483 (+ 36us) server_negotiation.cc:407] Connection header received
0809 15:35:20.807672 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:20.807677 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:20.807739 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:20.807848 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:20.808399 (+ 551us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53044: BlockingRecv error: recv got EOF from 127.0.0.1:53044 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260809 15:35:20.939743 3877 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:35:20.938583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53060 (local address 127.11.146.61:42415)
0809 15:35:20.938737 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:20.938742 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:20.938881 (+ 139us) server_negotiation.cc:407] Connection header received
0809 15:35:20.938981 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:20.938983 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:20.939036 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:20.939120 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:20.939580 (+ 460us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53060: BlockingRecv error: recv got EOF from 127.0.0.1:53060 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260809 15:35:21.199083 3877 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:35:21.197860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53066 (local address 127.11.146.61:42415)
0809 15:35:21.198032 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:21.198036 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:21.198091 (+ 55us) server_negotiation.cc:407] Connection header received
0809 15:35:21.198278 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:21.198281 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:21.198344 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:21.198476 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:21.198950 (+ 474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53066: BlockingRecv error: recv got EOF from 127.0.0.1:53066 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 15:35:21.504978 3976 catalog_manager.cc:1259] Loaded cluster ID: ca68d2780f514aed97e5d867ac4661b9
I20260809 15:35:21.505075 3976 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 627af65822ec448495414d073f8a7562: loading cluster ID for follower catalog manager: success
I20260809 15:35:21.506963 3976 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 627af65822ec448495414d073f8a7562: acquiring CA information for follower catalog manager: success
I20260809 15:35:21.508384 3976 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 627af65822ec448495414d073f8a7562: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 15:35:21.522910 4009 catalog_manager.cc:1259] Loaded cluster ID: ca68d2780f514aed97e5d867ac4661b9
I20260809 15:35:21.522993 4009 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 50d67cf517ce4023893b9dc3f6376f97: loading cluster ID for follower catalog manager: success
I20260809 15:35:21.524701 4009 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 50d67cf517ce4023893b9dc3f6376f97: acquiring CA information for follower catalog manager: success
I20260809 15:35:21.525799 4009 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 50d67cf517ce4023893b9dc3f6376f97: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 15:35:21.716655 4091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:21.713082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51686 (local address 127.11.146.61:42415)
0809 15:35:21.713340 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:21.713343 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:21.713361 (+ 18us) server_negotiation.cc:407] Connection header received
0809 15:35:21.713527 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:21.713529 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:21.713658 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:21.713754 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:35:21.713978 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:21.714485 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:21.715246 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:21.715456 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:21.715530 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:21.715800 (+ 270us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:35:21.716256 (+ 456us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:35:21.716346 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:21.716406 (+ 60us) server_negotiation.cc:299] Negotiation successful
0809 15:35:21.716452 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":89,"threads_started":1}
I20260809 15:35:21.722869 4097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:21.719622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33332 (local address 127.11.146.60:35561)
0809 15:35:21.719869 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:21.719873 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:21.719885 (+ 12us) server_negotiation.cc:407] Connection header received
0809 15:35:21.719961 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:21.719963 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:21.720062 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:21.720204 (+ 142us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:35:21.720377 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:21.720879 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:21.721610 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:21.721818 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:21.721892 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:21.722139 (+ 247us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:35:21.722476 (+ 337us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:35:21.722591 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:21.722645 (+ 54us) server_negotiation.cc:299] Negotiation successful
0809 15:35:21.722689 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":108,"threads_started":1}
I20260809 15:35:21.729812 4097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:21.725913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33348 (local address 127.11.146.60:35561)
0809 15:35:21.726152 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:21.726157 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:21.726172 (+ 15us) server_negotiation.cc:407] Connection header received
0809 15:35:21.726282 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:21.726287 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:21.726332 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:21.726412 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:35:21.726627 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:21.727359 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:21.728561 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:21.728886 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:21.728963 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:21.729324 (+ 361us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:35:21.729394 (+ 70us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:35:21.729486 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:21.729631 (+ 145us) server_negotiation.cc:299] Negotiation successful
0809 15:35:21.729683 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175}
I20260809 15:35:21.729877 4091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:21.726023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51690 (local address 127.11.146.61:42415)
0809 15:35:21.726137 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:21.726141 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:21.726157 (+ 16us) server_negotiation.cc:407] Connection header received
0809 15:35:21.726521 (+ 364us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:21.726524 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:21.726569 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:21.726647 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:35:21.726931 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:21.727495 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:21.728552 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:21.728763 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:21.728872 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:21.729139 (+ 267us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:35:21.729205 (+ 66us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:35:21.729294 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:21.729674 (+ 380us) server_negotiation.cc:299] Negotiation successful
0809 15:35:21.729727 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 15:35:21.730525 4104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:21.725619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36584 (local address 127.11.146.62:37705)
0809 15:35:21.726336 (+ 717us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:21.726340 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:21.726354 (+ 14us) server_negotiation.cc:407] Connection header received
0809 15:35:21.726441 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:21.726444 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:21.726577 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:21.726779 (+ 202us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:35:21.727023 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:21.727784 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:21.728979 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:21.729362 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:21.729481 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:21.729834 (+ 353us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:35:21.730122 (+ 288us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:35:21.730222 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:21.730312 (+ 90us) server_negotiation.cc:299] Negotiation successful
0809 15:35:21.730371 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":644,"thread_start_us":86,"threads_started":1}
I20260809 15:35:21.733549 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 3718
I20260809 15:35:21.743271 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 3797
I20260809 15:35:21.750434 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 3880
2026-08-09T15:35:21Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3139 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 15:35:21 dist-test-slave-1jjb krb5kdc[4109](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 15:35:21 dist-test-slave-1jjb krb5kdc[4109](info): set up 2 sockets
Aug 09 15:35:21 dist-test-slave-1jjb krb5kdc[4109](info): commencing operation
krb5kdc: starting...
W20260809 15:35:22.805137 11848 mini_kdc.cc:121] Time spent starting KDC: real 1.031s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/krb5kdc/test-user.keytab.
Aug 09 15:35:22 dist-test-slave-1jjb krb5kdc[4109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289722, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T15:35:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T15:35:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.146.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
Entry for principal kudu/127.11.146.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab.
I20260809 15:35:22.924335 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:32913
--webserver_interface=127.11.146.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:34093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:32913,127.11.146.61:40829,127.11.146.60:38571
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 15:35:23.030771 4124 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 15:35:23.031031 4124 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:35:23.031054 4124 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:35:23.031087 4124 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:35:23.034932 4124 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:35:23.034976 4124 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:35:23.034992 4124 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:35:23.035024 4124 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:35:23.035046 4124 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:35:23.040076 4124 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:34093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:32913,127.11.146.61:40829,127.11.146.60:38571
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.62.keytab
--principal=kudu/127.11.146.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.62:32913
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.146.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4124
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:35:23.041033 4124 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:35:23.041953 4124 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:35:23.049839 4129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:23.049887 4132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:23.049868 4130 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:35:23.050112 4124 server_base.cc:1034] running on GCE node
I20260809 15:35:23.050714 4124 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:35:23.051687 4124 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:35:23.052863 4124 hybrid_clock.cc:648] HybridClock initialized: now 1786289723052840 us; error 40 us; skew 500 ppm
Aug 09 15:35:23 dist-test-slave-1jjb krb5kdc[4109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289723, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:35:23.062063 4124 init.cc:377] Logged in from keytab as kudu/127.11.146.62@KRBTEST.COM (short username kudu)
I20260809 15:35:23.062933 4124 webserver.cc:460] Webserver started at http://127.11.146.62:46183/ using document root <none> and password file <none>
I20260809 15:35:23.063412 4124 fs_manager.cc:359] Metadata directory not provided
I20260809 15:35:23.063468 4124 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:35:23.063618 4124 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:35:23.065549 4124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-0/data/instance:
uuid: "d660d9071dba483ebb88b9b65006387a"
format_stamp: "Formatted at 2026-08-09 15:35:23 on dist-test-slave-1jjb"
server_key: "761476f6187f41905486208c390a6f67"
server_key_iv: "ebfd223915c3fbc3f929fa52634ef0be"
server_key_version: "encryptionkey@0"
I20260809 15:35:23.066031 4124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-0/wal/instance:
uuid: "d660d9071dba483ebb88b9b65006387a"
format_stamp: "Formatted at 2026-08-09 15:35:23 on dist-test-slave-1jjb"
server_key: "761476f6187f41905486208c390a6f67"
server_key_iv: "ebfd223915c3fbc3f929fa52634ef0be"
server_key_version: "encryptionkey@0"
I20260809 15:35:23.069402 4124 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260809 15:35:23.071607 4139 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:35:23.072826 4124 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 15:35:23.072957 4124 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-0/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-0/wal
uuid: "d660d9071dba483ebb88b9b65006387a"
format_stamp: "Formatted at 2026-08-09 15:35:23 on dist-test-slave-1jjb"
server_key: "761476f6187f41905486208c390a6f67"
server_key_iv: "ebfd223915c3fbc3f929fa52634ef0be"
server_key_version: "encryptionkey@0"
I20260809 15:35:23.073050 4124 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:35:23.095943 4124 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:35:23.098796 4124 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:35:23.099018 4124 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:35:23.106201 4124 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.62:32913
I20260809 15:35:23.106519 4195 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.62:32913 every 8 connection(s)
I20260809 15:35:23.107182 4124 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-0/data/info.pb
I20260809 15:35:23.109903 4196 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:35:23.110284 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 4124
I20260809 15:35:23.110448 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-0/wal/instance
I20260809 15:35:23.110739 11848 external_mini_cluster.cc:1428] Setting key 5c3e5cdc32556bba7eac0aa61320454d
I20260809 15:35:23.113761 4196 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.62" port: 32913 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.146.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.61@KRBTEST.COM" created.
Aug 09 15:35:23 dist-test-slave-1jjb krb5kdc[4109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289723, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:35:23.128444 4199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.116007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39742 (local address 127.11.146.62:32913)
0809 15:35:23.116470 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:23.116487 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:23.116710 (+ 223us) server_negotiation.cc:407] Connection header received
0809 15:35:23.117676 (+ 966us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:23.117680 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:23.117856 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:23.118044 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:23.118863 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.119723 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.120800 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.121250 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.121421 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:23.123769 (+ 2348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:23.123778 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:23.123793 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:23.123825 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:23.125545 (+ 1720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:23.126119 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:23.126124 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:23.126125 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:23.126225 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:23.126593 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:23.126596 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:23.126597 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:23.126917 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:23.127018 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:23.127487 (+ 469us) server_negotiation.cc:299] Negotiation successful
0809 15:35:23.127725 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":50,"server-negotiator.queue_time_us":331,"thread_start_us":135,"threads_started":1}
I20260809 15:35:23.128449 4200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.116007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:32913 (local address 127.0.0.1:39742)
0809 15:35:23.116568 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:23.116606 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 15:35:23.117374 (+ 768us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:35:23.118048 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:35:23.118053 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:35:23.118485 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:35:23.118718 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:23.118732 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.119862 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.119864 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:23.120675 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:23.120686 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.121401 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.121405 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:23.121548 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:23.122158 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:35:23.122174 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:35:23.123614 (+ 1440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:35:23.125661 (+ 2047us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:23.125674 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:23.125686 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:23.126004 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:23.126331 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:23.126337 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:23.126342 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:23.126500 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:23.127040 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:35:23.127050 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:35:23.127234 (+ 184us) client_negotiation.cc:769] Sending connection context
0809 15:35:23.127436 (+ 202us) client_negotiation.cc:240] Negotiation successful
0809 15:35:23.127825 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":388,"mutex_wait_us":73,"spinlock_wait_cycles":64384,"thread_start_us":204,"threads_started":1}
I20260809 15:35:23.130810 4196 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.61" port: 40829 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:35:23.131521 4200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.131232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:40829 (local address 127.0.0.1:38126)
0809 15:35:23.131363 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:23.131450 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.61:40829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 15:35:23.131709 4140 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.146.61:40829: connect: Connection refused (error 111)
I20260809 15:35:23.132545 4200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.132338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:40829 (local address 127.0.0.1:38140)
0809 15:35:23.132460 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:23.132501 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.61:40829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 15:35:23.132702 4196 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.146.61:40829: Network error: Client connection negotiation failed: client connection to 127.11.146.61:40829: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.61.keytab.
Entry for principal kudu/127.11.146.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.61.keytab.
I20260809 15:35:23.138864 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.61:40829
--webserver_interface=127.11.146.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.61.keytab
--principal=kudu/127.11.146.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:34093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:32913,127.11.146.61:40829,127.11.146.60:38571
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:35:23.181957 4196 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.61" port: 40829 } attempt: 1
I20260809 15:35:23.182787 4200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.182473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:40829 (local address 127.0.0.1:38144)
0809 15:35:23.182647 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:23.182711 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.61:40829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260809 15:35:23.183480 4200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.183247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:40829 (local address 127.0.0.1:38152)
0809 15:35:23.183360 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:23.183419 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.61:40829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 15:35:23.183619 4196 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.146.61:40829: Network error: Client connection negotiation failed: client connection to 127.11.146.61:40829: connect: Connection refused (error 111)
W20260809 15:35:23.249511 4203 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 15:35:23.249745 4203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:35:23.249799 4203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:35:23.249898 4203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260809 15:35:23.251806 4196 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.61" port: 40829 } attempt: 2
I20260809 15:35:23.252624 4200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.252303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:40829 (local address 127.0.0.1:38166)
0809 15:35:23.252466 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:23.252533 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.61:40829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260809 15:35:23.253372 4200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.253131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:40829 (local address 127.0.0.1:38182)
0809 15:35:23.253239 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:23.253288 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.61:40829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 15:35:23.253523 4196 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.146.61:40829: Network error: Client connection negotiation failed: client connection to 127.11.146.61:40829: connect: Connection refused (error 111)
W20260809 15:35:23.254287 4203 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:35:23.254330 4203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:35:23.254349 4203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:35:23.254365 4203 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:35:23.254386 4203 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:35:23.259398 4203 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:34093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:32913,127.11.146.61:40829,127.11.146.60:38571
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.61.keytab
--principal=kudu/127.11.146.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.61:40829
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.146.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4203
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:35:23.260316 4203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:35:23.261319 4203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 15:35:23.269232 4209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:23.269217 4208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:35:23.269479 4203 server_base.cc:1034] running on GCE node
W20260809 15:35:23.269217 4211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 15:35:23.270068 4203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:35:23.271111 4203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:35:23.272293 4203 hybrid_clock.cc:648] HybridClock initialized: now 1786289723272276 us; error 29 us; skew 500 ppm
Aug 09 15:35:23 dist-test-slave-1jjb krb5kdc[4109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289723, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:35:23.274957 4203 init.cc:377] Logged in from keytab as kudu/127.11.146.61@KRBTEST.COM (short username kudu)
I20260809 15:35:23.275786 4203 webserver.cc:460] Webserver started at http://127.11.146.61:43547/ using document root <none> and password file <none>
I20260809 15:35:23.276425 4203 fs_manager.cc:359] Metadata directory not provided
I20260809 15:35:23.276511 4203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:35:23.276715 4203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:35:23.278647 4203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-1/data/instance:
uuid: "0071ad0595c94774a0f803e3723fc6b8"
format_stamp: "Formatted at 2026-08-09 15:35:23 on dist-test-slave-1jjb"
server_key: "a3403db36633adb70fc03339fed64f6f"
server_key_iv: "0a18f820278201fd3bbaf553ce65b74e"
server_key_version: "encryptionkey@0"
I20260809 15:35:23.279203 4203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-1/wal/instance:
uuid: "0071ad0595c94774a0f803e3723fc6b8"
format_stamp: "Formatted at 2026-08-09 15:35:23 on dist-test-slave-1jjb"
server_key: "a3403db36633adb70fc03339fed64f6f"
server_key_iv: "0a18f820278201fd3bbaf553ce65b74e"
server_key_version: "encryptionkey@0"
I20260809 15:35:23.282721 4203 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260809 15:35:23.285079 4219 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:35:23.286218 4203 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:35:23.286351 4203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-1/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-1/wal
uuid: "0071ad0595c94774a0f803e3723fc6b8"
format_stamp: "Formatted at 2026-08-09 15:35:23 on dist-test-slave-1jjb"
server_key: "a3403db36633adb70fc03339fed64f6f"
server_key_iv: "0a18f820278201fd3bbaf553ce65b74e"
server_key_version: "encryptionkey@0"
I20260809 15:35:23.286458 4203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:35:23.303951 4203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:35:23.306736 4203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:35:23.306928 4203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:35:23.313618 4203 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.61:40829
I20260809 15:35:23.313926 4275 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.61:40829 every 8 connection(s)
I20260809 15:35:23.314569 4203 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-1/data/info.pb
I20260809 15:35:23.314944 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 4203
I20260809 15:35:23.315104 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-1/wal/instance
I20260809 15:35:23.315474 11848 external_mini_cluster.cc:1428] Setting key 896a17994c19879d25ea1913d4fc6545
I20260809 15:35:23.318085 4276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:35:23.322139 4276 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.62" port: 32913 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.146.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.146.60@KRBTEST.COM" created.
Aug 09 15:35:23 dist-test-slave-1jjb krb5kdc[4109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289723, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.61@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:35:23.337277 4199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.324022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39756 (local address 127.11.146.62:32913)
0809 15:35:23.324206 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:23.324212 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:23.324937 (+ 725us) server_negotiation.cc:407] Connection header received
0809 15:35:23.325928 (+ 991us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:23.325931 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:23.325997 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:23.326131 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:23.327655 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.328524 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.330344 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.330567 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.330641 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:23.333203 (+ 2562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:23.333207 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:23.333208 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:23.333231 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:23.334829 (+ 1598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:23.335405 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:23.335415 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:23.335417 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:23.335524 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:23.335950 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:23.335956 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:23.335958 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:23.336219 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:23.336339 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:23.336987 (+ 648us) server_negotiation.cc:299] Negotiation successful
0809 15:35:23.337113 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 15:35:23.338071 4279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.324381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:32913 (local address 127.0.0.1:39756)
0809 15:35:23.324801 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:23.324840 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 15:35:23.325721 (+ 881us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:35:23.326495 (+ 774us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:35:23.326501 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:35:23.326973 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:35:23.327502 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:23.327516 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.328667 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.328672 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:23.330212 (+ 1540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:23.330228 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.330720 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.330728 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:23.331005 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:23.331585 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:35:23.331607 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:35:23.333028 (+ 1421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:35:23.334983 (+ 1955us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:23.334990 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:23.335002 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:23.335271 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:23.335629 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:23.335639 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:23.335641 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:23.335841 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:23.336471 (+ 630us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:35:23.336477 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:35:23.336690 (+ 213us) client_negotiation.cc:769] Sending connection context
0809 15:35:23.336913 (+ 223us) client_negotiation.cc:240] Negotiation successful
0809 15:35:23.337202 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":104,"threads_started":1}
I20260809 15:35:23.339514 4276 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.61" port: 40829 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.146.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.60.keytab.
Entry for principal kudu/127.11.146.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.60.keytab.
I20260809 15:35:23.342736 11848 external_mini_cluster.cc:1326] Running /tmp/dist-test-taska0HXVP/build/debug/bin/kudu
/tmp/dist-test-taska0HXVP/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.60:38571
--webserver_interface=127.11.146.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.60.keytab
--principal=kudu/127.11.146.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.146.20:34093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.146.62:32913,127.11.146.61:40829,127.11.146.60:38571
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 15:35:23.344710 4196 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.61" port: 40829 } attempt: 3
Aug 09 15:35:23 dist-test-slave-1jjb krb5kdc[4109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289723, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.61@KRBTEST.COM for kudu/127.11.146.61@KRBTEST.COM
I20260809 15:35:23.349881 4281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.340115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38186 (local address 127.11.146.61:40829)
0809 15:35:23.340452 (+ 337us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:23.340464 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:23.340485 (+ 21us) server_negotiation.cc:407] Connection header received
0809 15:35:23.340545 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:23.340550 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:23.340694 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:23.340825 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:23.341218 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.342068 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.343075 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.343442 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.343528 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:23.345822 (+ 2294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:23.345833 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:23.345845 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:23.345866 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:23.347751 (+ 1885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:23.348245 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:23.348255 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:23.348258 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:23.348361 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:23.348667 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:23.348671 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:23.348677 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:23.348899 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:23.349037 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:23.349303 (+ 266us) server_negotiation.cc:299] Negotiation successful
0809 15:35:23.349456 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":233,"thread_start_us":144,"threads_started":1}
I20260809 15:35:23.350375 4279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.339993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:40829 (local address 127.0.0.1:38186)
0809 15:35:23.340242 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:23.340262 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 15:35:23.340379 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:35:23.340804 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:35:23.340807 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:35:23.341034 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:35:23.341116 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:23.341121 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.342189 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.342194 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:23.342962 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:23.342975 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.343559 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.343565 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:23.343699 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:23.344229 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:35:23.344240 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:35:23.345700 (+ 1460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:35:23.347868 (+ 2168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:23.347871 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:23.347873 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:23.348135 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:23.348464 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:23.348466 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:23.348468 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:23.348577 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:23.348997 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:35:23.349000 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:35:23.349109 (+ 109us) client_negotiation.cc:769] Sending connection context
0809 15:35:23.350065 (+ 956us) client_negotiation.cc:240] Negotiation successful
0809 15:35:23.350185 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96}
Aug 09 15:35:23 dist-test-slave-1jjb krb5kdc[4109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289723, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for kudu/127.11.146.61@KRBTEST.COM
I20260809 15:35:23.352586 4276 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.60" port: 38571 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:35:23.353238 4279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.353008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:38571 (local address 127.0.0.1:54704)
0809 15:35:23.353141 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:23.353196 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:38571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
W20260809 15:35:23.353404 4221 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.146.60:38571: connect: Connection refused (error 111)
I20260809 15:35:23.354164 4279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.353966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:38571 (local address 127.0.0.1:54716)
0809 15:35:23.354065 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:23.354109 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:38571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 15:35:23.354359 4276 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.146.60:38571: Network error: Client connection negotiation failed: client connection to 127.11.146.60:38571: connect: Connection refused (error 111)
I20260809 15:35:23.355587 4200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.345102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:40829 (local address 127.0.0.1:38198)
0809 15:35:23.345219 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:23.345235 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 15:35:23.345312 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:35:23.345853 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:35:23.345859 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:35:23.346043 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:35:23.346183 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:23.346194 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.347332 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.347336 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:23.348441 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:23.348453 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.349138 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.349142 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:23.349263 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:23.349764 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:35:23.349783 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:35:23.351373 (+ 1590us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:35:23.353929 (+ 2556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:23.353933 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:23.353935 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:23.354180 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:23.354699 (+ 519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:23.354702 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:23.354703 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:23.354780 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:23.355235 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:35:23.355237 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:35:23.355309 (+ 72us) client_negotiation.cc:769] Sending connection context
0809 15:35:23.355386 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 15:35:23.355482 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260809 15:35:23.355870 4283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.345388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38198 (local address 127.11.146.61:40829)
0809 15:35:23.345625 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:23.345631 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:23.345641 (+ 10us) server_negotiation.cc:407] Connection header received
0809 15:35:23.345667 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:23.345669 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:23.345707 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:23.345809 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:23.346609 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.347220 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.348534 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.348959 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.349140 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:23.351527 (+ 2387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:23.351533 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:23.351538 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:23.351568 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:23.353791 (+ 2223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:23.354308 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:23.354313 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:23.354317 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:23.354605 (+ 288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:23.354880 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:23.354885 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:23.354889 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:23.355134 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:23.355247 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:23.355463 (+ 216us) server_negotiation.cc:299] Negotiation successful
0809 15:35:23.355568 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":186,"thread_start_us":72,"threads_started":1}
I20260809 15:35:23.356580 4196 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.60" port: 38571 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:35:23.357193 4200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.356989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:38571 (local address 127.0.0.1:54728)
0809 15:35:23.357093 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:23.357137 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:38571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260809 15:35:23.357856 4200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.357624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:38571 (local address 127.0.0.1:54742)
0809 15:35:23.357762 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:23.357813 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:38571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
W20260809 15:35:23.358007 4196 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.146.60:38571: Network error: Client connection negotiation failed: client connection to 127.11.146.60:38571: connect: Connection refused (error 111)
I20260809 15:35:23.389163 4196 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.60" port: 38571 } attempt: 1
I20260809 15:35:23.389883 4200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.389596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:38571 (local address 127.0.0.1:54758)
0809 15:35:23.389728 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:23.389809 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:38571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260809 15:35:23.390581 4200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.390323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:38571 (local address 127.0.0.1:54766)
0809 15:35:23.390433 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:23.390485 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:38571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 15:35:23.390736 4196 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.146.60:38571: Network error: Client connection negotiation failed: client connection to 127.11.146.60:38571: connect: Connection refused (error 111)
I20260809 15:35:23.403614 4276 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.60" port: 38571 } attempt: 1
I20260809 15:35:23.404306 4279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.404035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:38571 (local address 127.0.0.1:54776)
0809 15:35:23.404177 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:23.404235 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:38571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260809 15:35:23.405004 4279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.404767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:38571 (local address 127.0.0.1:54778)
0809 15:35:23.404891 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:23.404946 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:38571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 15:35:23.405154 4276 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.146.60:38571: Network error: Client connection negotiation failed: client connection to 127.11.146.60:38571: connect: Connection refused (error 111)
W20260809 15:35:23.453776 4282 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 15:35:23.454005 4282 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 15:35:23.454026 4282 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 15:35:23.454061 4282 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 15:35:23.458249 4282 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 15:35:23.458302 4282 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 15:35:23.458320 4282 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 15:35:23.458336 4282 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 15:35:23.458356 4282 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 15:35:23.463925 4282 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.146.20:34093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.146.62:32913,127.11.146.61:40829,127.11.146.60:38571
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/krb5kdc/kudu_127.11.146.60.keytab
--principal=kudu/127.11.146.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.146.60:38571
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.146.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4282
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 14:46:55 UTC on ccycloud.quasar-yswkmf.root.comops.site
build id 4576540
I20260809 15:35:23.464862 4282 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 15:35:23.465783 4282 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 15:35:23.465893 4196 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.60" port: 38571 } attempt: 2
I20260809 15:35:23.466660 4200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.466366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:38571 (local address 127.0.0.1:54782)
0809 15:35:23.466503 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:23.466590 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:38571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260809 15:35:23.467454 4200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.467239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:38571 (local address 127.0.0.1:54788)
0809 15:35:23.467349 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:23.467395 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:38571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 15:35:23.467643 4196 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.146.60:38571: Network error: Client connection negotiation failed: client connection to 127.11.146.60:38571: connect: Connection refused (error 111)
I20260809 15:35:23.473343 4276 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.60" port: 38571 } attempt: 2
I20260809 15:35:23.474095 4279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.473783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:38571 (local address 127.0.0.1:54802)
0809 15:35:23.473944 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:23.474002 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:38571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260809 15:35:23.475240 4279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.474947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:38571 (local address 127.0.0.1:54808)
0809 15:35:23.475127 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:23.475172 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.146.60:38571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
W20260809 15:35:23.475451 4290 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:23.475487 4291 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:23.475793 4293 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 15:35:23.476049 4276 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.146.60:38571: Network error: Client connection negotiation failed: client connection to 127.11.146.60:38571: connect: Connection refused (error 111)
I20260809 15:35:23.476536 4282 server_base.cc:1034] running on GCE node
I20260809 15:35:23.477188 4282 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 15:35:23.478706 4282 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 15:35:23.479911 4282 hybrid_clock.cc:648] HybridClock initialized: now 1786289723479886 us; error 38 us; skew 500 ppm
Aug 09 15:35:23 dist-test-slave-1jjb krb5kdc[4109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289723, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 15:35:23.482569 4282 init.cc:377] Logged in from keytab as kudu/127.11.146.60@KRBTEST.COM (short username kudu)
I20260809 15:35:23.483413 4282 webserver.cc:460] Webserver started at http://127.11.146.60:41961/ using document root <none> and password file <none>
I20260809 15:35:23.483935 4282 fs_manager.cc:359] Metadata directory not provided
I20260809 15:35:23.484037 4282 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 15:35:23.484278 4282 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 15:35:23.486167 4282 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-2/data/instance:
uuid: "8cb18510ec214436897efe8b30b072c9"
format_stamp: "Formatted at 2026-08-09 15:35:23 on dist-test-slave-1jjb"
server_key: "cdd817f60f60eed2ea3b5b66897ba978"
server_key_iv: "49a1e1b91d0f4aa3309fb4237b495aef"
server_key_version: "encryptionkey@0"
I20260809 15:35:23.486712 4282 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-2/wal/instance:
uuid: "8cb18510ec214436897efe8b30b072c9"
format_stamp: "Formatted at 2026-08-09 15:35:23 on dist-test-slave-1jjb"
server_key: "cdd817f60f60eed2ea3b5b66897ba978"
server_key_iv: "49a1e1b91d0f4aa3309fb4237b495aef"
server_key_version: "encryptionkey@0"
I20260809 15:35:23.490383 4282 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 15:35:23.492731 4301 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 15:35:23.493896 4282 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 15:35:23.494033 4282 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-2/data,/tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-2/wal
uuid: "8cb18510ec214436897efe8b30b072c9"
format_stamp: "Formatted at 2026-08-09 15:35:23 on dist-test-slave-1jjb"
server_key: "cdd817f60f60eed2ea3b5b66897ba978"
server_key_iv: "49a1e1b91d0f4aa3309fb4237b495aef"
server_key_version: "encryptionkey@0"
I20260809 15:35:23.494138 4282 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 15:35:23.512928 4282 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 15:35:23.515550 4282 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 15:35:23.515736 4282 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 15:35:23.522665 4282 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.60:38571
I20260809 15:35:23.522929 4355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.146.60:38571 every 8 connection(s)
I20260809 15:35:23.523587 4282 server_base.cc:1166] Dumped server information to /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-2/data/info.pb
I20260809 15:35:23.526089 4357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 15:35:23.529572 4357 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.62" port: 32913 } has no permanent_uuid. Determining permanent_uuid...
I20260809 15:35:23.530115 11848 external_mini_cluster.cc:1388] Started /tmp/dist-test-taska0HXVP/build/debug/bin/kudu as pid 4282
I20260809 15:35:23.530256 11848 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taska0HXVP/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786289437399694-11848-0/minicluster-data/master-2/wal/instance
I20260809 15:35:23.530541 11848 external_mini_cluster.cc:1428] Setting key e7f23ddc254ac4f8c011714ca3518352
Aug 09 15:35:23 dist-test-slave-1jjb krb5kdc[4109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289723, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.60@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
Aug 09 15:35:23 dist-test-slave-1jjb krb5kdc[4109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289722, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.60@KRBTEST.COM
I20260809 15:35:23.543467 4199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.531501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39770 (local address 127.11.146.62:32913)
0809 15:35:23.531618 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:23.531622 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:23.532344 (+ 722us) server_negotiation.cc:407] Connection header received
0809 15:35:23.533064 (+ 720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:23.533068 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:23.533115 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:23.533205 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:23.534316 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.535160 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.536455 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.536760 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.536872 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:23.539431 (+ 2559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:23.539435 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:23.539438 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:23.539469 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:23.541152 (+ 1683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:23.541725 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:23.541728 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:23.541730 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:23.541810 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:23.542206 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:23.542210 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:23.542211 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:23.542468 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:23.542558 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:23.543174 (+ 616us) server_negotiation.cc:299] Negotiation successful
0809 15:35:23.543293 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 15:35:23.544440 4361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.531743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54810 (local address 127.11.146.60:38571)
0809 15:35:23.532151 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:23.532167 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:23.532205 (+ 38us) server_negotiation.cc:407] Connection header received
0809 15:35:23.532839 (+ 634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:23.532854 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:23.533094 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:23.533244 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:23.534182 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.535503 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.536599 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.537113 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.537212 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:23.539933 (+ 2721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:23.539940 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:23.539955 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:23.539986 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:23.541994 (+ 2008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:23.542453 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:23.542458 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:23.542459 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:23.542547 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:23.542801 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:23.542804 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:23.542806 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:23.543082 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:23.543242 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:23.543472 (+ 230us) server_negotiation.cc:299] Negotiation successful
0809 15:35:23.543601 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"spinlock_wait_cycles":896,"thread_start_us":131,"threads_started":1}
I20260809 15:35:23.544440 4360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.531742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.62:32913 (local address 127.0.0.1:39770)
0809 15:35:23.532186 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:23.532230 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 15:35:23.532857 (+ 627us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:35:23.533273 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:35:23.533278 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:35:23.533739 (+ 461us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:35:23.534114 (+ 375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:23.534135 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.535269 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.535271 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:23.536324 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:23.536335 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.536914 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.536917 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:23.537057 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:23.537573 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:35:23.537588 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:35:23.539270 (+ 1682us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:35:23.541269 (+ 1999us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:23.541277 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:23.541285 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:23.541623 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:23.541937 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:23.541940 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:23.541942 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:23.542111 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:23.542578 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:35:23.542587 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:35:23.542869 (+ 282us) client_negotiation.cc:769] Sending connection context
0809 15:35:23.543096 (+ 227us) client_negotiation.cc:240] Negotiation successful
0809 15:35:23.543395 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":130,"threads_started":1}
I20260809 15:35:23.545692 4357 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.61" port: 40829 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 15:35:23 dist-test-slave-1jjb krb5kdc[4109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289723, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.60@KRBTEST.COM for kudu/127.11.146.61@KRBTEST.COM
Aug 09 15:35:23 dist-test-slave-1jjb krb5kdc[4109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289722, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.62@KRBTEST.COM
I20260809 15:35:23.555183 4199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.546929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39778 (local address 127.11.146.62:32913)
0809 15:35:23.547019 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:23.547022 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:23.547035 (+ 13us) server_negotiation.cc:407] Connection header received
0809 15:35:23.547144 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:23.547146 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:23.547178 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:23.547238 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:23.547865 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.548368 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.549255 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.549449 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.549568 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:23.552235 (+ 2667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:23.552239 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:23.552241 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:23.552265 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:23.553546 (+ 1281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:23.554017 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:23.554021 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:23.554023 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:23.554107 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:23.554384 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:23.554395 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:23.554396 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:23.554588 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:23.554787 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:23.554939 (+ 152us) server_negotiation.cc:299] Negotiation successful
0809 15:35:23.555045 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 15:35:23.555184 4283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.546241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38200 (local address 127.11.146.61:40829)
0809 15:35:23.546360 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:23.546364 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:23.546379 (+ 15us) server_negotiation.cc:407] Connection header received
0809 15:35:23.546439 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:23.546441 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:23.546493 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:23.546597 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:23.547042 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.547848 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.548724 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.548954 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.549029 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:23.551277 (+ 2248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:23.551281 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:23.551284 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:23.551309 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:23.553021 (+ 1712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:23.554017 (+ 996us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:23.554021 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:23.554023 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:23.554107 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:23.554384 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:23.554387 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:23.554389 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:23.554588 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:23.554679 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:23.554944 (+ 265us) server_negotiation.cc:299] Negotiation successful
0809 15:35:23.555051 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 15:35:23.555276 4360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.546131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.61:40829 (local address 127.0.0.1:38200)
0809 15:35:23.546260 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:23.546269 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 15:35:23.546350 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:35:23.546607 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:35:23.546610 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:35:23.546785 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:35:23.546894 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:23.546901 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.547976 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.547978 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:23.548604 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:23.548614 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.549065 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.549069 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:23.549192 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:23.549663 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:35:23.549677 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:35:23.551145 (+ 1468us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:35:23.553690 (+ 2545us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:23.553695 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:23.553699 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:23.553922 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:23.554198 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:23.554200 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:23.554202 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:23.554289 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:23.554685 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:35:23.554688 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:35:23.554768 (+ 80us) client_negotiation.cc:769] Sending connection context
0809 15:35:23.554880 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 15:35:23.554999 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83}
I20260809 15:35:23.555938 4357 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.60" port: 38571 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 15:35:23 dist-test-slave-1jjb krb5kdc[4109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289723, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.60@KRBTEST.COM for kudu/127.11.146.60@KRBTEST.COM
Aug 09 15:35:23 dist-test-slave-1jjb krb5kdc[4109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289722, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.146.61@KRBTEST.COM
I20260809 15:35:23.563235 4360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.556419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:38571 (local address 127.0.0.1:54822)
0809 15:35:23.556534 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:23.556545 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 15:35:23.556608 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:35:23.556822 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:35:23.556825 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:35:23.556973 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:35:23.557029 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:23.557033 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.557674 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.557680 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:23.558168 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:23.558175 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.558629 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.558633 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:23.558701 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:23.559103 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:35:23.559113 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:35:23.560235 (+ 1122us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:35:23.561882 (+ 1647us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:23.561887 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:23.561890 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:23.562089 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:23.562347 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:23.562349 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:23.562351 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:23.562428 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:23.562762 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:35:23.562765 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:35:23.562841 (+ 76us) client_negotiation.cc:769] Sending connection context
0809 15:35:23.562947 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 15:35:23.563076 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260809 15:35:23.563256 4361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.556455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54822 (local address 127.11.146.60:38571)
0809 15:35:23.556542 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:23.556546 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:23.556582 (+ 36us) server_negotiation.cc:407] Connection header received
0809 15:35:23.556691 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:23.556694 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:23.556727 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:23.556812 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:23.557129 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.557577 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.558289 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.558528 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.558630 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:23.560367 (+ 1737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:23.560370 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:23.560372 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:23.560391 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:23.561783 (+ 1392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:23.562179 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:23.562184 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:23.562186 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:23.562254 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:23.562516 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:23.562519 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:23.562520 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:23.562664 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:23.562761 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:23.562990 (+ 229us) server_negotiation.cc:299] Negotiation successful
0809 15:35:23.563131 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":51,"server-negotiator.queue_time_us":33}
I20260809 15:35:23.564924 4283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.556268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38214 (local address 127.11.146.61:40829)
0809 15:35:23.556374 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:23.556378 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:23.556641 (+ 263us) server_negotiation.cc:407] Connection header received
0809 15:35:23.556751 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:23.556754 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:23.556788 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:23.556874 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:23.557416 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.557851 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.558665 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.558957 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.559062 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:23.561798 (+ 2736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:23.561802 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:23.561804 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:23.561826 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:23.563230 (+ 1404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:23.563809 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:23.563813 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:23.563815 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:23.563894 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:23.564181 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:23.564184 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:23.564186 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:23.564359 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:23.564547 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:23.564676 (+ 129us) server_negotiation.cc:299] Negotiation successful
0809 15:35:23.564776 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 15:35:23.566768 4357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cb18510ec214436897efe8b30b072c9: Bootstrap starting.
I20260809 15:35:23.566828 4196 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.60" port: 38571 } attempt: 3
I20260809 15:35:23.567250 4276 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.60" port: 38571 } attempt: 3
I20260809 15:35:23.568328 11848 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 15:35:23.569648 4357 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8cb18510ec214436897efe8b30b072c9: Neither blocks nor log segments found. Creating new log.
I20260809 15:35:23.570513 4357 log.cc:824] T 00000000000000000000000000000000 P 8cb18510ec214436897efe8b30b072c9: Log is configured to *not* fsync() on all Append() calls
I20260809 15:35:23.569579 4167 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "d660d9071dba483ebb88b9b65006387a"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39778
Aug 09 15:35:23 dist-test-slave-1jjb krb5kdc[4109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289723, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.61@KRBTEST.COM for kudu/127.11.146.60@KRBTEST.COM
I20260809 15:35:23.573189 4357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cb18510ec214436897efe8b30b072c9: No bootstrap required, opened a new log
Aug 09 15:35:23 dist-test-slave-1jjb krb5kdc[4109](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786289723, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.146.62@KRBTEST.COM for kudu/127.11.146.60@KRBTEST.COM
I20260809 15:35:23.577453 4200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.567211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:38571 (local address 127.0.0.1:54838)
0809 15:35:23.567358 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:23.567371 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 15:35:23.567459 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:35:23.568677 (+ 1218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:35:23.568680 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:35:23.568862 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:35:23.568978 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:23.568985 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.570105 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.570109 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:23.570866 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:23.570876 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.571607 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.571611 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:23.571710 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:23.572244 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:35:23.572260 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:35:23.573627 (+ 1367us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:35:23.575887 (+ 2260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:23.575901 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:23.575903 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:23.576208 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:23.576539 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:23.576542 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:23.576544 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:23.576629 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:23.577046 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:35:23.577049 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:35:23.577124 (+ 75us) client_negotiation.cc:769] Sending connection context
0809 15:35:23.577215 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 15:35:23.577316 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90}
I20260809 15:35:23.577493 4279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.567612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.146.60:38571 (local address 127.0.0.1:54848)
0809 15:35:23.567775 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 15:35:23.567787 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 15:35:23.567865 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 15:35:23.568188 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 15:35:23.568191 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 15:35:23.568365 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0809 15:35:23.568450 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:23.568457 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.569427 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.569431 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:23.570213 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 15:35:23.570224 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.570808 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.570814 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 15:35:23.570916 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:23.571366 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 15:35:23.571377 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 15:35:23.573627 (+ 2250us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 15:35:23.575638 (+ 2011us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:23.575643 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:23.575648 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:23.575922 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:23.576554 (+ 632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 15:35:23.576557 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 15:35:23.576558 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 15:35:23.576629 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 15:35:23.577008 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 15:35:23.577012 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 15:35:23.577095 (+ 83us) client_negotiation.cc:769] Sending connection context
0809 15:35:23.577195 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 15:35:23.577315 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102}
I20260809 15:35:23.577392 4357 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8cb18510ec214436897efe8b30b072c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d660d9071dba483ebb88b9b65006387a" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 32913 } } peers { permanent_uuid: "0071ad0595c94774a0f803e3723fc6b8" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 40829 } } peers { permanent_uuid: "8cb18510ec214436897efe8b30b072c9" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 38571 } }
I20260809 15:35:23.577675 4357 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8cb18510ec214436897efe8b30b072c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cb18510ec214436897efe8b30b072c9, State: Initialized, Role: FOLLOWER
I20260809 15:35:23.577903 4361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.567672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54848 (local address 127.11.146.60:38571)
0809 15:35:23.567759 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:23.567763 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:23.567829 (+ 66us) server_negotiation.cc:407] Connection header received
0809 15:35:23.567955 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:23.567958 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:23.568017 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:23.568559 (+ 542us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:23.568636 (+ 77us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.569297 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.570366 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.570671 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.571156 (+ 485us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:23.573753 (+ 2597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:23.573756 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:23.573759 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:23.573780 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:23.575453 (+ 1673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:23.576387 (+ 934us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:23.576390 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:23.576392 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:23.576469 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:23.576722 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:23.576726 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:23.576727 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:23.576911 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:23.577010 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:23.577260 (+ 250us) server_negotiation.cc:299] Negotiation successful
0809 15:35:23.577352 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 15:35:23.577972 4357 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8cb18510ec214436897efe8b30b072c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d660d9071dba483ebb88b9b65006387a" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 32913 } } peers { permanent_uuid: "0071ad0595c94774a0f803e3723fc6b8" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 40829 } } peers { permanent_uuid: "8cb18510ec214436897efe8b30b072c9" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 38571 } }
I20260809 15:35:23.578202 4362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.568007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54838 (local address 127.11.146.60:38571)
0809 15:35:23.568458 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:23.568468 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:23.568481 (+ 13us) server_negotiation.cc:407] Connection header received
0809 15:35:23.568511 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:23.568514 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:23.568550 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:23.569108 (+ 558us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:23.569208 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.569982 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.571089 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.571464 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.571964 (+ 500us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:23.574029 (+ 2065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:23.574032 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:23.574034 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:23.574056 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:23.575776 (+ 1720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:23.576347 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:23.576351 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:23.576352 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:23.576434 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:23.576743 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:23.576746 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:23.576749 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:23.576941 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:23.577654 (+ 713us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:23.577729 (+ 75us) server_negotiation.cc:299] Negotiation successful
0809 15:35:23.577836 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":128,"threads_started":1}
I20260809 15:35:23.579211 4357 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8cb18510ec214436897efe8b30b072c9 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:35:23.580245 4276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0071ad0595c94774a0f803e3723fc6b8: Bootstrap starting.
I20260809 15:35:23.580895 4196 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d660d9071dba483ebb88b9b65006387a: Bootstrap starting.
I20260809 15:35:23.581581 4364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cb18510ec214436897efe8b30b072c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d660d9071dba483ebb88b9b65006387a" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 32913 } } peers { permanent_uuid: "0071ad0595c94774a0f803e3723fc6b8" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 40829 } } peers { permanent_uuid: "8cb18510ec214436897efe8b30b072c9" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 38571 } } }
I20260809 15:35:23.581705 4364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cb18510ec214436897efe8b30b072c9 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:35:23.582741 4276 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0071ad0595c94774a0f803e3723fc6b8: Neither blocks nor log segments found. Creating new log.
I20260809 15:35:23.583299 4196 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d660d9071dba483ebb88b9b65006387a: Neither blocks nor log segments found. Creating new log.
I20260809 15:35:23.583590 4276 log.cc:824] T 00000000000000000000000000000000 P 0071ad0595c94774a0f803e3723fc6b8: Log is configured to *not* fsync() on all Append() calls
I20260809 15:35:23.584172 4196 log.cc:824] T 00000000000000000000000000000000 P d660d9071dba483ebb88b9b65006387a: Log is configured to *not* fsync() on all Append() calls
W20260809 15:35:23.585017 4377 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8cb18510ec214436897efe8b30b072c9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:35:23.585139 4377 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:35:23.586537 4276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0071ad0595c94774a0f803e3723fc6b8: No bootstrap required, opened a new log
I20260809 15:35:23.585570 4282 master_runner.cc:186] Error getting master registration for 127.11.146.62:32913: OK, instance_id { permanent_uuid: "d660d9071dba483ebb88b9b65006387a" instance_seqno: 1786289723104324 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 15:35:23.588712 4282 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 15:35:23.590477 4276 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0071ad0595c94774a0f803e3723fc6b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d660d9071dba483ebb88b9b65006387a" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 32913 } } peers { permanent_uuid: "0071ad0595c94774a0f803e3723fc6b8" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 40829 } } peers { permanent_uuid: "8cb18510ec214436897efe8b30b072c9" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 38571 } }
I20260809 15:35:23.590677 4276 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0071ad0595c94774a0f803e3723fc6b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0071ad0595c94774a0f803e3723fc6b8, State: Initialized, Role: FOLLOWER
I20260809 15:35:23.591005 4276 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0071ad0595c94774a0f803e3723fc6b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d660d9071dba483ebb88b9b65006387a" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 32913 } } peers { permanent_uuid: "0071ad0595c94774a0f803e3723fc6b8" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 40829 } } peers { permanent_uuid: "8cb18510ec214436897efe8b30b072c9" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 38571 } }
I20260809 15:35:23.591563 4381 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0071ad0595c94774a0f803e3723fc6b8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d660d9071dba483ebb88b9b65006387a" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 32913 } } peers { permanent_uuid: "0071ad0595c94774a0f803e3723fc6b8" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 40829 } } peers { permanent_uuid: "8cb18510ec214436897efe8b30b072c9" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 38571 } } }
I20260809 15:35:23.591799 4381 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0071ad0595c94774a0f803e3723fc6b8 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:35:23.592372 4276 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0071ad0595c94774a0f803e3723fc6b8 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:35:23.593976 4196 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d660d9071dba483ebb88b9b65006387a: No bootstrap required, opened a new log
I20260809 15:35:23.597002 4196 raft_consensus.cc:348] T 00000000000000000000000000000000 P d660d9071dba483ebb88b9b65006387a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d660d9071dba483ebb88b9b65006387a" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 32913 } } peers { permanent_uuid: "0071ad0595c94774a0f803e3723fc6b8" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 40829 } } peers { permanent_uuid: "8cb18510ec214436897efe8b30b072c9" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 38571 } }
I20260809 15:35:23.597209 4196 raft_consensus.cc:729] T 00000000000000000000000000000000 P d660d9071dba483ebb88b9b65006387a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d660d9071dba483ebb88b9b65006387a, State: Initialized, Role: FOLLOWER
I20260809 15:35:23.597505 4196 consensus_queue.cc:260] T 00000000000000000000000000000000 P d660d9071dba483ebb88b9b65006387a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d660d9071dba483ebb88b9b65006387a" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 32913 } } peers { permanent_uuid: "0071ad0595c94774a0f803e3723fc6b8" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 40829 } } peers { permanent_uuid: "8cb18510ec214436897efe8b30b072c9" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 38571 } }
W20260809 15:35:23.597795 4393 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0071ad0595c94774a0f803e3723fc6b8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:35:23.597898 4393 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:35:23.595945 4203 master_runner.cc:186] Error getting master registration for 127.11.146.62:32913: OK, instance_id { permanent_uuid: "d660d9071dba483ebb88b9b65006387a" instance_seqno: 1786289723104324 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 15:35:23.599249 4203 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 15:35:23.599370 4167 raft_consensus.cc:482] T 00000000000000000000000000000000 P d660d9071dba483ebb88b9b65006387a [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 15:35:23.599501 4167 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d660d9071dba483ebb88b9b65006387a [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:35:23.600144 4196 sys_catalog.cc:564] T 00000000000000000000000000000000 P d660d9071dba483ebb88b9b65006387a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 15:35:23.600828 4167 raft_consensus.cc:504] T 00000000000000000000000000000000 P d660d9071dba483ebb88b9b65006387a [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d660d9071dba483ebb88b9b65006387a" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 32913 } } peers { permanent_uuid: "0071ad0595c94774a0f803e3723fc6b8" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 40829 } } peers { permanent_uuid: "8cb18510ec214436897efe8b30b072c9" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 38571 } }
W20260809 15:35:23.601128 4145 tablet.cc:2369] T 00000000000000000000000000000000 P d660d9071dba483ebb88b9b65006387a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 15:35:23.601833 4167 leader_election.cc:288] T 00000000000000000000000000000000 P d660d9071dba483ebb88b9b65006387a [CANDIDATE]: Term 1 election: Requested vote from peers 0071ad0595c94774a0f803e3723fc6b8 (127.11.146.61:40829), 8cb18510ec214436897efe8b30b072c9 (127.11.146.60:38571)
I20260809 15:35:23.602672 4328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d660d9071dba483ebb88b9b65006387a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "8cb18510ec214436897efe8b30b072c9"
I20260809 15:35:23.602895 4328 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8cb18510ec214436897efe8b30b072c9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:35:23.603910 4328 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8cb18510ec214436897efe8b30b072c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d660d9071dba483ebb88b9b65006387a in term 1.
I20260809 15:35:23.604449 4141 leader_election.cc:302] T 00000000000000000000000000000000 P d660d9071dba483ebb88b9b65006387a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8cb18510ec214436897efe8b30b072c9, d660d9071dba483ebb88b9b65006387a; no voters:
I20260809 15:35:23.607273 4248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d660d9071dba483ebb88b9b65006387a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "0071ad0595c94774a0f803e3723fc6b8"
I20260809 15:35:23.607497 4248 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0071ad0595c94774a0f803e3723fc6b8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 15:35:23.608798 4248 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0071ad0595c94774a0f803e3723fc6b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d660d9071dba483ebb88b9b65006387a in term 1.
I20260809 15:35:23.613200 4395 sys_catalog.cc:455] T 00000000000000000000000000000000 P d660d9071dba483ebb88b9b65006387a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d660d9071dba483ebb88b9b65006387a" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 32913 } } peers { permanent_uuid: "0071ad0595c94774a0f803e3723fc6b8" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 40829 } } peers { permanent_uuid: "8cb18510ec214436897efe8b30b072c9" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 38571 } } }
I20260809 15:35:23.613262 4415 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d660d9071dba483ebb88b9b65006387a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 15:35:23.613322 4395 sys_catalog.cc:458] T 00000000000000000000000000000000 P d660d9071dba483ebb88b9b65006387a [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:35:23.613417 4415 raft_consensus.cc:686] T 00000000000000000000000000000000 P d660d9071dba483ebb88b9b65006387a [term 1 LEADER]: Becoming Leader. State: Replica: d660d9071dba483ebb88b9b65006387a, State: Running, Role: LEADER
I20260809 15:35:23.613605 4124 master_runner.cc:263] No leader master found from master d660d9071dba483ebb88b9b65006387a
I20260809 15:35:23.613657 4124 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 15:35:23.613946 4415 consensus_queue.cc:237] T 00000000000000000000000000000000 P d660d9071dba483ebb88b9b65006387a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d660d9071dba483ebb88b9b65006387a" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 32913 } } peers { permanent_uuid: "0071ad0595c94774a0f803e3723fc6b8" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 40829 } } peers { permanent_uuid: "8cb18510ec214436897efe8b30b072c9" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 38571 } }
I20260809 15:35:23.616532 4395 sys_catalog.cc:455] T 00000000000000000000000000000000 P d660d9071dba483ebb88b9b65006387a [sys.catalog]: SysCatalogTable state changed. Reason: New leader d660d9071dba483ebb88b9b65006387a. Latest consensus state: current_term: 1 leader_uuid: "d660d9071dba483ebb88b9b65006387a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d660d9071dba483ebb88b9b65006387a" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 32913 } } peers { permanent_uuid: "0071ad0595c94774a0f803e3723fc6b8" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 40829 } } peers { permanent_uuid: "8cb18510ec214436897efe8b30b072c9" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 38571 } } }
I20260809 15:35:23.616677 4395 sys_catalog.cc:458] T 00000000000000000000000000000000 P d660d9071dba483ebb88b9b65006387a [sys.catalog]: This master's current role is: LEADER
I20260809 15:35:23.619498 4199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.606804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39784 (local address 127.11.146.62:32913)
0809 15:35:23.606905 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:23.606909 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:23.609568 (+ 2659us) server_negotiation.cc:407] Connection header received
0809 15:35:23.609969 (+ 401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:23.609972 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:23.610018 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:23.610075 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:23.611375 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.611864 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.613729 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.614018 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.614112 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:23.615904 (+ 1792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:23.615907 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:23.615909 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:23.615928 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:23.617711 (+ 1783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:23.618190 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:23.618194 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:23.618195 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:23.618272 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:23.618592 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:23.618596 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:23.618597 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:23.618789 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:23.618885 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:23.619247 (+ 362us) server_negotiation.cc:299] Negotiation successful
0809 15:35:23.619356 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
W20260809 15:35:23.623767 4408 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d660d9071dba483ebb88b9b65006387a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 15:35:23.623852 4408 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 15:35:23.629508 4362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.612460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54858 (local address 127.11.146.60:38571)
0809 15:35:23.612597 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:23.612601 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:23.620088 (+ 7487us) server_negotiation.cc:407] Connection header received
0809 15:35:23.620269 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:23.620272 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:23.620317 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:23.620366 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:23.621230 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.622042 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.623022 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.623340 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.623439 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:23.625053 (+ 1614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:23.625058 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:23.625061 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:23.625087 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:23.627448 (+ 2361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:23.627983 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:23.627987 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:23.627990 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:23.628090 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:23.628472 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:23.628475 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:23.628478 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:23.628696 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:23.628804 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:23.629216 (+ 412us) server_negotiation.cc:299] Negotiation successful
0809 15:35:23.629336 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 15:35:23.636159 4418 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 15:35:23.637199 4418 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 15:35:23.637480 4283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:23.606346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38224 (local address 127.11.146.61:40829)
0809 15:35:23.606470 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:23.606474 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:23.619870 (+ 13396us) server_negotiation.cc:407] Connection header received
0809 15:35:23.621007 (+ 1137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:23.621011 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:23.621067 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:23.621119 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:23.622008 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.622725 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.624146 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:23.624515 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:23.624615 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:23.627085 (+ 2470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 15:35:23.627089 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 15:35:23.627092 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 15:35:23.627119 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 15:35:23.628914 (+ 1795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:23.636186 (+ 7272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:23.636190 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:23.636192 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:23.636282 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 15:35:23.636598 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 15:35:23.636601 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 15:35:23.636603 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 15:35:23.636803 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 15:35:23.636914 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:23.637232 (+ 318us) server_negotiation.cc:299] Negotiation successful
0809 15:35:23.637349 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 15:35:23.645624 4328 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8cb18510ec214436897efe8b30b072c9 [term 1 FOLLOWER]: Refusing update from remote peer d660d9071dba483ebb88b9b65006387a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:35:23.645624 4248 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0071ad0595c94774a0f803e3723fc6b8 [term 1 FOLLOWER]: Refusing update from remote peer d660d9071dba483ebb88b9b65006387a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 15:35:23.646214 4415 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d660d9071dba483ebb88b9b65006387a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cb18510ec214436897efe8b30b072c9" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 38571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:35:23.646644 4415 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d660d9071dba483ebb88b9b65006387a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0071ad0595c94774a0f803e3723fc6b8" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 40829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 15:35:23.650074 4381 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0071ad0595c94774a0f803e3723fc6b8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d660d9071dba483ebb88b9b65006387a. Latest consensus state: current_term: 1 leader_uuid: "d660d9071dba483ebb88b9b65006387a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d660d9071dba483ebb88b9b65006387a" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 32913 } } peers { permanent_uuid: "0071ad0595c94774a0f803e3723fc6b8" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 40829 } } peers { permanent_uuid: "8cb18510ec214436897efe8b30b072c9" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 38571 } } }
I20260809 15:35:23.650177 4381 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0071ad0595c94774a0f803e3723fc6b8 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:35:23.654001 4364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cb18510ec214436897efe8b30b072c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d660d9071dba483ebb88b9b65006387a. Latest consensus state: current_term: 1 leader_uuid: "d660d9071dba483ebb88b9b65006387a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d660d9071dba483ebb88b9b65006387a" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 32913 } } peers { permanent_uuid: "0071ad0595c94774a0f803e3723fc6b8" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 40829 } } peers { permanent_uuid: "8cb18510ec214436897efe8b30b072c9" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 38571 } } }
I20260809 15:35:23.654107 4364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cb18510ec214436897efe8b30b072c9 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:35:23.660341 4420 mvcc.cc:205] Tried to move back new op lower bound from 7316642708046807040 to 7316642707926872064. Current Snapshot: MvccSnapshot[applied={T|T < 7316642708046807040}]
I20260809 15:35:23.660755 4395 sys_catalog.cc:455] T 00000000000000000000000000000000 P d660d9071dba483ebb88b9b65006387a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d660d9071dba483ebb88b9b65006387a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d660d9071dba483ebb88b9b65006387a" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 32913 } } peers { permanent_uuid: "0071ad0595c94774a0f803e3723fc6b8" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 40829 } } peers { permanent_uuid: "8cb18510ec214436897efe8b30b072c9" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 38571 } } }
I20260809 15:35:23.660861 4395 sys_catalog.cc:458] T 00000000000000000000000000000000 P d660d9071dba483ebb88b9b65006387a [sys.catalog]: This master's current role is: LEADER
I20260809 15:35:23.664135 4381 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0071ad0595c94774a0f803e3723fc6b8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d660d9071dba483ebb88b9b65006387a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d660d9071dba483ebb88b9b65006387a" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 32913 } } peers { permanent_uuid: "0071ad0595c94774a0f803e3723fc6b8" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 40829 } } peers { permanent_uuid: "8cb18510ec214436897efe8b30b072c9" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 38571 } } }
I20260809 15:35:23.664254 4381 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0071ad0595c94774a0f803e3723fc6b8 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:35:23.666338 4418 catalog_manager.cc:1347] Generated new cluster ID: eef32eee8db54512a79f753de7894624
I20260809 15:35:23.666432 4418 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 15:35:23.666734 4415 sys_catalog.cc:455] T 00000000000000000000000000000000 P d660d9071dba483ebb88b9b65006387a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d660d9071dba483ebb88b9b65006387a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d660d9071dba483ebb88b9b65006387a" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 32913 } } peers { permanent_uuid: "0071ad0595c94774a0f803e3723fc6b8" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 40829 } } peers { permanent_uuid: "8cb18510ec214436897efe8b30b072c9" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 38571 } } }
I20260809 15:35:23.666846 4415 sys_catalog.cc:458] T 00000000000000000000000000000000 P d660d9071dba483ebb88b9b65006387a [sys.catalog]: This master's current role is: LEADER
I20260809 15:35:23.667904 4364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cb18510ec214436897efe8b30b072c9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d660d9071dba483ebb88b9b65006387a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d660d9071dba483ebb88b9b65006387a" member_type: VOTER last_known_addr { host: "127.11.146.62" port: 32913 } } peers { permanent_uuid: "0071ad0595c94774a0f803e3723fc6b8" member_type: VOTER last_known_addr { host: "127.11.146.61" port: 40829 } } peers { permanent_uuid: "8cb18510ec214436897efe8b30b072c9" member_type: VOTER last_known_addr { host: "127.11.146.60" port: 38571 } } }
I20260809 15:35:23.667995 4364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cb18510ec214436897efe8b30b072c9 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 15:35:23.668493 4424 mvcc.cc:205] Tried to move back new op lower bound from 7316642708046807040 to 7316642707926872064. Current Snapshot: MvccSnapshot[applied={T|T < 7316642708046807040}]
I20260809 15:35:23.700354 4418 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 15:35:23.701522 4418 catalog_manager.cc:1504] Loading token signing keys...
I20260809 15:35:23.714262 4418 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d660d9071dba483ebb88b9b65006387a: Generated new TSK 0
I20260809 15:35:23.715003 4418 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 15:35:23.749466 4362 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:35:23.746835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54872 (local address 127.11.146.60:38571)
0809 15:35:23.746971 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:23.746975 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:23.748449 (+ 1474us) server_negotiation.cc:407] Connection header received
0809 15:35:23.748630 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:23.748633 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:23.748677 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:23.748727 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:23.749344 (+ 617us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54872: BlockingRecv error: recv got EOF from 127.0.0.1:54872 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
W20260809 15:35:23.750909 4283 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:35:23.746438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38236 (local address 127.11.146.61:40829)
0809 15:35:23.746552 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:23.746557 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:23.750086 (+ 3529us) server_negotiation.cc:407] Connection header received
0809 15:35:23.750242 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:23.750245 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:23.750288 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:23.750336 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:23.750799 (+ 463us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38236: BlockingRecv error: recv got EOF from 127.0.0.1:38236 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260809 15:35:23.752301 4199 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:35:23.747287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39792 (local address 127.11.146.62:32913)
0809 15:35:23.747397 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:23.747401 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:23.751476 (+ 4075us) server_negotiation.cc:407] Connection header received
0809 15:35:23.751633 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:23.751636 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:23.751680 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:23.751728 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:23.752201 (+ 473us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39792: BlockingRecv error: recv got EOF from 127.0.0.1:39792 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260809 15:35:23.762351 4283 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:35:23.760572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38238 (local address 127.11.146.61:40829)
0809 15:35:23.760679 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:23.760683 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:23.761207 (+ 524us) server_negotiation.cc:407] Connection header received
0809 15:35:23.761482 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:23.761486 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:23.761652 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:23.761742 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:23.762262 (+ 520us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38238: BlockingRecv error: recv got EOF from 127.0.0.1:38238 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260809 15:35:23.767014 4283 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:35:23.765737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38254 (local address 127.11.146.61:40829)
0809 15:35:23.765825 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:23.765828 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:23.766243 (+ 415us) server_negotiation.cc:407] Connection header received
0809 15:35:23.766395 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:23.766398 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:23.766438 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:23.766482 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:23.766913 (+ 431us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38254: BlockingRecv error: recv got EOF from 127.0.0.1:38254 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
W20260809 15:35:23.773007 4283 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:35:23.771664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38270 (local address 127.11.146.61:40829)
0809 15:35:23.771746 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:23.771750 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:23.772282 (+ 532us) server_negotiation.cc:407] Connection header received
0809 15:35:23.772433 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:23.772435 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:23.772477 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:23.772522 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:23.772920 (+ 398us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38270: BlockingRecv error: recv got EOF from 127.0.0.1:38270 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
W20260809 15:35:23.780849 4283 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:35:23.779179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38280 (local address 127.11.146.61:40829)
0809 15:35:23.779326 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:23.779331 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:23.779817 (+ 486us) server_negotiation.cc:407] Connection header received
0809 15:35:23.780012 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:23.780015 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:23.780062 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:23.780149 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:23.780738 (+ 589us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38280: BlockingRecv error: recv got EOF from 127.0.0.1:38280 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260809 15:35:23.792164 4283 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:35:23.790872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38282 (local address 127.11.146.61:40829)
0809 15:35:23.791017 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:23.791023 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:23.791232 (+ 209us) server_negotiation.cc:407] Connection header received
0809 15:35:23.791339 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:23.791342 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:23.791387 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:23.791468 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:23.792066 (+ 598us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38282: BlockingRecv error: recv got EOF from 127.0.0.1:38282 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260809 15:35:23.811323 4283 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:35:23.810161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38294 (local address 127.11.146.61:40829)
0809 15:35:23.810270 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:23.810274 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:23.810525 (+ 251us) server_negotiation.cc:407] Connection header received
0809 15:35:23.810676 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:23.810679 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:23.810728 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:23.810812 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:23.811218 (+ 406us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38294: BlockingRecv error: recv got EOF from 127.0.0.1:38294 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260809 15:35:23.846287 4283 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:35:23.845328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38310 (local address 127.11.146.61:40829)
0809 15:35:23.845441 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:23.845445 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:23.845585 (+ 140us) server_negotiation.cc:407] Connection header received
0809 15:35:23.845677 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:23.845679 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:23.845721 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:23.845795 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:23.846165 (+ 370us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38310: BlockingRecv error: recv got EOF from 127.0.0.1:38310 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260809 15:35:23.913461 4283 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:35:23.912305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38324 (local address 127.11.146.61:40829)
0809 15:35:23.912452 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:23.912457 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:23.912599 (+ 142us) server_negotiation.cc:407] Connection header received
0809 15:35:23.912757 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:23.912767 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:23.912814 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:23.912905 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:23.913341 (+ 436us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38324: BlockingRecv error: recv got EOF from 127.0.0.1:38324 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260809 15:35:24.044839 4283 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:35:24.043625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38332 (local address 127.11.146.61:40829)
0809 15:35:24.043780 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:24.043784 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:24.043913 (+ 129us) server_negotiation.cc:407] Connection header received
0809 15:35:24.044126 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:24.044129 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:24.044178 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:24.044270 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:24.044721 (+ 451us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38332: BlockingRecv error: recv got EOF from 127.0.0.1:38332 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260809 15:35:24.303920 4283 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 15:35:24.302922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38340 (local address 127.11.146.61:40829)
0809 15:35:24.303061 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:24.303065 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:24.303145 (+ 80us) server_negotiation.cc:407] Connection header received
0809 15:35:24.303252 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:24.303255 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:24.303303 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:24.303376 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 15:35:24.303782 (+ 406us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38340: BlockingRecv error: recv got EOF from 127.0.0.1:38340 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 15:35:24.586449 4377 catalog_manager.cc:1259] Loaded cluster ID: eef32eee8db54512a79f753de7894624
I20260809 15:35:24.586539 4377 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8cb18510ec214436897efe8b30b072c9: loading cluster ID for follower catalog manager: success
I20260809 15:35:24.588198 4377 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8cb18510ec214436897efe8b30b072c9: acquiring CA information for follower catalog manager: success
I20260809 15:35:24.589356 4377 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8cb18510ec214436897efe8b30b072c9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 15:35:24.598991 4393 catalog_manager.cc:1259] Loaded cluster ID: eef32eee8db54512a79f753de7894624
I20260809 15:35:24.599054 4393 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0071ad0595c94774a0f803e3723fc6b8: loading cluster ID for follower catalog manager: success
I20260809 15:35:24.600718 4393 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0071ad0595c94774a0f803e3723fc6b8: acquiring CA information for follower catalog manager: success
I20260809 15:35:24.601890 4393 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0071ad0595c94774a0f803e3723fc6b8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 15:35:24.821795 4497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:24.818069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38356 (local address 127.11.146.61:40829)
0809 15:35:24.818291 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:24.818295 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:24.818361 (+ 66us) server_negotiation.cc:407] Connection header received
0809 15:35:24.818487 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:24.818489 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:24.818619 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:24.818725 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:35:24.818980 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:24.819482 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:24.820364 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:24.820586 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:24.820664 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:24.820953 (+ 289us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:35:24.821401 (+ 448us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:35:24.821490 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:24.821627 (+ 137us) server_negotiation.cc:299] Negotiation successful
0809 15:35:24.821677 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":90,"threads_started":1}
I20260809 15:35:24.827857 4503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:24.824644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54888 (local address 127.11.146.60:38571)
0809 15:35:24.824867 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:24.824870 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:24.824944 (+ 74us) server_negotiation.cc:407] Connection header received
0809 15:35:24.825075 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:24.825077 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:24.825178 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:24.825279 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:35:24.825483 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:24.825968 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:24.826653 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:24.826843 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:24.826929 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:24.827149 (+ 220us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:35:24.827491 (+ 342us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:35:24.827571 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:24.827629 (+ 58us) server_negotiation.cc:299] Negotiation successful
0809 15:35:24.827671 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":66,"threads_started":1}
I20260809 15:35:24.834771 4503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:24.831015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54896 (local address 127.11.146.60:38571)
0809 15:35:24.831146 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:24.831150 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:24.831398 (+ 248us) server_negotiation.cc:407] Connection header received
0809 15:35:24.831439 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:24.831442 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:24.831485 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:24.831559 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:35:24.831762 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:24.832562 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:24.833548 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:24.833826 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:24.833914 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:24.834279 (+ 365us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:35:24.834367 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:35:24.834413 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:24.834577 (+ 164us) server_negotiation.cc:299] Negotiation successful
0809 15:35:24.834634 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 15:35:24.834925 4497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:24.830971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38368 (local address 127.11.146.61:40829)
0809 15:35:24.831243 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:24.831246 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:24.831256 (+ 10us) server_negotiation.cc:407] Connection header received
0809 15:35:24.831289 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:24.831291 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:24.831323 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:24.831411 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:35:24.831874 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:24.832633 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:24.833767 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:24.834079 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:24.834195 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:24.834464 (+ 269us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:35:24.834534 (+ 70us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:35:24.834571 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:24.834755 (+ 184us) server_negotiation.cc:299] Negotiation successful
0809 15:35:24.834813 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206}
I20260809 15:35:24.835539 4511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 15:35:24.831051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39808 (local address 127.11.146.62:32913)
0809 15:35:24.831605 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0809 15:35:24.831611 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 15:35:24.831626 (+ 15us) server_negotiation.cc:407] Connection header received
0809 15:35:24.831709 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 15:35:24.831712 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 15:35:24.831890 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 15:35:24.832028 (+ 138us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 15:35:24.832277 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:24.832909 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:24.833969 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 15:35:24.834276 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 15:35:24.834396 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 15:35:24.834715 (+ 319us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 15:35:24.835094 (+ 379us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 15:35:24.835178 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 15:35:24.835308 (+ 130us) server_negotiation.cc:299] Negotiation successful
0809 15:35:24.835356 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":477,"thread_start_us":61,"threads_started":1}
I20260809 15:35:24.838387 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 4124
I20260809 15:35:24.847473 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 4203
I20260809 15:35:24.854519 11848 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taska0HXVP/build/debug/bin/kudu with pid 4282
2026-08-09T15:35:24Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3102 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6242 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (287425 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST